Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

parallelize algorithms #98

Open
thatbudakguy opened this issue Aug 5, 2020 · 0 comments
Open

parallelize algorithms #98

thatbudakguy opened this issue Aug 5, 2020 · 0 comments
Labels
enhancement New feature or request
Milestone
v3.0

Comments

@thatbudakguy
Copy link
Member

several stages of the data pipeline can be easily parallelized, especially the extension and alignment which take the most time. we should look at python's built-in multiprocessing module for this.

also worth a look is this spaCy example using joblib.
@thatbudakguy thatbudakguy transferred this issue from direct-phonology/dphon Aug 21, 2020
@thatbudakguy thatbudakguy transferred this issue from another repository Aug 23, 2020
@thatbudakguy thatbudakguy added the enhancement New feature or request label Oct 24, 2020
@thatbudakguy thatbudakguy added this to the v3.0 milestone Feb 19, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
v3.0
Development

No branches or pull requests
1 participant
@thatbudakguy