-
Notifications
You must be signed in to change notification settings - Fork 3
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #6 from rafa-be/rename-to-parfun
Renames Parafun to Parfun.
- Loading branch information
Showing
133 changed files
with
273 additions
and
4,581 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,19 @@ | ||
__pychace__/ | ||
*.py[cod] | ||
*$py.class | ||
|
||
build/ | ||
dist/ | ||
eggs/ | ||
.eggs/ | ||
.idea/ | ||
sdist/ | ||
wheels/ | ||
*.egg-info/ | ||
*.egg | ||
venv/ | ||
|
||
.vscode/ | ||
|
||
dask-worker-space/* | ||
.pre-commit-config.yaml |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -3,34 +3,34 @@ | |
<img src="https://github.com/citi.png" alt="Citi" width="80" height="80"> | ||
</a> | ||
|
||
<h3 align="center">Citi/parafun</h3> | ||
<h3 align="center">Citi/parfun</h3> | ||
|
||
<p align="center"> | ||
Lightweight parallelisation library for Python. | ||
</p> | ||
|
||
<p align="center"> | ||
<a href="./LICENSE"> | ||
<img src="https://img.shields.io/github/license/citi/parafun?label=license&colorA=0f1632&colorB=255be3"> | ||
<img src="https://img.shields.io/github/license/citi/parfun?label=license&colorA=0f1632&colorB=255be3"> | ||
</a> | ||
</p> | ||
</div> | ||
|
||
<br /> | ||
|
||
Parafun is a lightweight library providing helpers to **make it easy to write and run a Python function in parallel | ||
Parfun is a lightweight library providing helpers to **make it easy to write and run a Python function in parallel | ||
and distributed systems**. | ||
|
||
The main feature of the library is its `@parafun` decorator that transparently executes standard Python functions | ||
The main feature of the library is its `@parfun` decorator that transparently executes standard Python functions | ||
following the [map-reduce](https://en.wikipedia.org/wiki/MapReduce) pattern: | ||
|
||
```Python | ||
from parafun import parafun | ||
from parafun.combine.collection import list_concat | ||
from parafun.partition.api import per_argument | ||
from parafun.partition.collection import list_by_chunk | ||
from parfun import parfun | ||
from parfun.combine.collection import list_concat | ||
from parfun.partition.api import per_argument | ||
from parfun.partition.collection import list_by_chunk | ||
|
||
@parafun( | ||
@parfun( | ||
split=per_argument( | ||
values=list_by_chunk | ||
), | ||
|
@@ -74,8 +74,8 @@ Your contributions are at the core of making this a true open source project. An | |
We welcome you to: | ||
|
||
- Fix typos or touch up documentation | ||
- Share your opinions on [existing issues](https://github.com/citi/parafun/issues) | ||
- Help expand and improve our library by [opening a new issue](https://github.com/citi/parafun/issues/new) | ||
- Share your opinions on [existing issues](https://github.com/citi/parfun/issues) | ||
- Help expand and improve our library by [opening a new issue](https://github.com/citi/parfun/issues/new) | ||
|
||
Please review our [community contribution guidelines](https://github.com/Citi/.github/blob/main/CONTRIBUTING.md) and | ||
[functional contribution guidelines](./CONTRIBUTING.md) to get started 👍. | ||
|
@@ -95,5 +95,5 @@ This project is distributed under the [Apache-2.0 License](https://www.apache.or | |
|
||
## Contact | ||
|
||
If you have a query or require support with this project, [raise an issue](https://github.com/Citi/parafun/issues). | ||
If you have a query or require support with this project, [raise an issue](https://github.com/Citi/parfun/issues). | ||
Otherwise, reach out to [[email protected]](mailto:[email protected]). |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,17 +1,17 @@ | ||
Backend | ||
======= | ||
|
||
.. automodule:: parafun.backend.mixins | ||
.. automodule:: parfun.backend.mixins | ||
:members: | ||
|
||
.. automodule:: parafun.backend.local_single_process | ||
.. automodule:: parfun.backend.local_single_process | ||
:members: | ||
|
||
.. automodule:: parafun.backend.local_multiprocessing | ||
.. automodule:: parfun.backend.local_multiprocessing | ||
:members: | ||
|
||
.. automodule:: parafun.backend.dask | ||
.. automodule:: parfun.backend.dask | ||
:members: | ||
|
||
.. automodule:: parafun.backend.scaler | ||
.. automodule:: parfun.backend.scaler | ||
:members: |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,18 +1,18 @@ | ||
Combining functions | ||
=================== | ||
|
||
.. automodule:: parafun.combine | ||
.. automodule:: parfun.combine | ||
|
||
|
||
Collections | ||
----------- | ||
|
||
.. automodule:: parafun.combine.collection | ||
.. automodule:: parfun.combine.collection | ||
:members: | ||
|
||
|
||
Dataframes | ||
---------- | ||
|
||
.. automodule:: parafun.combine.dataframe | ||
.. automodule:: parfun.combine.dataframe | ||
:members: |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,5 +1,5 @@ | ||
Entry Point | ||
=========== | ||
|
||
.. automodule:: parafun.entry_point | ||
.. automodule:: parfun.entry_point | ||
:members: |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,5 +1,5 @@ | ||
Utility functions | ||
================= | ||
|
||
.. automodule:: parafun.functions | ||
.. automodule:: parfun.functions | ||
:members: |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,7 +1,7 @@ | ||
API | ||
=== | ||
|
||
.. automodule:: parafun | ||
.. automodule:: parfun | ||
:members: | ||
|
||
.. toctree:: | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,36 +1,36 @@ | ||
Partitioning functions | ||
====================== | ||
|
||
.. automodule:: parafun.partition | ||
.. automodule:: parfun.partition | ||
|
||
|
||
Interface | ||
--------- | ||
|
||
.. automodule:: parafun.partition.object | ||
.. automodule:: parfun.partition.object | ||
:members: | ||
|
||
|
||
.. automodule:: parafun.partition.api | ||
.. automodule:: parfun.partition.api | ||
:members: | ||
|
||
|
||
Collections | ||
----------- | ||
|
||
.. automodule:: parafun.partition.collection | ||
.. automodule:: parfun.partition.collection | ||
:members: | ||
|
||
|
||
Dataframes | ||
---------- | ||
|
||
.. automodule:: parafun.partition.dataframe | ||
.. automodule:: parfun.partition.dataframe | ||
:members: | ||
|
||
|
||
Utilities | ||
--------- | ||
|
||
.. automodule:: parafun.partition.utility | ||
.. automodule:: parfun.partition.utility | ||
:members: |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.