Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
redhog authored Sep 11, 2024
1 parent 8cc026a commit 5adcef9
Showing 1 changed file with 7 additions and 0 deletions.
7 changes: 7 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,13 @@ luigi --module beryl_pipeline.inversion Inversion --inversion-name=file:///some/

This assumes you've copied `docs/example-real.yml` to `/some/temp/dir/config.yml`.

# Cloud computing support

All the pipeline tools use the [luigi OpenerTarget](https://luigi.readthedocs.io/en/stable/api/luigi.contrib.opener.html), which allows for accessing files on a host of file storage options,
including gcs and s3 by just using the appropriate URL schemes.

Note: There are two types of parallelization utilized by this pipeline system: Multiple luigi tasks can be run in parallel if multiple workers are supplied, potentially using multiple computers.
Additionally, SimPEG inversions are parallelized using threading, and can utlize any number of CPU:s available on a single computer.

# Unit tests

Expand Down

0 comments on commit 5adcef9

Please sign in to comment.