Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MALA v1.2.0 #471

Merged
merged 472 commits into from
Sep 28, 2023
Merged
Show file tree
Hide file tree
Changes from 250 commits
Commits
Show all changes
472 commits
Select commit Hold shift + click to select a range
d2872a1
Removed workaround for XClib
RandomDefaultUser Jan 19, 2023
dec7862
Merge pull request #409 from mala-project/nvidia_performance_changes
RandomDefaultUser Jan 20, 2023
8558b74
Added class for ACSD analysis
RandomDefaultUser Jan 21, 2023
0e32636
ACSD analyzer works in MPI
RandomDefaultUser Jan 21, 2023
bddaeda
Added basic plotting ability
RandomDefaultUser Jan 21, 2023
694b861
Tested MPI successfully
RandomDefaultUser Jan 21, 2023
ac1aeac
Added example and fixed docs
RandomDefaultUser Jan 21, 2023
479c2e3
Adapted test
RandomDefaultUser Jan 21, 2023
575f983
Fixed MPI and tested for cube files
RandomDefaultUser Jan 21, 2023
d50e06e
Made ACSD example a tad faster
RandomDefaultUser Jan 21, 2023
7592a3f
Fixed OAT hyperparameter
RandomDefaultUser Jan 21, 2023
9587ceb
Fixed old merge conflict
RandomDefaultUser Jan 21, 2023
1e578b4
ACSD test now with lammps warning
RandomDefaultUser Jan 21, 2023
4b983a6
Reduced overhead of ex09
RandomDefaultUser Jan 21, 2023
e59b43c
Merge pull request #411 from RandomDefaultUser/acsd_convenience
RandomDefaultUser Jan 21, 2023
8813949
Added new Tester convenience function
RandomDefaultUser Jan 21, 2023
a34d3ad
Adapted examples
RandomDefaultUser Jan 21, 2023
6a13d63
Fixed docstring
RandomDefaultUser Jan 21, 2023
2a75d9d
Merge pull request #412 from RandomDefaultUser/tester_convenience
RandomDefaultUser Jan 21, 2023
4f7624c
Removed Al36 data from mala
RandomDefaultUser Jan 21, 2023
1bf3c1e
Merge pull request #413 from RandomDefaultUser/remove_al_data
RandomDefaultUser Jan 21, 2023
65ce277
Implemented unified runner interface
RandomDefaultUser Jan 21, 2023
93f85b8
Fixed some tests and examples
RandomDefaultUser Jan 21, 2023
5dfcc4b
Fixed docstrings
RandomDefaultUser Jan 21, 2023
942a004
Made workflow tests independent of another
RandomDefaultUser Jan 21, 2023
335d98f
Merge pull request #414 from RandomDefaultUser/complete_checkpoints
RandomDefaultUser Jan 21, 2023
a0c19d0
Enabled ACSD for atomic density
RandomDefaultUser Jan 22, 2023
97ce46a
Merge pull request #415 from RandomDefaultUser/acsd_atomic_density
RandomDefaultUser Jan 22, 2023
18ff6f5
Implemented DataShuffler class
RandomDefaultUser Jan 27, 2023
d590201
Added seed for shuffler
RandomDefaultUser Feb 6, 2023
a04c11c
Fixed typo
RandomDefaultUser Feb 6, 2023
73c6a37
Added note about seed to example
RandomDefaultUser Feb 6, 2023
aec8a6d
Added test for training
RandomDefaultUser Feb 6, 2023
1fe97f0
Fixed the docs
RandomDefaultUser Feb 6, 2023
03ef3fa
Improved docstring of add_snapshot
RandomDefaultUser Feb 6, 2023
8ba39b6
Improved shuffling algorithm
RandomDefaultUser Feb 6, 2023
7b3b0bd
Added option to split descriptor and target path
RandomDefaultUser Feb 6, 2023
ba7f9f6
Made it possible to save shuffled data to OpenPMD
RandomDefaultUser Feb 6, 2023
c875cda
Merge pull request #416 from RandomDefaultUser/data_shuffling
RandomDefaultUser Feb 7, 2023
f426373
Made data preparation default for trainer loading
RandomDefaultUser Feb 16, 2023
4b5b401
Merge pull request #419 from RandomDefaultUser/trainer_load_defaukt
RandomDefaultUser Feb 16, 2023
de82966
Incorporated raw changes from Josh
RandomDefaultUser Feb 16, 2023
7ff37b5
added unisolvent nodes to the examples
szabo137 Feb 20, 2023
7d20955
added generation and transforming of unisolvent nodes
szabo137 Feb 20, 2023
bccedc0
Forgot to add file from Josh
RandomDefaultUser Feb 20, 2023
a6c4f40
Unisolvent nodes added to MinterPyDescriptor class
RandomDefaultUser Feb 20, 2023
a982340
Merge branch 'develop_lenz' into minterpy_descriptors
RandomDefaultUser Feb 21, 2023
bcb1ecc
Fixed merge conflict
RandomDefaultUser Feb 21, 2023
2354e21
ACSD analysis for minterpy
RandomDefaultUser Feb 21, 2023
15778fd
ACSD working for Minterpy descriptors
RandomDefaultUser Feb 21, 2023
0ed9233
Allowing full output for tests
RandomDefaultUser Feb 21, 2023
2a52464
Merge pull request #420 from RandomDefaultUser/more_tester_options
RandomDefaultUser Feb 21, 2023
4cb3090
Updated example
RandomDefaultUser Feb 22, 2023
d0e1f39
Updated ACSD analysis
RandomDefaultUser Feb 23, 2023
b9baf8a
Fixed bug in MinterpyDescriptors
RandomDefaultUser Feb 27, 2023
b8371a9
Improved upon ACSD analysis
RandomDefaultUser Feb 27, 2023
df7451a
Merge pull request #421 from RandomDefaultUser/acsd_improvements
RandomDefaultUser Mar 2, 2023
c4d8766
First round of refactoring
RandomDefaultUser Mar 2, 2023
90f3741
Added missing class by Josh
RandomDefaultUser Mar 2, 2023
6155b03
More refactoring
RandomDefaultUser Mar 2, 2023
8d74131
Removed some timing output and fixed the DataScaler
RandomDefaultUser Mar 10, 2023
a529c2d
Adapted ASE calculator to new data loading
RandomDefaultUser Mar 10, 2023
c0407b2
Merge branch 'develop_lenz' into fixing_for_tutorial
RandomDefaultUser Mar 10, 2023
54b2fe6
Improved ASE interface
RandomDefaultUser Mar 13, 2023
7eed241
Adding missing whitespaces in ACSD
RandomDefaultUser Mar 13, 2023
d7f37c3
Added missing imports
RandomDefaultUser Mar 13, 2023
343633b
Fixed bug with alternating LAMMPS serial/parallel usage
RandomDefaultUser Mar 13, 2023
9224721
Merge pull request #425 from RandomDefaultUser/fixing_for_tutorial
RandomDefaultUser Mar 14, 2023
1d116a8
Made saving/loading additional calculation data part of the regular m…
RandomDefaultUser Mar 16, 2023
5a1550d
Added direct interface to target calculators and temperature as optio…
RandomDefaultUser Mar 16, 2023
7d15a74
Small bugfix
RandomDefaultUser Mar 16, 2023
8b623c3
Fixed tests
RandomDefaultUser Mar 16, 2023
697675c
Merge pull request #426 from RandomDefaultUser/save_additional_data
RandomDefaultUser Mar 16, 2023
6bdebe2
Moved actual energy calculation into try-except safeguard
RandomDefaultUser Mar 16, 2023
5c94b6c
Merge pull request #428 from RandomDefaultUser/fix_band_energy_metric
RandomDefaultUser Mar 16, 2023
f112fba
added minus sign in front of early_stopping_threshold contribution to…
kyledmiller Mar 16, 2023
a0198c9
clarified description of early_stopping_threshold
kyledmiller Mar 16, 2023
d64ca2c
Merge pull request #430 from kyledmiller/fix_early_stopping
RandomDefaultUser Mar 17, 2023
1882332
Made clear_data() the default behavior of the DataHandler initializat…
RandomDefaultUser Mar 28, 2023
2395208
Merge pull request #432 from RandomDefaultUser/no_clear_data
RandomDefaultUser Mar 28, 2023
757669d
Fixed pipeline
RandomDefaultUser Mar 28, 2023
0c4f9a9
Made DOS integration FP64 by default
RandomDefaultUser Mar 29, 2023
501bc8b
Merge branch 'develop_lenz' into float_precision_32
RandomDefaultUser Mar 29, 2023
5296c5d
Made conversion in FP32 possible
RandomDefaultUser Mar 29, 2023
afa00c9
Atomic density requires double precision in TEM mode
RandomDefaultUser Mar 30, 2023
d8bd1ad
Since .astype copies, only call it when needed
RandomDefaultUser Mar 30, 2023
2c7cf12
Adjusted comments
RandomDefaultUser Mar 30, 2023
0fc5075
Added central parameter for FP accuracy
RandomDefaultUser Mar 30, 2023
c783ab2
Shortened default readout of dict values
RandomDefaultUser Mar 31, 2023
11d6503
Merge pull request #435 from RandomDefaultUser/float_precision_32
RandomDefaultUser Apr 5, 2023
6cea77d
Merge branch 'develop_lenz' into lazy_loading_nvidia
RandomDefaultUser Apr 5, 2023
eb40a95
Re-added pickling code from Josh that I initially forgot
RandomDefaultUser Apr 6, 2023
3a267f7
Renaming parameter
RandomDefaultUser Apr 6, 2023
c35be8a
Tried fixing the memory leak warning at shutdown, succeeded 50%
RandomDefaultUser Apr 6, 2023
2d9f095
Fixed length of lazy load dataset single
RandomDefaultUser Apr 6, 2023
fff3cd4
Added a test
RandomDefaultUser Apr 6, 2023
2a8468c
Adapted the CI for FP32
RandomDefaultUser Apr 6, 2023
5c26510
Merge pull request #437 from RandomDefaultUser/CI_at_FP32
RandomDefaultUser Apr 6, 2023
ad3e147
Merge branch 'develop_lenz' into lazy_loading_nvidia
RandomDefaultUser Apr 6, 2023
88b6341
Git LFS mentioned in docs now
RandomDefaultUser Apr 6, 2023
17b05a1
Merge pull request #438 from RandomDefaultUser/mention_gitlfs
RandomDefaultUser Apr 6, 2023
925946d
Added a test for NASWOT
RandomDefaultUser Apr 6, 2023
5d703d4
Added density and DOS as options to tester
RandomDefaultUser Apr 7, 2023
89d2e57
Merge pull request #440 from RandomDefaultUser/tester_density_dos
RandomDefaultUser Apr 7, 2023
37a9ae2
Merge branch 'develop_lenz' into tem_gpu
RandomDefaultUser Apr 12, 2023
d12994f
band energy works with prefetching now
RandomDefaultUser Apr 12, 2023
6503b70
Added shutdown command as suggested by Josh
RandomDefaultUser Apr 12, 2023
b43774b
Implemented Josh's memory leak fix
RandomDefaultUser Apr 13, 2023
d0eb4ca
Merge pull request #434 from RandomDefaultUser/lazy_loading_nvidia
RandomDefaultUser Apr 13, 2023
f5395e1
expanded predict_targets to work for all 3 partitions, tr, va, te
kyledmiller Apr 21, 2023
24de08a
set Tester data_type default to 'te' for compatibility, propagated pa…
kyledmiller Apr 21, 2023
feda942
corrected *_data_set to *_data_sets[0]
kyledmiller Apr 22, 2023
8d44756
fixed minor bug
kyledmiller Apr 22, 2023
6c4b4eb
Merge pull request #442 from kyledmiller/expand_tester
RandomDefaultUser Apr 24, 2023
0eff3bd
For LDOS and density, the grid dimensions are now read alongside data…
RandomDefaultUser Apr 26, 2023
037ea4a
Merge pull request #444 from RandomDefaultUser/grid_dimensions_at_read
RandomDefaultUser Apr 26, 2023
50cc8f7
Made entropy contribution directly accessible via LDOS interface
RandomDefaultUser May 4, 2023
98e49c7
Merge pull request #446 from RandomDefaultUser/separate_entropy_calcu…
RandomDefaultUser May 4, 2023
6178128
Hotfix for other QE versions
RandomDefaultUser May 4, 2023
94284fb
Hotfix for entropy
RandomDefaultUser May 5, 2023
0849c72
Updated saving for ASE calculator (for MC simulations)
RandomDefaultUser May 16, 2023
9d3126c
Merge pull request #448 from mala-project/updating_ase_calculator
RandomDefaultUser May 16, 2023
d3bc98b
Merge branch 'develop_lenz' into naswot_test
RandomDefaultUser May 22, 2023
92a5313
Merge pull request #439 from RandomDefaultUser/naswot_test
RandomDefaultUser May 22, 2023
2a5b75b
Merge branch 'develop_lenz' into tem_gpu
RandomDefaultUser May 22, 2023
a0e5e22
Merge remote-tracking branch 'mala-main/develop' into minterpy_descri…
htahmasbi May 22, 2023
3733449
Minor changes. Add minterpy to installation.
htahmasbi May 23, 2023
9afd46e
Made adjustments for GPU lammps calculations
RandomDefaultUser May 23, 2023
0f37e0d
Hotfix missing entropy contribution
RandomDefaultUser May 23, 2023
bb99811
Extract __shuffle_numpy()
franzpoeschel Apr 26, 2023
26e046f
Add template for openPMD shuffling
franzpoeschel Apr 28, 2023
67baaac
Write all attributes
franzpoeschel Apr 28, 2023
5225746
Fix indexes
franzpoeschel Apr 28, 2023
d1a990f
Shuffle descriptors
franzpoeschel May 2, 2023
81a1cce
Shuffle target data
franzpoeschel May 2, 2023
03bb7e1
Some inline commenting
franzpoeschel May 22, 2023
c2e7cd5
Reduce number of output snapshots if necessary
franzpoeschel May 22, 2023
66f414f
Cleanup and comments
franzpoeschel May 22, 2023
3faf172
Refactoring: Don't repeat every line twice
franzpoeschel May 22, 2023
8fbf783
Ensure that shuffling is possible for different sized inputs
franzpoeschel May 22, 2023
5e1cbfa
Documentation/Hiding for nested classes
franzpoeschel May 22, 2023
630895d
Some comments
franzpoeschel May 23, 2023
bc56f1f
Undo unneeded whitespace changes
franzpoeschel May 23, 2023
93dd2b9
Added lammps input file
RandomDefaultUser May 23, 2023
a03fb60
Modify ex19 and file preprocessing.rst of docs.
htahmasbi May 23, 2023
cab53b1
Extended OpenPMD write function to include iteration number
RandomDefaultUser May 23, 2023
dae9178
Fix iteration index of input iteration in shuffler
franzpoeschel May 23, 2023
8d06951
Fix two little bugs
franzpoeschel May 24, 2023
714978d
Numpy huffling now includes iteration number and correct dtype
RandomDefaultUser May 24, 2023
0c1e218
examples: update clean script
elcorto May 23, 2023
07c263c
Merge pull request #445 from franzpoeschel/shuffle-from-openpmd
RandomDefaultUser May 24, 2023
257de6e
Update test-data to 1.7.0
franzpoeschel May 25, 2023
4ea028d
Add openPMD-api>=0.15 to requirements.txt
franzpoeschel May 23, 2023
58bbce8
Add shuffling_openpmd_test.py
franzpoeschel May 25, 2023
bda5f2b
Basically functioning version
franzpoeschel May 25, 2023
6d3dbbd
Skip MPI part for ranks that contribute nothing
franzpoeschel May 26, 2023
235e776
Use MPI for checking snapshots
franzpoeschel May 26, 2023
c2a6d59
tmp
franzpoeschel May 26, 2023
4be3f3b
Revert "tmp"
franzpoeschel May 26, 2023
e0a5ff0
Merge pull request #7 from htahmasbi/minterpy_descriptors
RandomDefaultUser Jun 2, 2023
bb79be4
Add an inline comment
franzpoeschel Jun 2, 2023
3b0ac79
Merge pull request #457 from mala-project/feature-update-example-clea…
RandomDefaultUser Jun 2, 2023
fba4ad2
Python interface to LAMMPS+Kokkos now works
RandomDefaultUser Jun 2, 2023
9659089
Merge pull request #458 from franzpoeschel/openpmd-shuffle-parallel
RandomDefaultUser Jun 6, 2023
3a91595
Combined shuffling tests
RandomDefaultUser Jun 6, 2023
1849232
Added preprocessing test and fixed a few bugs using this test
RandomDefaultUser Jun 6, 2023
9ec966f
Added an OpenPMD network training
RandomDefaultUser Jun 6, 2023
41515f3
Added a postprocessing test
RandomDefaultUser Jun 6, 2023
5eba685
Mention OpenPMD in the examples
RandomDefaultUser Jun 6, 2023
24ad97f
Mention OpenPMD in the documentation
RandomDefaultUser Jun 6, 2023
e85993e
Adjusted NASWOT accuracy
RandomDefaultUser Jun 6, 2023
648ed67
Remove ADIOS2 StatsLevel configuration
franzpoeschel Jun 6, 2023
974126a
Merge pull request #460 from mala-project/fix_naswot_test_2
RandomDefaultUser Jun 6, 2023
719f8ac
Added more documentation to shuffling test
RandomDefaultUser Jun 6, 2023
efd7111
Merge remote-tracking branch 'origin/develop' into openpmd-ci
RandomDefaultUser Jun 6, 2023
bbe94bf
Merge branch 'develop_lenz' into minterpy_descriptors
RandomDefaultUser Jun 6, 2023
8ff72f8
Deleted unnecessary files and changed example
RandomDefaultUser Jun 6, 2023
3736a88
Fixing the pipeline
RandomDefaultUser Jun 6, 2023
83f03be
Merge pull request #449 from franzpoeschel/openpmd-ci
RandomDefaultUser Jun 6, 2023
ff4b77a
Changed the MP docs
RandomDefaultUser Jun 6, 2023
69767c0
Made minterpy truly optional
RandomDefaultUser Jun 6, 2023
588c58d
Removed example
RandomDefaultUser Jun 6, 2023
207766a
More doc changes
RandomDefaultUser Jun 6, 2023
cc0d6d2
Fixed the docs
RandomDefaultUser Jun 7, 2023
ebdd01a
Merge pull request #459 from RandomDefaultUser/minterpy_descriptors
RandomDefaultUser Jun 7, 2023
bf4875a
Implemented multi lazy loading for OpenPMD
RandomDefaultUser Jun 7, 2023
f74e107
Merge pull request #461 from RandomDefaultUser/openpmd_multilazyloading
RandomDefaultUser Jun 7, 2023
1ed5665
Added finalize function and cleaned up LAMMPS init in descriptor class
RandomDefaultUser Jun 7, 2023
d444371
Merge branch 'develop_lenz' into lammps_gpu
RandomDefaultUser Jun 7, 2023
a86532f
Adapted ionic density and minterpy descriptors for new interface
RandomDefaultUser Jun 7, 2023
fe4ae7d
Added documentation.
RandomDefaultUser Jun 7, 2023
fdab03a
Merge pull request #450 from mala-project/lammps_gpu
RandomDefaultUser Jun 7, 2023
858d628
Log files are now separated again
RandomDefaultUser Jun 30, 2023
d4a92fa
Merge pull request #463 from mala-project/fix_lammps_logfile_names
RandomDefaultUser Jul 3, 2023
0b15537
Merge branch 'develop_lenz' into tem_gpu
RandomDefaultUser Jul 3, 2023
61ab8fa
Adapted build for QE7.2
RandomDefaultUser Jul 3, 2023
b05d1ac
Removed need for prepare_qe.sh and rewrote installation instructions
RandomDefaultUser Jul 3, 2023
084fa80
Merge pull request #405 from RandomDefaultUser/tem_gpu
RandomDefaultUser Jul 4, 2023
8674b79
Removed clustering from the codebase
RandomDefaultUser Jul 4, 2023
61030c4
Forgot to remove pkqmeans from setup.py
RandomDefaultUser Jul 4, 2023
dba1617
Merge pull request #464 from RandomDefaultUser/fix_modules
RandomDefaultUser Jul 4, 2023
5d73999
Fix ValueError in test_snapshot
Jul 5, 2023
e1a6841
(Re-)moving example files
RandomDefaultUser Jul 5, 2023
4f2e2db
Starting to rewrit landing page
RandomDefaultUser Jul 6, 2023
7aed1f3
Moved usage insttructions and fixed installation instructions
RandomDefaultUser Jul 6, 2023
f692fb1
Dtarted with usage
RandomDefaultUser Jul 7, 2023
2b2b1ca
Finished section on training and testing a model
RandomDefaultUser Jul 9, 2023
76de99f
Halfway done with hyperparameter section, finished data generation se…
RandomDefaultUser Jul 9, 2023
7c1f9f5
Continuing with hyperparams
RandomDefaultUser Jul 9, 2023
486a206
Hyperparams finished
RandomDefaultUser Jul 9, 2023
65108e5
Finished with basic examples
RandomDefaultUser Jul 9, 2023
b4f86c3
Started with advanced features
RandomDefaultUser Jul 10, 2023
aefb562
Finished with advanced training
RandomDefaultUser Jul 10, 2023
f902b63
Finished openPMD
RandomDefaultUser Jul 10, 2023
0dc88e0
Started descriptor text
RandomDefaultUser Jul 10, 2023
0232bc2
Finished with descriptors
RandomDefaultUser Jul 10, 2023
bb6f576
Started with hyperparameters
RandomDefaultUser Jul 10, 2023
eb8afc3
Finished with advanced hyperparameter section
RandomDefaultUser Jul 11, 2023
bfb0ba1
Added tensorboard, originally forgot that
RandomDefaultUser Jul 11, 2023
dfdcbf1
Halfway done with predictions section
RandomDefaultUser Jul 11, 2023
9dd3c25
Added notes in parallelization
RandomDefaultUser Jul 11, 2023
dc0f18f
Finished prediction section
RandomDefaultUser Jul 11, 2023
ecfcc20
Targeting different atomic structure for ex08
RandomDefaultUser Jul 11, 2023
5f18c8b
Fixed small mistakes
RandomDefaultUser Jul 11, 2023
632e39b
Fixed the contribution list(s)
RandomDefaultUser Jul 11, 2023
9c96b93
Mistake
RandomDefaultUser Jul 11, 2023
5253110
Small typo
RandomDefaultUser Jul 11, 2023
1884610
Typo in example
RandomDefaultUser Jul 11, 2023
6e8d9a4
Rewrote example test
RandomDefaultUser Jul 11, 2023
b6adb05
Small changes from meeting
RandomDefaultUser Jul 14, 2023
a968c01
Fix silent fail when grep doesn't find a match
elcorto Jul 27, 2023
30a01bf
Incorporated changes from meeting
RandomDefaultUser Jul 30, 2023
b221f92
Changes from Franz
RandomDefaultUser Jul 30, 2023
5d7270b
Changes by Attila
RandomDefaultUser Jul 30, 2023
6a79676
Removed simply and change to "python" to "Python"
RandomDefaultUser Jul 30, 2023
e1a2364
Addressed most of Steve's suggestions
RandomDefaultUser Jul 30, 2023
b7bad6c
Added copybutton
RandomDefaultUser Jul 30, 2023
bdb4dca
Merge pull request #467 from RandomDefaultUser/improve_defaults_and_docs
RandomDefaultUser Jul 30, 2023
1c40d69
Cleanup in build_total_energy_module.sh
elcorto Aug 1, 2023
d267e56
Fixed openPMD and ex07 test
RandomDefaultUser Aug 3, 2023
7170c26
Modified test order in the most unsavory way
RandomDefaultUser Aug 4, 2023
9da5d7e
Merge pull request #465 from nerkulec/fix_test_snapshot
RandomDefaultUser Aug 4, 2023
17747bd
Merge pull request #472 from elcorto/feature-fix-tem-build-silent-fail
RandomDefaultUser Aug 4, 2023
b64eca2
Merge pull request #479 from RandomDefaultUser/hotfix_openpmd_test
RandomDefaultUser Aug 4, 2023
965e61e
Basic implementation of uncorrelated snapshot parsing
RandomDefaultUser Sep 20, 2023
ba9b740
Uncorrelated snapshot sampling working now
RandomDefaultUser Sep 20, 2023
6d3357d
Fixed small docstring error
RandomDefaultUser Sep 20, 2023
c3033ca
Added malada compatability option
RandomDefaultUser Sep 20, 2023
4bc5adc
Fixed the cached property bit
RandomDefaultUser Sep 20, 2023
22bcefb
Merge pull request #485 from RandomDefaultUser/add_malada_feature
RandomDefaultUser Sep 20, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
28 changes: 14 additions & 14 deletions .github/workflows/cpu-tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -22,10 +22,10 @@ env:
jobs:
build-docker-image-cpu:
# Build and push temporary Docker image to GitHub's container registry
runs-on: ubuntu-20.04
runs-on: ubuntu-22.04
steps:
- name: Check out repository
uses: actions/checkout@v2
uses: actions/checkout@v3

- name: Set environment variables
run: |
Expand All @@ -37,7 +37,7 @@ jobs:
echo "IMAGE_REPO=$IMAGE_REPO"

- name: Restore cache
uses: actions/cache@v2
uses: actions/cache@v3
id: cache-docker
with:
path: ${{ env.DOCKER_CACHE_PATH }}
Expand All @@ -47,17 +47,17 @@ jobs:
id: check_file
run: |
if [[ -f "$DOCKER_CACHE_PATH/docker-image.tar.gz" ]]; then
echo '::set-output name=file_exists::true'
echo "FILE_EXISTS=true" >> $GITHUB_OUTPUT
else
echo '::set-output name=file_exists::false'
echo "FILE_EXISTS=false" >> $GITHUB_OUTPUT
fi

- name: Pull latest image from container registry
run: docker pull $IMAGE_REPO/$IMAGE_NAME || true

- name: Build temporary Docker image
run: |
if [[ "${{ steps.check_file.outputs.file_exists }}" == 'true' ]]
if [[ "${{ steps.check_file.outputs.FILE_EXISTS }}" == 'true' ]]
then
docker load -i $DOCKER_CACHE_PATH/docker-image.tar.gz
CACHE=$IMAGE_NAME:$GITHUB_RUN_ID
Expand Down Expand Up @@ -114,7 +114,7 @@ jobs:
steps:
- name: "Prepare environment: Restore cache"
if: env.DOCKER_TAG != 'latest'
uses: actions/cache@v2
uses: actions/cache@v3
id: cache-docker
with:
path: ${{ env.DOCKER_CACHE_PATH }}
Expand Down Expand Up @@ -145,7 +145,7 @@ jobs:
[[ $(docker inspect --format '{{json .State.Running}}' mala-cpu) == 'true' ]]

- name: Check out repository (mala)
uses: actions/checkout@v2
uses: actions/checkout@v3

- name: Install mala package
# Exec all commands inside the mala-cpu container
Expand All @@ -168,20 +168,20 @@ jobs:
diff env_1.yml env_2.yml

- name: Check out repository (data)
uses: actions/checkout@v2
uses: actions/checkout@v3
with:
repository: mala-project/test-data
path: mala_data
ref: v1.3.0
lfs: false
ref: v1.7.0
lfs: true

- name: Test mala
shell: 'bash -c "docker exec -i mala-cpu bash < {0}"'
run: MALA_DATA_REPO=$(pwd)/mala_data pytest -m "not examples" --disable-warnings

retag-docker-image-cpu:
needs: [cpu-tests, build-docker-image-cpu]
runs-on: ubuntu-20.04
runs-on: ubuntu-22.04
permissions:
packages: write
env:
Expand All @@ -194,11 +194,11 @@ jobs:
|| startsWith(github.ref, 'refs/tags/')
steps:
- name: Check out repository
uses: actions/checkout@v2
uses: actions/checkout@v3

- name: "Prepare environment: Restore cache"
if: env.DOCKER_TAG != 'latest'
uses: actions/cache@v2
uses: actions/cache@v3
id: cache-docker
with:
path: ${{ env.DOCKER_CACHE_PATH }}
Expand Down
14 changes: 7 additions & 7 deletions .github/workflows/gh-pages.yml
Original file line number Diff line number Diff line change
Expand Up @@ -11,13 +11,13 @@ on:

jobs:
test-docstrings:
runs-on: ubuntu-18.04
runs-on: ubuntu-22.04
steps:
- name: Check out repository
uses: actions/checkout@v2
uses: actions/checkout@v3

- name: Setup Python
uses: actions/setup-python@v2
uses: actions/setup-python@v4
with:
python-version: '3.8'

Expand All @@ -29,19 +29,19 @@ jobs:

- name: Check docstrings
# Ignoring the cached_properties because pydocstyle (sometimes?) treats them as functions.
run: pydocstyle --convention=numpy --ignore-decorators=cached_property mala
run: pydocstyle --convention=numpy --ignore-decorators=[cached_property,property] mala

build-and-deploy-pages:
needs: test-docstrings
runs-on: ubuntu-18.04
runs-on: ubuntu-22.04
steps:
- name: Check out repository
uses: actions/checkout@v2
uses: actions/checkout@v3
with:
fetch-depth: 0 # 0 fetches complete history and tags

- name: Setup Python
uses: actions/setup-python@v2
uses: actions/setup-python@v4
with:
python-version: '3.8'

Expand Down
10 changes: 6 additions & 4 deletions .github/workflows/mirror-to-casus.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,13 +4,15 @@ on: [push, delete]

jobs:
mirror-to-CASUS:
runs-on: ubuntu-18.04
runs-on: ubuntu-22.04
steps:
- uses: actions/checkout@v1
- uses: actions/checkout@v3
with:
fetch-depth: 0
- name: mirror-repository
uses: spyoungtech/mirror-action@v0.4.0
uses: spyoungtech/mirror-action@v0.6.0
with:
REMOTE: [email protected]:casus/mala.git
REMOTE: 'ssh://[email protected]/casus/mala.git'
GIT_SSH_PRIVATE_KEY: ${{ secrets.GIT_SSH_KEY }}
GIT_SSH_NO_VERIFY_HOST: "true"
DEBUG: "true"
6 changes: 3 additions & 3 deletions .github/workflows/publish-to-pypi.yml
Original file line number Diff line number Diff line change
Expand Up @@ -14,13 +14,13 @@ on:
jobs:
build-n-publish:
name: Build and publish Python 🐍 distributions 📦 to PyPI and TestPyPI
runs-on: ubuntu-20.04
runs-on: ubuntu-22.04
steps:
- name: Check out repository
uses: actions/checkout@v2
uses: actions/checkout@v3

- name: Set up Python 3.8
uses: actions/setup-python@v2
uses: actions/setup-python@v4
with:
python-version: '3.8'

Expand Down
6 changes: 6 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -173,3 +173,9 @@ cython_debug/

# Git files
.gitconfig

# HDF5 files
*.h5

*.zip
*~
41 changes: 40 additions & 1 deletion CITATION.cff
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,12 @@
cff-version: 1.1.0
message: "If you use this software, please cite it using these metadata."
authors:
- affiliation: "Center for Advanced Systems Understanding (CASUS), Helmholtz-Zentrum Dresden-Rossendorf e.V. (HZDR)"
family-names: Brzoza
given-names: Bartosz
- affiliation: "Center for Advanced Systems Understanding (CASUS), Helmholtz-Zentrum Dresden-Rossendorf e.V. (HZDR)"
family-names: Callow
given-names: Timothy J.
- affiliation: "Center for Advanced Systems Understanding (CASUS), Helmholtz-Zentrum Dresden-Rossendorf e.V. (HZDR)"
family-names: Cangi
given-names: Attila
Expand All @@ -10,38 +16,71 @@ authors:
family-names: Ellis
given-names: J. Austin
orcid: https://orcid.org/0000-0002-9901-102X
- affiliation: "Center for Advanced Systems Understanding (CASUS), Helmholtz-Zentrum Dresden-Rossendorf e.V. (HZDR)"
family-names: Faruk
given-names: Omar
- affiliation: "Center for Advanced Systems Understanding (CASUS), Helmholtz-Zentrum Dresden-Rossendorf e.V. (HZDR)"
family-names: Fiedler
given-names: Lenz
orcid: https://orcid.org/0000-0002-8311-0613
- affiliation: "Sandia National Laboratories (SNL)"
family-names: Fox
given-names: James S.
- affiliation: "Center for Advanced Systems Understanding (CASUS), Helmholtz-Zentrum Dresden-Rossendorf e.V. (HZDR)"
family-names: Hoffmann
given-names: Nils
- affiliation: "Sandia National Laboratories (SNL)"
family-names: Miller
given-names: Kyle D.
- affiliation: "Center for Advanced Systems Understanding (CASUS), Helmholtz-Zentrum Dresden-Rossendorf e.V. (HZDR)"
family-names: Kotik
given-names: Daniel
orcid: https://orcid.org/0000-0001-8735-3199
- affiliation: "Center for Advanced Systems Understanding (CASUS), Helmholtz-Zentrum Dresden-Rossendorf e.V. (HZDR)"
family-names: Kulkarni
given-names: Somashekar
- affiliation: "Sandia National Laboratories (SNL)"
family-names: Modine
given-names: Normand A.
- affiliation: "Center for Advanced Systems Understanding (CASUS), Helmholtz-Zentrum Dresden-Rossendorf e.V. (HZDR)"
family-names: Mohammed
given-names: Parvez
- affiliation: "Oak Ridge National Laboratory (ORNL)"
family-names: Oles
given-names: Vladyslav
- affiliation: "Sandia National Laboratories (SNL)"
family-names: Popoola
given-names: Gabriel A.
- affiliation: "Center for Advanced Systems Understanding (CASUS), Helmholtz-Zentrum Dresden-Rossendorf e.V. (HZDR)"
family-names: Pöschel
given-names: Franz
- affiliation: "Sandia National Laboratories (SNL)"
family-names: Rajamanickam
given-names: Siva
given-names: Sivasankaran
orcid: https://orcid.org/0000-0002-5854-409X
- affiliation: "Nvidia Corporation"
family-names: Romero
given-names: Josh
- affiliation: "Helmholtz-Zentrum Dresden-Rossendorf e.V. (HZDR)"
family-names: Schmerler
given-names: Steve
orcid: https://orcid.org/0000-0003-1354-0578
- affiliation: "Sandia National Laboratories (SNL)"
family-names: Stephens
given-names: J. Adam
- affiliation: "Center for Advanced Systems Understanding (CASUS), Helmholtz-Zentrum Dresden-Rossendorf e.V. (HZDR)"
family-names: Tahmasbi
given-names: Hossein
- affiliation: "Sandia National Laboratories (SNL)"
family-names: Thompson
given-names: Aidan P.
orcid: https://orcid.org/0000-0002-0324-9114
- affiliation: "Center for Advanced Systems Understanding (CASUS), Helmholtz-Zentrum Dresden-Rossendorf e.V. (HZDR)"
family-names: Verma
given-names: Sneha
- affiliation: "Sandia National Laboratories (SNL)"
family-names: Vogel
given-names: D. Jon


date-released: 2022-10-18
Expand Down
25 changes: 17 additions & 8 deletions Dockerfile
Original file line number Diff line number Diff line change
@@ -1,19 +1,28 @@
FROM continuumio/miniconda3:4.9.2
MAINTAINER Daniel Kotik <[email protected]>
FROM continuumio/miniconda3:22.11.1
LABEL maintainer="[email protected]"

# Update the image to the latest packages
RUN apt-get --allow-releaseinfo-change update && apt-get upgrade -y

RUN apt-get install --no-install-recommends -y build-essential libz-dev swig git-lfs cmake
RUN apt-get clean && rm -rf /var/lib/apt/lists/*
# Update the image and install essential packages
RUN apt-get --allow-releaseinfo-change update && apt-get upgrade -y && \
apt-get install --no-install-recommends -y \
build-essential \
libz-dev \
swig \
git-lfs \
cmake && \
apt-get clean && rm -rf /var/lib/apt/lists/*

# Choose 'cpu' or 'gpu'
ARG DEVICE=cpu
COPY install/mala_${DEVICE}_environment.yml .
RUN conda env create -f mala_${DEVICE}_environment.yml && rm -rf /opt/conda/pkgs/*

# Install optional MALA dependencies into Conda environment with pip
RUN /opt/conda/envs/mala-${DEVICE}/bin/pip install --no-input --no-cache-dir pytest oapackage==2.6.8 pqkmeans
RUN /opt/conda/envs/mala-${DEVICE}/bin/pip install --no-input --no-cache-dir \
pytest \
oapackage==2.6.8 \
openpmd-api==0.15.1 \
pqkmeans

RUN echo "source activate mala-${DEVICE}" > ~/.bashrc
ENV PATH /opt/conda/envs/mala-${DEVICE}/bin:$PATH

39 changes: 8 additions & 31 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,47 +25,24 @@ This repository is structured as follows:

> **WARNING**: Even if you install MALA via PyPI, please consult the full installation instructions afterwards. External modules (like the QuantumESPRESSO bindings) are not distributed via PyPI!

Please refer to [Installation of MALA](docs/source/install/README.md).
Please refer to [Installation of MALA](docs/source/install/installing_mala.rst).

## Running

You can familiarize yourself with the usage of this package by running
the examples in the `example/` folder.

## Institutions
### Founding Institutions
## Contributors

MALA is jointly maintained by

- [Sandia National Laboratories](https://www.sandia.gov/) (SNL), USA.
- Scientific supervisor: Sivasankaran Rajamanickam, code maintenance:
Jon Vogel
- [Center for Advanced Systems Understanding](https://www.casus.science/) (CASUS), Germany.
- Scientific supervisor: Attila Cangi, code maintenance: Lenz Fiedler

### Contributing Institutions

- [Oak Ridge National Laboratory](https://www.ornl.gov/) (ORNL), USA

## Developers
### Scientific Supervision
- Attila Cangi (CASUS)
- Siva Rajamanickam (SNL)

### Core Developers

- Austin Ellis (ORNL)
- Lenz Fiedler (CASUS)
- Daniel Kotik (CASUS)
- Normand Modine (SNL)
- Vladyslav Oles (ORNL)
- Gabriel Popoola (SNL)
- Aidan Thompson (SNL)
- Steve Schmerler (HZDR)
- Adam Stephens (SNL)

### Contributors

- Sneha Verma (CASUS)
- Parvez Mohammed (CASUS)
- Nils Hoffmann (CASUS)
- Omar Faruk (CASUS)
- Somashekhar Kulkarni (CASUS)
A full list of contributors can be found [here](docs/source/CONTRIBUTE.md).

## Citing MALA

Expand Down
1 change: 1 addition & 0 deletions docs/requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -3,3 +3,4 @@ Sphinx==4.5.*
sphinx-rtd-theme==1.0.0
myst-parser==0.17.2
sphinx-markdown-tables==0.0.17
sphinx-copybutton==0.5.1
Loading