Lustreinfiniband #289
Open
Lustreinfiniband #289
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…over infiniband (IPoIB) Changes to files to enable Infiniband functionality: lfsmaster.sh lfsoss.sh lfsclient.sh lfsrepo.sh Addition for correct drives placement of OSSes : instaldrives.sh *installdrives.sh takes about 15 minutes to run so please either remote this entity, or wait it out.
…e using IP over infiniband (IPoIB) using the existing 700GB NVMe drives in the H series nodes Changes to files to enable Infiniband functionality: lfsmaster.sh lfsoss.sh lfsclient.sh lfsrepo.sh
…over infiniband (IPoIB) - lustre-rdma - This is a created implementation of Lustre using native Remote Direct Memory Access (RDMA) Changes to files to enable Infiniband functionality: lfsmaster.sh lfsoss.sh lfsclient.sh lfsrepo.sh lfspkgs.sh Addition for the installation of new OFED : installOFED.sh Addition for correct Lustre kernel : lustreinstall1.sh Lustre packages : lustreinstall2.sh Addition for rebooting of Lustre MDS/OSS: rebootlustre.sh Addition for pause after MDS/OSS reboot : waitforreboot.sh
…remove unnecessary lines
…remove unnecessary lines
…ition of lustre_rdma_avs
…y, so removing Infiniband components from headnode
hmeiland
reviewed
Jul 14, 2020
There was a problem hiding this comment.
- please use something smaller than hc44 for headnode (no hpc/ib requirements)
- do not rely on sleep for az resources to be made, better actively check
- why modify .ssh dir in lsf scripts? that should already be set up
- waagent isn't the only one trying to manage sdb; cloud-init is here as well...
- why install ofed on centos-hpc image?
- modify waagent.conf, but not restart?
- double modification of waagent.conf?
- sakey for saskey?
please update, so I can start functional tests.... thanks!
|
I have reduced the size of the headnode to a 'Standard_D8s_v3' since there is no infiniband connectivity with the Lustre servers anyway. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
lustre_rdma_nvmedrives:
Changes to files to enable Infiniband functionality:
lfsmaster.sh
lfsoss.sh
lfsclient.sh
lfsrepo.sh
lfspkgs.sh
Addition for the installation of new Mellanox OFED (MOFED) for the Lustre kernel : installMOFED.sh
Addition for correct drives placement of OSSes : installdrives.sh
*installdrives.sh takes about 15 minutes to run so please either remote this entity, or wait it out.
Additions for correct Lustre kernel :
lustreinstall1.sh
lustreinstall2.sh
Addition for pause after MDS/OSS reboot : waitforreboot.sh