Adding thousands of files at once (EMFILE)

[hacdias]

It seems that adding a directory with thousands of files on it can cause the EMFILE: too many open files error.

Ref.: #624 (comment)

[magik6k]

Is this error returned by go-ipfs? If yes then it is likely a bug in flatfs (I think so), opened ipfs/go-ds-flatfs#36.

Can you try this on a node with badger datastore - ipfs init --profile=badgerds or ipfs config profile apply badgerds+ipfs-ds-convert convert --keep?

[hacdias]

Since I couldn't replicate this error: @lidel or @olizilla could you try do do what @magik6k said?

@magik6k the error is returned by js-ipfs-api, thus I think it is returned by go-ipfs.

[hacdias]

@magik6k could you test if you have this error with the latest version?

[magik6k]

I'm assuming this should be done via the 'Files' screen. I can't add folders at all through there, it just fails with Failed to add files to IPFS. Please try again. - adding single file works fine. (running from source with npm i + npm start, node 11.5.0, npm 6.5.0)

[hacdias]

This bug was fixed on the latest version! Closing 😃