Place limits on the repeated use of individual worker processes

[candleindark]

Place limits on the repeated use of individual worker processes. If a worker process has been used more than 1000 times or has used more than 500MB resident memory, it will be replaced by a new worker process. These configurations are put in place to control affect of possible memory leaks.

For more information, please check out the following documentations.

1. https://docs.celeryq.dev/en/stable/userguide/workers.html#max-tasks-per-child-setting
2. https://docs.celeryq.dev/en/stable/userguide/configuration.html#std-setting-worker_max_tasks_per_child

[codecov]

Codecov Report

Patch and project coverage have no change.

Comparison is base (81a9f36) 98.31% compared to head (e695061) 98.31%.

Additional details and impacted files

@@           Coverage Diff           @@
##           master     #229   +/-   ##
=======================================
  Coverage   98.31%   98.31%           
=======================================
  Files          40       40           
  Lines        1542     1542           
=======================================
  Hits         1516     1516           
  Misses         26       26           

Files Changed	Coverage Δ
datalad_registry/conf.py	97.95% <ø> (ø)
datalad_registry/tests/test__init__.py	100.00% <ø> (ø)
datalad_registry/tests/test_conf.py	100.00% <ø> (ø)

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.