task/WI-221: Add retry decorator and retry system access steps during onboarding

[rstijerina]

Overview:

Add retry decorator, and retry steps during System Access step known to be time-sensitive.

PR Status:

• Ready.

Related Jira tickets:

• WI-221

Testing Steps:

1. Create a test user and delete their 'My Data'
2. Run the System Access step
3. Confirm that the step retries while the setfacl command is being run, until it succeeds.

Relevant logs showing retry

des_workers        | [DJANGO] $(processName)s INFO 2024-11-13 20:19:16,515 receivers designsafe.apps.api.notifications.receivers.send_setup_event:53: Sending setup event through websocket
des_workers        | [DJANGO] WARNING 2024-11-13 20:19:17,574 decorators designsafe.libs.common.decorators.f_retry:127: <class 'tapipy.errors.UnauthorizedError'>, Retrying in 3 seconds...
des_workers        | [DJANGO] $(processName)s WARNING 2024-11-13 20:19:17,574 decorators designsafe.libs.common.decorators.f_retry:127: <class 'tapipy.errors.UnauthorizedError'>, Retrying in 3 seconds...
des_workers        | [DJANGO] WARNING 2024-11-13 20:19:21,846 decorators designsafe.libs.common.decorators.f_retry:127: <class 'tapipy.errors.UnauthorizedError'>, Retrying in 6 seconds...
des_workers        | [DJANGO] $(processName)s WARNING 2024-11-13 20:19:21,846 decorators designsafe.libs.common.decorators.f_retry:127: <class 'tapipy.errors.UnauthorizedError'>, Retrying in 6 seconds...
des_workers        | [DJANGO] INFO 2024-11-13 20:19:30,155 system_access_v3 designsafe.apps.onboarding.steps.system_access_v3.process:165: Ensuring directory exists for user=sal_test then going to run setfacl on system=designsafe.storage.default path=sal_test