Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document backups for homedirs on AWS #3185

Open
consideRatio opened this issue Sep 28, 2023 · 1 comment
Open

Document backups for homedirs on AWS #3185

consideRatio opened this issue Sep 28, 2023 · 1 comment

Comments

@consideRatio
Copy link
Contributor

consideRatio commented Sep 28, 2023

With #3182 we have backups enabled on all the homedir storage on AWS. I was initially worried about costs, but reading up about it I'm less concerned now. This is anyhow something that we should probably end up documenting, so I've summarized some learnings below.

Related info

  • Default retention policy (used by us)

    The default EFS backup plan uses the AWS Backup recommended settings for automatic backups—daily backups with a 35-day retention period.

  • Backup consistency

    To ensure consistent backups, we recommend that you pause applications or processes that are modifying the file system for the duration of the backup process. Or, schedule your backups to occur during periods when the file system is not being modified.

  • Backup performance

    In general, you can expect the following backup rates with AWS Backup:

    • 100 MB/s for file systems composed of mostly large files
    • 500 files/s for file systems composed of mostly small files
      The maximum duration for a backup operation in AWS Backup is thirty days.
  • Incremental backups

    AWS Backup performs incremental backups of EFS file systems. During the initial backup, a copy of the entire file system is made. During subsequent backups of that file system, only files and directories that have been changed, added, or removed are copied. With each incremental backup, AWS Backup retains the necessary reference data to allow a full restore. This approach minimizes the time required to complete the backup and saves on storage costs by not duplicating data.

  • Complete and partial restores

    You can perform a Complete restore, which restores the entire file system. Or, you can restore specific files and directories using a Partial restore.

@consideRatio consideRatio changed the title Follow up to automatic backups for homedirs on AWS with documentation Document backups for homedirs on AWS Sep 28, 2023
@damianavila
Copy link
Contributor

Additionally, I think we might be interested in documenting a "recovery" scenario where some information from homesdirs is somehow lost.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
Status: Needs Shaping / Refinement
Development

No branches or pull requests

3 participants