It is a group of useful shell scripts for DevOps engineers, System administrators, and developers.
Each script has a different purpose and scripts are not related to each other. Find a useful script from this readme file then use it.
- try_interval.sh
- bulk_commands.sh
- backup_ftp.sh
- incremental-backup-smb.sh
- remove_old_created_files.sh
- archive-to-minio-using-mc.sh
- backup-dockerized-postgresql-to-smb.sh
- backup-website-files-and-db-to-smb.sh
- dump-postgresql-db-then-rsync.sh
- dump-dockerized-psql-db-then-rsync.sh
Try to execute a command until a successful result or reach a limitation in the number of tries based on an interval time between each try.
Example:
#./try_interval.sh -i 6 -n 3 mycommand
Execute the same command for all lines of a file as input.
For example, we have an IPs.txt file and each line of the file has an IP address. We want to allow all IPs to use iptables command. So we run:
#sudo ./bulk_commands.sh -f cdnips.txt iptables -A INPUT -s PARM -j ACCEPT
PARM is replaced by each line of the file (which contains an IP address in this example)
Create a tar.gz file from a given directory, then upload it to an ftp backup storage. If your backup storage supports secure protocols/methods (e.g: rsync/scp/sftp/...), you should use another method instead of FTP. You can use FTP_STORAGE_PASS environment variable instead of -p option.
Example usage:
#backup_ftp.sh -d /home/myuser/myfiles/ -o /tmp/backups/bkp-$(date '+%Y-%m-%d-%H-%M-%S').tar.gz -u b110973 -f b110973.myftpserver.org -p f67Eex1JsfR8bB -r
Create an incremental backup (using rsync) on each execution (for example the script is triggered by a cronjob) and create a full (tar) backup on a specific day of week and hour (which the cronjob runs at).
The destination is an SMB server.
Create the mount point destination manually before execution. Also, configure variables in the next step.
Find old created files (older than REMOVER_PAST_DAYS variable) and delete them.
Change REMOVER_DIR, REMOVER_PAST_DAYS and REMOVER_TODAY variables then use.
Archive files or backups in a MinIO bucket. This script ensures today's backup existence, uploads it to the bucket and then removes the oldest file (based on BKP_OLD_DATE variable) locally and remotely. requirements:
- mc command as minio client
- create an Alias for your bucket in mc command (https://min.io/docs/minio/linux/reference/minio-mc.html)
Create dump from a dockerized PostgreSQL database and save it locally, then upload it to a SMB storage.
Tested on Rocky 8, Please check commands (like /usr/bin/time -f %e) on another OS.
Create dump from a mysql database and compress website files, then mount a SMB storage and copy the backup to it.
Create dump from a Postgresql database. Then transfer the dump to a remote server using rsync.
Create dump from a dockerized Postgresql database. Then transfer the dump to a remote server using rsync.
Feel free and don't hesitate to contribute to this repository.