Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

zstd compress for 10x size reduction of backups #4270

Draft
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

swiffer
Copy link
Contributor

@swiffer swiffer commented Oct 16, 2024

recommend taking backups with zstd compression for 10x size reduction

https://www.cybertec-postgresql.com/en/lz4-zstd-pg_dump-compression-postgresql-16/

Copy link

netlify bot commented Oct 16, 2024

Deploy Preview for teslamate ready!

Name Link
🔨 Latest commit 36f6af5
🔍 Latest deploy log https://app.netlify.com/sites/teslamate/deploys/671e038c7006b2000895709c
😎 Deploy Preview https://deploy-preview-4270--teslamate.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@swiffer swiffer force-pushed the docs-backup-zstd-10x-size-reduction branch from 191bf3e to 2796a07 Compare October 16, 2024 08:58
@JakobLichterfeld
Copy link
Collaborator

Thanks for the suggestion. As zstd is not standard on all operating systems, this is not operating system-independent. So a restore is possible as we use our docker but the backup file itself is not open-able on every system.

I strongly vote against any compression in backup creation. The user can compress backups afterward and store them compressed. I do a compressed upload every night for example. But this is total in user hand.

This also makes the command more error-prone, especially because of the spaces. An old backup cannot be restored with the command, etc.

@JakobLichterfeld JakobLichterfeld added kind:documentation Adds or improves documentation enhancement New feature or request note:discussion Details or approval are up for discussion labels Oct 16, 2024
@JakobLichterfeld JakobLichterfeld marked this pull request as draft October 19, 2024 13:06
@swiffer
Copy link
Contributor Author

swiffer commented Oct 19, 2024

ok, fine - would you consider a new page in "Guides" on how to backup (eg. daily) with a small backup script, compression options and crontab or is what we have enough?

@swiffer swiffer force-pushed the docs-backup-zstd-10x-size-reduction branch from 2796a07 to 36f6af5 Compare October 27, 2024 09:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request kind:documentation Adds or improves documentation note:discussion Details or approval are up for discussion
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants