Comments on: How-To: Automated incremental daily backups to Amazon S3 using Duplicity

By: How-To: Automated incremental daily backups to Amazon S3 using Duplicity › ec2base

Mon, 14 Dec 2009 07:54:22 +0000

[...] http://www.cenolan.com/2008/12/how-to-incremental-daily-backups-amazon-s3-duplicity/#more-54 [...]

By: Kearney

Kearney — Mon, 05 Oct 2009 15:58:35 +0000

Sam,

Duplicity uses rsync, which contains incremental changes. Those files won't be deleted because, even though the backup maybe older than 7 days, there are backups which are incrementals and younger than 7 days.

So, after 2 weeks have passed, those files will be deleted, since the full backup and the incremental backups are now 14 days old, and there exists a full backup newer than the full and incremental backups.

By: Sam S

Sam S — Sat, 01 Aug 2009 15:44:32 +0000

Nice script ... i was wondering if you could help me troubleshoot my issue. I keep getting the following message.

"Which can't be deleted because newer sets depend on them"

My variables are:

OLDER_THAN="14D"
FULL="7D"

What I've been doing is logging into S3 using the S3 plugin for Firefox and deleting the old sets that way. Any idea as to why it keeps failing?

By: Søren Vind >> Backing up to Amazon S3 (Part 2) - duplicity

Søren Vind >> Backing up to Amazon S3 (Part 2) - duplicity — Tue, 28 Apr 2009 20:09:28 +0000

[...] up the backup, I took a lot of inspiration from a blog post at cenolan.com and a blog post by Tim McCormack. Actually, “a lot of inspiration” may be an [...]

By: Søren Vind >> Backing up to Amazon S3 (Part 1)

Søren Vind >> Backing up to Amazon S3 (Part 1) — Mon, 20 Apr 2009 21:44:24 +0000

[...] http://www.cenolan.com/2008/12/how-to-incremental-daily-backups-amazon-s3-duplicity/ http://www.brainonfire.net/blog/remote-encrypted-backup-duplicity-amazon-s3/ [...]

By: thinking sysadmin / Duplicity to Amazon S3 on FreeBSD: Building on the work of others

Mon, 02 Mar 2009 19:48:54 +0000

[...] post adds only a couple small details to work described at randys.org and cenolan.com - go there for background on this post and useful scripts for automated Duplicity backup to [...]

By: kb.hurricane-ridge.com / Bookmarks for February 25, 2009

kb.hurricane-ridge.com / Bookmarks for February 25, 2009 — Fri, 27 Feb 2009 14:32:06 +0000

[...] How-To: Automated incremental daily backups to Amazon S3 using Duplicity | cenolan.com - Example s3 duplicity backup and restore scripts. Post a comment — Trackback URI RSS 2.0 feed for these comments This entry (permalink) was posted on Wednesday, February 25, 2009, at 8:21 am by admin. Filed in Links. [...]

By: Dave Abrahams

Dave Abrahams — Wed, 18 Feb 2009 08:13:57 +0000

Also, you might want to mention that people can really confuse duplicity if they use sudo to run the script manually without changing $HOME. Then GPG looks in the wrong place for key files.

By: Dave Abrahams

Dave Abrahams — Mon, 16 Feb 2009 20:43:46 +0000

Nice guide; Even though I had done something similar myself once, I found it useful to have a simple tutorial that walked me through the steps.

I was wondering why you didn't use duplicity's "--full-if-older-than 1M" option rather than coding the logic for making full backups yourself? If you miss the first day of the month due to downtime, you will fall behind on full backups.

We used to use shell scripts for this but I found it's really easy to lose important information when the script breaks for any reason. You can see http://techarcana.net/hydra/backups/ for rationale and links to our Python code.