Comments on: How-To: Automated incremental daily backups to Amazon S3 using Duplicity

By: Bookmarks for October 21st – LostFocus

Bookmarks for October 21st – LostFocus — Fri, 21 Oct 2011 10:01:23 +0000

[...] How-To: Automated incremental daily backups to Amazon S3 using Duplicity | cenolan.com [...]

By: user GPG key not able to be used by SUDO - Admins Goodies

user GPG key not able to be used by SUDO - Admins Goodies — Sun, 21 Aug 2011 04:53:38 +0000

[...] Not really important but the script is modeled off a combination of these three sites: http://www.cenolan.com/2008/12/how-to-incremental-daily-backups-amazon-s3-duplicity/ [...]

By: mzweep

mzweep — Sat, 19 Feb 2011 10:09:50 +0000

Very usefull script and tutorial.

I refer to it a lot in a page I just write : http://wiki.qnap.com/wiki/How_To_Install_Duplicity_On_QNAP_NAS
Please keep it online as long as possible !

Warning for everyone : duplicity always use ~/.cache even when you use "--tempdir" option to specify another temp directory.
Next warning : you must have gpg command, not gpg2... just do a symlink between gpg->gpgp2 if needed.

For those who want to use duplicity as root, copy your ~/.gnupg to /root/.gnupg ...

By: Nathan Olsen

Nathan Olsen — Sat, 01 Jan 2011 19:15:43 +0000

Since I also got stuck on this step, I thought I'd follow up on Dave Abrahams note regarding sudo and $HOME.

The instructions on this page will create a gpg key for root, so restoring files will require accessing root's gpg keyring. If you plan to use sudo to manually restore files, the duplicity-restore script needs to be run using:

sudo -H duplicity-restore

Thanks for the great tutorial and scripts!

By: user GPG key not able to be used by SUDO Drija

user GPG key not able to be used by SUDO Drija — Thu, 18 Nov 2010 16:39:24 +0000

[...] Not really important but the script is modeled off a combination of these three sites: http://www.cenolan.com/2008/12/how-to-incremental-daily-backups-amazon-s3-duplicity/ [...]

By: How-To: Automated incremental daily backups to Amazon S3 using Duplicity › ec2base

Mon, 14 Dec 2009 07:54:22 +0000

[...] http://www.cenolan.com/2008/12/how-to-incremental-daily-backups-amazon-s3-duplicity/#more-54 [...]

By: Kearney

Kearney — Mon, 05 Oct 2009 15:58:35 +0000

Sam,

Duplicity uses rsync, which contains incremental changes. Those files won't be deleted because, even though the backup maybe older than 7 days, there are backups which are incrementals and younger than 7 days.

So, after 2 weeks have passed, those files will be deleted, since the full backup and the incremental backups are now 14 days old, and there exists a full backup newer than the full and incremental backups.

By: Sam S

Sam S — Sat, 01 Aug 2009 15:44:32 +0000

Nice script ... i was wondering if you could help me troubleshoot my issue. I keep getting the following message.

"Which can't be deleted because newer sets depend on them"

My variables are:

OLDER_THAN="14D"
FULL="7D"

What I've been doing is logging into S3 using the S3 plugin for Firefox and deleting the old sets that way. Any idea as to why it keeps failing?

By: Søren Vind >> Backing up to Amazon S3 (Part 2) - duplicity

Søren Vind >> Backing up to Amazon S3 (Part 2) - duplicity — Tue, 28 Apr 2009 20:09:28 +0000

[...] up the backup, I took a lot of inspiration from a blog post at cenolan.com and a blog post by Tim McCormack. Actually, “a lot of inspiration” may be an [...]

By: Søren Vind >> Backing up to Amazon S3 (Part 1)

Søren Vind >> Backing up to Amazon S3 (Part 1) — Mon, 20 Apr 2009 21:44:24 +0000

[...] http://www.cenolan.com/2008/12/how-to-incremental-daily-backups-amazon-s3-duplicity/ http://www.brainonfire.net/blog/remote-encrypted-backup-duplicity-amazon-s3/ [...]

By: thinking sysadmin / Duplicity to Amazon S3 on FreeBSD: Building on the work of others

Mon, 02 Mar 2009 19:48:54 +0000

[...] post adds only a couple small details to work described at randys.org and cenolan.com - go there for background on this post and useful scripts for automated Duplicity backup to [...]

By: kb.hurricane-ridge.com / Bookmarks for February 25, 2009

kb.hurricane-ridge.com / Bookmarks for February 25, 2009 — Fri, 27 Feb 2009 14:32:06 +0000

[...] How-To: Automated incremental daily backups to Amazon S3 using Duplicity | cenolan.com - Example s3 duplicity backup and restore scripts. Post a comment — Trackback URI RSS 2.0 feed for these comments This entry (permalink) was posted on Wednesday, February 25, 2009, at 8:21 am by admin. Filed in Links. [...]

By: Dave Abrahams

Dave Abrahams — Wed, 18 Feb 2009 08:13:57 +0000

Also, you might want to mention that people can really confuse duplicity if they use sudo to run the script manually without changing $HOME. Then GPG looks in the wrong place for key files.

By: Dave Abrahams

Dave Abrahams — Mon, 16 Feb 2009 20:43:46 +0000

Nice guide; Even though I had done something similar myself once, I found it useful to have a simple tutorial that walked me through the steps.

I was wondering why you didn't use duplicity's "--full-if-older-than 1M" option rather than coding the logic for making full backups yourself? If you miss the first day of the month due to downtime, you will fall behind on full backups.

We used to use shell scripts for this but I found it's really easy to lose important information when the script breaks for any reason. You can see http://techarcana.net/hydra/backups/ for rationale and links to our Python code.