Backup With Duplicati (Tech Preview)

Duplicati is a backup tool. It can group and compress a lot of small files into bigger blocks. It is a great tool for reducing the costs of cold storage.

Warning: The version used for writing this documentation is currently not yet available. Please wait for the next release or patch it manually. https://github.com/duplicati/duplicati/pull/4232

  1. Download and install the Duplicati installer file for your OS or run the docker container. Note warning above!

  2. Once installed, the software will open your browser to the local Duplicati dashboard. If not, it can be accessed at http://localhost:8200/

  3. On the Duplicati dashboard, click "Add Backup" and select "Configure a new backup"

Configure a new backup on Duplicati

4. Enter a name for this backup. For this example, we'll call it "My Backup Job". The Tardigrade plugin will encrypt all files before they get uploaded. We don't want to encrypt each file twice. Disable the Duplicati encryption.

General backup settings

5. Click the storage type dropdown and select "Tardigrade Decentralized Cloud Storage". Select a Tardigrade satellite, then enter an API key, encryption passphrase, bucket and optional a folder. You can generate a new API key at any time but please don't lose the encryption key - keep a backup in a safe place.

Backup destination

6. Next, press "Test Connection"

Test connection

7. On the next page, we will select the folder we want to backup. For this example, we will use "My Drive"

Source data

8. Now we will create a schedule. In this example, we will run the backup once every day at 1:00 PM.

Schedule

9. On the next page, select the appropriate options for you.

Options

Option

Description

asynchronous-concurrent-upload-limit=1

By default, Duplicati will transfer 4 files in parallel in order to speed up the transfer. The Tardigrade protocol splits every file upload into many small pieces and uploads them in parallel. Even with only 1 concurrent upload it should max out most consumer connections.

backup-test-samples=0

The Tardigrade protocol checks the hash at the end of every file upload. An additional test sample is not needed. Use list-verify-uploads instead.

list-verify-uploads=true

If a file upload fails for any reason, a final listing would catch it.

no-auto-compact=true

If a large number of small files are detected during a backup, or wasted space is found after deleting backups, the remote data will be compacted. This will cause a lot of unnecessary and expensive download traffic.

threshold

As files are changed, some data stored at the remote destination may not be required. This option controls how much wasted space the destination can contain before being reclaimed. Depending on the use case, the threshold can be reduced to 0. Tardigrade doesn't charge you for the additional delete and re-upload operations.

zip-compression-method

This option can be used to set an alternative compression method, such as LZMA.

10. Click "Save" and you should see the "My Backup Job" we created on the Duplicati page.

Duplicati Home Screen

11. You can select "Run now" if you would like to do a backup instantly.

Congrats, you've set up Duplicati Backup to Tardigrade! 🎉