quick and easy backup solution

All Gurus once were Newbies
Forum rules
There are no such things as "stupid" questions. However if you think your question is a bit stupid, then this is the right place for you to post it. Please stick to easy to-the-point questions that you feel people can answer fast. For long and complicated questions prefer the other forums within the support section.
Before you post please read how to get help
rmcellig
Level 4
Level 4
Posts: 226
Joined: Sat May 28, 2011 11:47 am

quick and easy backup solution

Post by rmcellig » Mon Apr 14, 2014 7:38 am

I have an ever increasing folder containing many sub folders and consists of .flac files of my digitized LP's. I need to back this folder up on a regular basis. What are my options?

The source folder is on a Dell 3000 desktop computer.

My criteria:

I don't mind using code with Gnome-schedule so I can set up when to implement the backups.

A GUI solution is another possibility

I need to quickly recover the files and folders if need be.

I need something that will backup quickly

I need to back up to other computers on my LAN

Compression might be an option although I would assume it would slow the backup considerably

Thanks for the help!
Take care,

Randy
www.mcran.com - my web site
www.chuo.fm - My radio show every Sunday from noon-2pm or 89.1 fM

User avatar
WharfRat
Level 21
Level 21
Posts: 13440
Joined: Thu Apr 07, 2011 8:15 pm

Re: quick and easy backup solution

Post by WharfRat » Mon Apr 14, 2014 8:33 am

rmcellig,

I use rsync via ssh

Code: Select all

rsync -aviuzh  --progress --delete-during  /media/shared/script/ user@ipaddress:/media/shared/script/
To auto login to the remote system you can generate a public key with ssh-keygen so it will work unattended with a cron job.

Good luck :wink:
ImageImage

rmcellig
Level 4
Level 4
Posts: 226
Joined: Sat May 28, 2011 11:47 am

Re: quick and easy backup solution

Post by rmcellig » Mon Apr 14, 2014 8:54 am

At the moment I am using rsync over ssh to my other computers but I was wondering if rsync is a resource hog. I find it slows my computer right down so that I can barely use it. Might I be doing something wrong?

This is the code I am using in Gnome-Schedule:

Code: Select all

rsync -avr  /media/passport/lps/ randy@192.168.2.12:/media/lps/flaclps
Take care,

Randy
www.mcran.com - my web site
www.chuo.fm - My radio show every Sunday from noon-2pm or 89.1 fM

Riko
Level 3
Level 3
Posts: 129
Joined: Fri Dec 09, 2011 9:10 am
Location: Hamburg, Germany

Re: quick and easy backup solution

Post by Riko » Mon Apr 14, 2014 9:10 am

Hi,

you might want to limit the resource (CPU and IO) that rsync is using when doing the back, e.g.

Code: Select all

nice -n 19 ionice -c2 -n7 rsync ....
I suspect it's mostly HD acticity during the backup that slows down the computer.

I use backintime as a GUI frontend to define profiles of what (and what not) to backup where-to and when. In the end, it just uses crontab and rsync as a backend to get the job done. I found it easy to configure and when it runs doing so quietly (meaning un-noticed) in the background.

Cheers, Riko

PS: forgot to mention: backintime does incremental backups for you, so you can go back several versions of files/folders in the past. Accessing it is as simple as copy and paste out of the files ystem hierarchy of the backup. It also comes with a restore facility which I haven't have the chance (better need:) to try out.

User avatar
WharfRat
Level 21
Level 21
Posts: 13440
Joined: Thu Apr 07, 2011 8:15 pm

Re: quick and easy backup solution

Post by WharfRat » Mon Apr 14, 2014 1:11 pm

rmcellig,

I've synced large and small files without experiencing any slowdown at all. I'd check htop or top to see what's hogging resources.

Also you really don't need the recursive option with archive as archive will recurse folders.

Good luck :wink:
ImageImage

User avatar
eanfrid
Level 7
Level 7
Posts: 1859
Joined: Mon Apr 30, 2012 2:49 am
Location: FR

Re: quick and easy backup solution

Post by eanfrid » Mon Apr 14, 2014 1:23 pm

Depending on the file types, "-avu", "-avz" or "-avuz" rsync options may speed up the process. In addition to rsync, I also use rdiff-backup to store backups on LUKS encrypted remote/external drives.
Main desktop: Debian GNU/Linux Jessie 64bit - MATE
(i5 2400@3.7GHz - 16GB DDR3 - HD6770 w/radeon driver - SSD+RAID1)
Safer than Dropbox

gibbs1984
Level 5
Level 5
Posts: 798
Joined: Mon Oct 27, 2008 2:40 pm
Location: Hemel Hempstead, England

Re: quick and easy backup solution

Post by gibbs1984 » Mon Apr 14, 2014 5:18 pm

I use LuckyBackup, by far the easiest I've found to use.

Nice video here.
Linux Mint 19.0 (Cinnamon) 64bit.

User avatar
slipstick
Level 5
Level 5
Posts: 943
Joined: Sun Oct 21, 2012 9:56 pm
Location: Somewhere on the /LL0 scale

Re: quick and easy backup solution

Post by slipstick » Tue Apr 15, 2014 6:43 pm

I am new to the Linux world, having just installed LM16 last week and I'm also looking for a good backup solution. I found this article on-line which I thought might be of general interest - I'm still trying to wrap my head around it.

http://www.halfgaar.net/backing-up-unix
In theory, theory and practice are the same. In practice, they ain't.

DrM
Level 2
Level 2
Posts: 87
Joined: Sun Feb 23, 2014 4:03 pm

Re: quick and easy backup solution

Post by DrM » Sat Apr 19, 2014 8:36 am

Does LuckyBackup also support incremental and differential backups? Lucky Backup which uses Rsync as a back-end, does store the files to be backed up into a single large .ZIP archive. Backup uitilities for Windows like Cobian Backup, BackupMaker and AceBackup often works with full, incremental and differential backups, in- and excluding files and store the backup as a big compressed .ZIP archive. Which backup utility for Linux works on the same way like a general backup solution for Windows?
Last edited by DrM on Sat Apr 19, 2014 9:28 am, edited 1 time in total.

User avatar
eanfrid
Level 7
Level 7
Posts: 1859
Joined: Mon Apr 30, 2012 2:49 am
Location: FR

Re: quick and easy backup solution

Post by eanfrid » Sat Apr 19, 2014 9:20 am

LuckyBackup is based on rsync. rsync does not do that by itself because it aims to sync/mirror data, not to make archives.

Most powerful backup systems for Linux do not target single desktop computers and/or are command-line utilities (tar, dar, backupninja, backup-manager, duplicity...). Not so easy for whom is used to Windows desktop backup utilities which have to handle much less possible complexity and use cases.

Deja-dup and sbackup are closer to what you are looking for. Take a look to box-backup (server-client utility) too.
Main desktop: Debian GNU/Linux Jessie 64bit - MATE
(i5 2400@3.7GHz - 16GB DDR3 - HD6770 w/radeon driver - SSD+RAID1)
Safer than Dropbox

DrM
Level 2
Level 2
Posts: 87
Joined: Sun Feb 23, 2014 4:03 pm

Re: quick and easy backup solution

Post by DrM » Sat Apr 19, 2014 11:03 am

At https://launchpad.net/~sbackup-team/+archive/stable you can use the PPA of the latest version of SBackup. SBackup reminds me of a general backup util for Windows. More info about SBackup see https://launchpad.net/sbackup/. And does box-backup also have a GUI-frontend like SBackup?

User avatar
eanfrid
Level 7
Level 7
Posts: 1859
Joined: Mon Apr 30, 2012 2:49 am
Location: FR

Re: quick and easy backup solution

Post by eanfrid » Sat Apr 19, 2014 11:20 am

sbackup is in the Mint repos.

Remember to always use first software stored in repos before lurking around on the Internet. Only repos have stable, signed, tested and certified software for your distribution (PPAs are not part of the official repos). There may exist newer versions for whatever purpose elsewhere (including the dev website) but this is at your own risk: either a common mistake (bad habit taken from Windows) to jump on the brand new latest release or something you do when you are enough skilled and aware of the risks.
Main desktop: Debian GNU/Linux Jessie 64bit - MATE
(i5 2400@3.7GHz - 16GB DDR3 - HD6770 w/radeon driver - SSD+RAID1)
Safer than Dropbox

DrM
Level 2
Level 2
Posts: 87
Joined: Sun Feb 23, 2014 4:03 pm

Re: quick and easy backup solution

Post by DrM » Sat Apr 19, 2014 11:50 am

eanfrid wrote:sbackup is in the Mint repos.

Remember to always use first software stored in repos before lurking around on the Internet. Only repos have stable, signed, tested and certified software for your distribution (PPAs are not part of the official repos). There may exist newer versions for whatever purpose elsewhere (including the dev website) but this is at your own risk: either a common mistake (bad habit taken from Windows) to jump on the brand new latest release or something you do when you are enough skilled and aware of the risks.
I come from using Windows where I always made sure to use the latest versions of any programs and drivers. I always think that the latest version of any program/driver is the best, because bugs have been removed which would be present in older versions. So I am suprised that in any Linux distro there are always older version of programs than the latest versions from the dev websites. I always think that in these older versions of programs in Linux distros there are bugs which have been removed in the latest versions from the dev websites. Will using software from outside the official repos like PPA's from Launchpad and from the dev website introduce malware to my Linux Mint installation, or introduce other security and stability issues?

For example take a look at SBackup, the version of this program in the official repos of Ubuntu Saucy is 0.11.4 from 2011. While the latest version of this program is already 0.11.6 from 2013.

User avatar
eanfrid
Level 7
Level 7
Posts: 1859
Joined: Mon Apr 30, 2012 2:49 am
Location: FR

Re: quick and easy backup solution

Post by eanfrid » Sat Apr 19, 2014 12:03 pm

Will using software from outside the official repos like PPA's from Launchpad and from the dev website introduce malware to my Linux Mint installation, or introduce other security and stability issues?
Considering that Launchpad PPA's represent a lower risk regarding malware, yes. What is not in the repos is untested, potentially unstable/experimental or only partially functional, corrupted or incompatible with something else specific to your OS. If your repos contain thousands of packages, why do you think the distro packagers take the time to gather/make/test and maintain them (including then bug/security fixes) ? Even if there is no "0% risk".
Main desktop: Debian GNU/Linux Jessie 64bit - MATE
(i5 2400@3.7GHz - 16GB DDR3 - HD6770 w/radeon driver - SSD+RAID1)
Safer than Dropbox

DrM
Level 2
Level 2
Posts: 87
Joined: Sun Feb 23, 2014 4:03 pm

Software in many distros is often very outdated.

Post by DrM » Sat Apr 19, 2014 12:18 pm

Another example of an older version of a program in the Linux Mint 16 repos is Wine. At http://wiki.winehq.org/HowTo I read the following:
Before you install Wine, make sure that there is no previous Wine installation on your system, either from a package or from source. If you haven't yet installed Wine, you should be fine. See the Removing old Wine versions chapter in the User Guide for details. Many Linux distributions come with an included Wine package, but due to Wine's rapid development rate these are usually old and often broken versions. It is best to uninstall your distribution's included package versions and update to the latest Wine version available here.

Ready-made, updated binary packages for Wine can be found at the WineHQ downloads page. In addition, full source code is available for both the current Wine development tree and every Wine release here. For help with installing from a package or from source, please consult the Getting Wine chapter of the User guide.

Note to Debian/Ubuntu users: The packages included in the main distribution are currently very out of date. We're working on having the latest packages available officially from Debian/Ubuntu's servers, but until then we suggest you install the latest Wine by using our apt repository here. Debian Lenny/Squeeze/Sid users can install the latest Wine packages by using the repository here.

User avatar
eanfrid
Level 7
Level 7
Posts: 1859
Joined: Mon Apr 30, 2012 2:49 am
Location: FR

Re: quick and easy backup solution

Post by eanfrid » Sat Apr 19, 2014 12:29 pm

When I am on Debian, I use Debian software. When I am on Windows, I use Windows software (or I boot on a Linux live-media) :mrgreen: In my very own opinion, if you still want/have to use Windows software on a Linux distro, then you are indeed not ready to use a Linux distro.
Main desktop: Debian GNU/Linux Jessie 64bit - MATE
(i5 2400@3.7GHz - 16GB DDR3 - HD6770 w/radeon driver - SSD+RAID1)
Safer than Dropbox

DrM
Level 2
Level 2
Posts: 87
Joined: Sun Feb 23, 2014 4:03 pm

Re: quick and easy backup solution

Post by DrM » Sat Apr 19, 2014 12:58 pm

eanfrid wrote:When I am on Debian, I use Debian software. When I am on Windows, I use Windows software (or I boot on a Linux live-media) :mrgreen: In my very own opinion, if you still want/have to use Windows software on a Linux distro, then you are indeed not ready to use a Linux distro.
I mentioned Wine as an example of a program in the Linux Mint 16 repos which is older and buggier than the latest stable release of Wine from the dev website.

User avatar
eanfrid
Level 7
Level 7
Posts: 1859
Joined: Mon Apr 30, 2012 2:49 am
Location: FR

Re: quick and easy backup solution

Post by eanfrid » Sat Apr 19, 2014 1:59 pm

DrM wrote:I come from using Windows where I always made sure to use the latest versions of any programs and drivers. I always think that the latest version of any program/driver is the best, because bugs have been removed which would be present in older versions.
Unless your are an advanced/skilled Linux user or expert, this is just stupid regarding how a Linux distro (at least Debian-like) truly works. Linux is not Windows. At best you will get a very unstable system. As a rule-of-thumb you only need security/bug fixes processed, applied and packaged by the distro maintainers who put them in the official repos. Unless you really need any special feature only available today in a new version, wait for this new version to make its way into the official repos.

I will stop arguing here since it is not related to the thread.
Main desktop: Debian GNU/Linux Jessie 64bit - MATE
(i5 2400@3.7GHz - 16GB DDR3 - HD6770 w/radeon driver - SSD+RAID1)
Safer than Dropbox

User avatar
DrHu
Level 17
Level 17
Posts: 7537
Joined: Wed Jun 17, 2009 8:20 pm

Re: quick and easy backup solution

Post by DrHu » Sat Apr 19, 2014 3:57 pm

One other thing to consider with backups; if you use encrytion on your own data, you should also use encrytion on your backups or they will be viewable to others..

If not using encryption (protecting your own data), then no problem, everthing is viewable (visible)

Rsync is a standard and very good process to use (only copying changed data, after an initial backup..)

DrM
Level 2
Level 2
Posts: 87
Joined: Sun Feb 23, 2014 4:03 pm

Re: quick and easy backup solution

Post by DrM » Wed Apr 23, 2014 3:33 am

DrHu wrote:"Rsync is a standard and very good process to use (only copying changed data, after an initial backup..)"
But Rsync does not pack the files into one compressed archive file like SBackup does. A compressed archive file takes less disk space.

Post Reply

Return to “Newbie Questions”