[Solved] What's the best way to copy a large amount of data?

All Gurus once were Newbies
Forum rules
There are no such things as "stupid" questions. However if you think your question is a bit stupid, then this is the right place for you to post it. Please stick to easy to-the-point questions that you feel people can answer fast. For long and complicated questions prefer the other forums within the support section.
Before you post please read how to get help
Post Reply
fs0ciety
Level 1
Level 1
Posts: 15
Joined: Tue Mar 26, 2019 1:46 am

[Solved] What's the best way to copy a large amount of data?

Post by fs0ciety » Fri Mar 29, 2019 4:35 pm

I've got a little over 1 TB of data I need to copy from an external hard disk to an internal hard disk. I tried just dragging and dropping, but it's been at 12% for a while now and I feel like it's stuck.
Last edited by fs0ciety on Sat Mar 30, 2019 6:41 pm, edited 1 time in total.

fstjohn
Level 3
Level 3
Posts: 128
Joined: Fri Jan 02, 2015 3:21 pm
Location: Georgia

Re: What's the best way to copy a large amount of data?

Post by fstjohn » Fri Mar 29, 2019 5:02 pm

fs0ciety wrote:
Fri Mar 29, 2019 4:35 pm
I've got a little over 1 TB of data I need to copy from an external hard disk to an internal hard disk. I tried just dragging and dropping, but it's been at 12% for a while now and I feel like it's stuck.
Be patient. It may not be stuck but just transferring a full buffer. That's a lot of data, so it may take a while. Go have a beer or two and come back.

User avatar
Larry78723
Level 7
Level 7
Posts: 1545
Joined: Wed Jan 09, 2019 7:01 pm
Location: Jasper County, SC, USA

Re: What's the best way to copy a large amount of data?

Post by Larry78723 » Fri Mar 29, 2019 5:28 pm

A 1TB drive can take 3 hours to copy, sometimes more depending on the method used. Be patient.
Image

User avatar
bob466
Level 5
Level 5
Posts: 694
Joined: Mon May 15, 2017 5:23 am
Location: Australia

Re: What's the best way to copy a large amount of data?

Post by bob466 » Fri Mar 29, 2019 6:32 pm

You can always copy and paste in smaller increments but what ever you do it takes time...Mint will tell you when it's done. Image
Linux For Ever...Windoze Never Image

User avatar
Flemur
Level 17
Level 17
Posts: 7320
Joined: Mon Aug 20, 2012 9:41 pm
Location: Potemkin Village

Re: What's the best way to copy a large amount of data?

Post by Flemur » Fri Mar 29, 2019 6:42 pm

I would definitely use "cp" or "rsync" in a terminal to copy that much data. There are issues - as in this forum** - with at least some file-browsers and copying large amounts of data especially to/from USB drives.

** Edit: internet search this -

Code: Select all

site:forums.linuxmint.com "copy" "large"
Please edit your original post title to include [SOLVED] if/when it is solved!
Your data and OS are backed up....right?

fs0ciety
Level 1
Level 1
Posts: 15
Joined: Tue Mar 26, 2019 1:46 am

Re: What's the best way to copy a large amount of data?

Post by fs0ciety » Fri Mar 29, 2019 6:50 pm

You guys were right, I was a bit too impatient haha. I first tried to copy everything from the terminal by doing cp -r * /targetdirectory/, because I'm trying to learn terminal stuff. But my issue with that was that I couldn't see the progress. So then I did it the old fashioned way instead.

User avatar
Pjotr
Level 21
Level 21
Posts: 13734
Joined: Mon Mar 07, 2011 10:18 am
Location: The Netherlands (Holland)
Contact:

Re: What's the best way to copy a large amount of data?

Post by Pjotr » Fri Mar 29, 2019 7:35 pm

Double Commander is a fine stand-alone file manager that has never bogged down on me. You might give it a try.
Tip: 10 things to do after installing Linux Mint 19.2 Tina
Keep your Linux Mint healthy: Avoid these 10 fatal mistakes
Twitter: twitter.com/easylinuxtips
All in all, horse sense simply makes sense.

User avatar
pbear
Level 8
Level 8
Posts: 2424
Joined: Wed Jun 21, 2017 12:25 pm
Location: San Francisco

Re: What's the best way to copy a large amount of data?

Post by pbear » Sat Mar 30, 2019 12:18 pm

fs0ciety wrote:
Fri Mar 29, 2019 6:50 pm
I first tried to copy everything from the terminal by doing cp -r * /targetdirectory/, because I'm trying to learn terminal stuff. But my issue with that was that I couldn't see the progress.
For future reference, one way you can do that is to add the "v" tag (verbose), so cp -rv /source/ /target/, which will scroll the file names as copied. For more info on cp or any terminal command, look at the man page (short for manual), e.g., man cp.
Time flies like an arrow. Fruit flies like a banana.
If your problem has been solved, please edit the thread title.

User avatar
Lord Boltar
Level 5
Level 5
Posts: 688
Joined: Mon Jan 09, 2017 7:24 pm
Location: Sunny Florida

Re: What's the best way to copy a large amount of data?

Post by Lord Boltar » Sat Mar 30, 2019 3:46 pm

You can also use Krusader
IF your problem has been solved, please edit your original post and add [SOLVED] to the beginning of the Subject Line. It helps other members

The only way for evil to prosper is for good men to do nothing

deepakdeshp
Level 16
Level 16
Posts: 6070
Joined: Sun Aug 09, 2015 10:00 am

Re: What's the best way to copy a large amount of data?

Post by deepakdeshp » Sat Mar 30, 2019 3:58 pm

dd command with bs=102400000 will copy 100 mb in one read operation.
If I have helped you solve a problem, please add [SOLVED] to your first post title, it helps other users looking for help, and keeps the forum clean.
Regards,
Deepak

I am using Mint 19.2 Cinnamon 64 bit with AMD A8/7410 processor . Memory 8GB

fs0ciety
Level 1
Level 1
Posts: 15
Joined: Tue Mar 26, 2019 1:46 am

Re: What's the best way to copy a large amount of data?

Post by fs0ciety » Sat Mar 30, 2019 6:41 pm

pbear wrote:
Sat Mar 30, 2019 12:18 pm
fs0ciety wrote:
Fri Mar 29, 2019 6:50 pm
I first tried to copy everything from the terminal by doing cp -r * /targetdirectory/, because I'm trying to learn terminal stuff. But my issue with that was that I couldn't see the progress.
For future reference, one way you can do that is to add the "v" tag (verbose), so cp -rv /source/ /target/, which will scroll the file names as copied. For more info on cp or any terminal command, look at the man page (short for manual), e.g., man cp.
Thanks, I'll try that out next time

User avatar
jimallyn
Level 18
Level 18
Posts: 8945
Joined: Thu Jun 05, 2014 7:34 pm
Location: Wenatchee, WA USA

Re: What's the best way to copy a large amount of data?

Post by jimallyn » Sun Mar 31, 2019 1:44 am

Pjotr wrote:
Fri Mar 29, 2019 7:35 pm
Double Commander is a fine stand-alone file manager that has never bogged down on me.
Just used Double Commander the other day to copy from an old install to a USB drive. It may not be pretty, but it sure works good!
Image

“If the government were coming for your TVs and cars, then you'd be upset. But, as it is, they're only coming for your sons.” - Daniel Berrigan

User avatar
Pierre
Level 19
Level 19
Posts: 9163
Joined: Fri Sep 05, 2008 5:33 am
Location: Perth, AU.

Re: What's the best way to copy a large amount of data?

Post by Pierre » Sun Mar 31, 2019 1:50 am

jimallyn wrote:
Sun Mar 31, 2019 1:44 am
Pjotr wrote:
Fri Mar 29, 2019 7:35 pm
Double Commander is a fine stand-alone file manager that has never bogged down on me.
Just used Double Commander the other day to copy from an old install to a USB drive. It may not be pretty, but it sure works good!
my favourite is the Gnome Commander & which is also in the repositories.
- - they all have their own quirks, and some work better than others do.
when copying a lots of files, I'll generally do that directory by directory,
& in case of any file failure - - I've had a few, when doing bulk file transferring .. .. ..
Image
Please edit your original post title to include [SOLVED] - when your problem is solved!
and DO LOOK at those Unanswered Topics - - you may be able to answer some!.

Post Reply

Return to “Newbie Questions”