Slow read/write speeds hard drives

Quick to answer questions about finding your way around Linux Mint as a new user.
Forum rules
There are no such things as "stupid" questions. However if you think your question is a bit stupid, then this is the right place for you to post it. Stick to easy to-the-point questions that you feel people can answer fast. For long and complicated questions use the other forums in the support section.
Before you post read how to get help. Topics in this forum are automatically closed 6 months after creation.
Locked
Russuk

Slow read/write speeds hard drives

Post by Russuk »

So I am having an issue on 2 hard drives.

When downloading and transferring files when its downloading and allocating data read/wright my transfer rate is like 50KiB/s at most it will goto 200KiB/s
for drive sdb1 and sdb2

Yet when I download to my main drive that Mint 19 is on I get the full 300 to 500 MiB/s or more.

I did read up on https://stackoverflow.com/questions/305 ... r-than-8gb And I think this is some what related issue I have as I currently have 32GB Ram installed on my system
If you use a 32 bit kernel with more than 2G of RAM, you are running in a sub-optimal configuration where significant tradeoffs must be made. This is because in these configurations, the kernel can no longer map all of physical memory at once.

As the amount of physical memory increases beyond this point, the tradeoffs become worse and worse, because the struct page array that is used to manage all physical memory must be kept mapped at all times, and that array grows with physical memory.

The physical memory that isn't directly mapped by the kernel is called "highmem", and by default the writeback code treats highmem as undirtyable. This is what results in your zero values for the dirty thresholds.

You can change this by setting /proc/sys/vm/highmem_is_dirtyable to 1, but with that much memory you will be far better off if you install a 64-bit kernel instead.

nr_dirty 333
nr_writeback 0
nr_writeback_temp 0
nr_dirty_threshold 3840
nr_dirty_background_threshold 1920



How does one fix and resolve this issue on Linux Mint 19.1 Tessa. Thanks
Last edited by LockBot on Wed Dec 28, 2022 7:16 am, edited 1 time in total.
Reason: Topic automatically closed 6 months after creation. New replies are no longer allowed.
WharfRat

Re: Slow read/wight speeds hard drives

Post by WharfRat »

Can we see the results of inxi -v6
Russuk

Re: Slow read/wight speeds hard drives

Post by Russuk »

WharfRat wrote: Thu Feb 21, 2019 1:11 am Can we see the results of inxi -v6
Sure

Code: Select all

System:
  Host: pc Kernel: 4.15.0-45-generic x86_64 bits: 64 compiler: gcc 
  v: 7.3.0 Desktop: Cinnamon 4.0.9 wm: muffin dm: LightDM 
  Distro: Linux Mint 19.1 Tessa base: Ubuntu 18.04 bionic 
Machine:
  Type: Desktop System: Gigabyte product: N/A v: N/A serial: <root required> 
  Chassis: type: 3 serial: <root required> 
  Mobo: Gigabyte model: 990FXA-UD5 serial: <root required> 
  UEFI: American Megatrends v: FCh date: 11/06/2014 
Memory:
  RAM: total: 31.28 GiB used: 4.72 GiB (15.1%) 
  RAM Report: permissions: Unable to run dmidecode. Are you root? 
CPU:
  Topology: 8-Core model: AMD FX-8350 bits: 64 type: MCP arch: Bulldozer 
  L2 cache: 2048 KiB 
  flags: lm nx pae sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3 svm 
  bogomips: 64286 
  Speed: 1400 MHz min/max: 1400/4000 MHz Core speeds (MHz): 1: 1395 2: 1405 
  3: 1635 4: 1990 5: 1393 6: 1396 7: 1464 8: 1701 
Graphics:
  Device-1: AMD Tahiti XT [Radeon HD 7970/8970 OEM / R9 280X] 
  vendor: Micro-Star MSI driver: radeon v: kernel bus ID: 01:00.0 
  chip ID: 1002:6798 
  Display: x11 server: X.Org 1.19.6 driver: ati,radeon 
  unloaded: fbdev,modesetting,vesa resolution: 1920x1080~60Hz 
  OpenGL: renderer: AMD TAHITI (DRM 2.50.0 4.15.0-45-generic LLVM 7.0.0) 
  v: 4.5 Mesa 18.2.2 compat-v: 4.4 direct render: Yes 
Audio:
  Device-1: AMD SBx00 Azalia vendor: Gigabyte driver: snd_hda_intel 
  v: kernel bus ID: 00:14.2 chip ID: 1002:4383 
  Device-2: AMD Tahiti HDMI Audio [Radeon HD 7870 XT / 7950/7970] 
  vendor: Micro-Star MSI driver: snd_hda_intel v: kernel bus ID: 01:00.1 
  chip ID: 1002:aaa0 
  Sound Server: ALSA v: k4.15.0-45-generic 
Network:
  Device-1: Realtek RTL8111/8168/8411 PCI Express Gigabit Ethernet 
  vendor: Gigabyte driver: r8169 v: 2.3LK-NAPI port: b000 bus ID: 05:00.0 
  chip ID: 10ec:8168 
  IF: enp5s0 state: up speed: 1000 Mbps duplex: full mac: 94:de:80:6e:a4:36 
Drives:
  Local Storage: total: 4.21 TiB used: 1.21 TiB (28.7%) 
  ID-1: /dev/sda vendor: Western Digital model: WD5000AZLX-00K4KA0 
  size: 465.76 GiB speed: 6.0 Gb/s serial: WD-WMC1S6304447 
  ID-2: /dev/sdb vendor: Western Digital model: WD30EZRX-00D8PB0 
  size: 2.73 TiB speed: 6.0 Gb/s serial: WD-WMC4N2529839 
  ID-3: /dev/sdc vendor: Samsung model: HD103SJ size: 931.51 GiB 
  speed: 3.0 Gb/s serial: S246J9AZ901210 
  ID-4: /dev/sdd vendor: OCZ model: VERTEX4 size: 119.24 GiB speed: 6.0 Gb/s 
  serial: OCZ-79P6A2C12981108S 
  Message: No Optical or Floppy data was found. 
Partition:
  ID-1: / size: 116.38 GiB used: 43.22 GiB (37.1%) fs: ext4 dev: /dev/sdd2 
  label: N/A uuid: 21950364-0563-44dd-9007-204ad1422057 
  ID-2: /boot/efi size: 511.0 MiB used: 33.5 MiB (6.6%) fs: vfat 
  dev: /dev/sdd1 label: N/A uuid: 4927-03C8 
  ID-3: /home/cryptogen size: 116.38 GiB used: 43.22 GiB (37.1%) 
  fs: ecryptfs source: ERR-102 label: N/A uuid: N/A 
  ID-4: /media/cryptogen/08750BC808750BC8 size: 2.00 TiB 
  used: 21.66 GiB (1.1%) fs: ntfs dev: /dev/sdb1 label: N/A 
  uuid: 08750BC808750BC8 
  ID-5: /media/cryptogen/Main Storage size: 931.51 GiB 
  used: 868.86 GiB (93.3%) fs: ntfs dev: /dev/sdc1 label: Main Storage 
  uuid: C0906D77906D74B6 
  ID-6: /media/cryptogen/Music size: 465.42 GiB used: 260.89 GiB (56.1%) 
  fs: ntfs dev: /dev/sda1 label: Music uuid: EE863C0A863BD1B7 
  ID-7: swap-1 size: 2.00 GiB used: 0 KiB (0.0%) fs: swap dev: /dev/dm-0 
  label: N/A uuid: 3160745a-214c-4ce8-8958-68fbb9af9e9c 
Unmounted:
  Message: No unmounted partitions found. 
USB:
  Hub: 1-0:1 info: Full speed (or root) Hub ports: 5 rev: 2.0 
  chip ID: 1d6b:0002 
  Hub: 2-0:1 info: Full speed (or root) Hub ports: 5 rev: 2.0 
  chip ID: 1d6b:0002 
  Hub: 3-0:1 info: Full speed (or root) Hub ports: 4 rev: 2.0 
  chip ID: 1d6b:0002 
  Hub: 4-0:1 info: Full speed (or root) Hub ports: 5 rev: 1.1 
  chip ID: 1d6b:0001 
  Hub: 5-0:1 info: Full speed (or root) Hub ports: 5 rev: 1.1 
  chip ID: 1d6b:0001 
  Hub: 6-0:1 info: Full speed (or root) Hub ports: 2 rev: 1.1 
  chip ID: 1d6b:0001 
  Hub: 7-0:1 info: Full speed (or root) Hub ports: 4 rev: 1.1 
  chip ID: 1d6b:0001 
  Hub: 8-0:1 info: Full speed (or root) Hub ports: 2 rev: 2.0 
  chip ID: 1d6b:0002 
  Device-1: 8-1:2 info: Microsoft type: Keyboard,Mouse,HID 
  driver: hid-generic,usbhid rev: 2.0 chip ID: 045e:0748 
  Device-2: 8-2:3 info: Logitech Compact Keyboard K300 type: Keyboard,HID 
  driver: hid-generic,usbhid rev: 2.0 chip ID: 046d:c31b 
  Hub: 9-0:1 info: Full speed (or root) Hub ports: 2 rev: 3.0 
  chip ID: 1d6b:0003 
  Hub: 10-0:1 info: Full speed (or root) Hub ports: 2 rev: 2.0 
  chip ID: 1d6b:0002 
  Hub: 11-0:1 info: Full speed (or root) Hub ports: 2 rev: 3.0 
  chip ID: 1d6b:0003 
Sensors:
  System Temperatures: cpu: 14.8 C mobo: N/A gpu: radeon temp: 37 C 
  Fan Speeds (RPM): N/A 
Info:
  Processes: 274 Uptime: 22h 03m Init: systemd v: 237 runlevel: 5 Compilers: 
  gcc: 7.3.0 alt: 7 Shell: bash v: 4.4.19 running in: gnome-terminal 
  inxi: 3.0.27
Last edited by Russuk on Thu Feb 21, 2019 7:35 pm, edited 1 time in total.
Reason: Added code tag
WharfRat

Re: Slow read/wight speeds hard drives

Post by WharfRat »

How about sudo sysctl -a | grep dirty
Russuk

Re: Slow read/wight speeds hard drives

Post by Russuk »

WharfRat wrote: Thu Feb 21, 2019 7:51 pm How about sudo sysctl -a | grep dirty

Code: Select all

sysctl: reading key "net.ipv6.conf.all.stable_secret"
sysctl: reading key "net.ipv6.conf.default.stable_secret"
sysctl: reading key "net.ipv6.conf.enp5s0.stable_secret"
sysctl: reading key "net.ipv6.conf.lo.stable_secret"
vm.dirty_background_bytes = 0
vm.dirty_background_ratio = 10
vm.dirty_bytes = 0
vm.dirty_expire_centisecs = 3000
vm.dirty_ratio = 20
vm.dirty_writeback_centisecs = 500
vm.dirtytime_expire_seconds = 43200

WharfRat

Re: Slow read/wight speeds hard drives

Post by WharfRat »

That's exactly my results so I see you haven't changed any of those settings.

Are you setting any kernel boot parameters cat /proc/cmdline

Did you try the mem=8G boot option as described at the site you linked to :?:

Are there any BIOS memory settings that might cause this.

I read some time back about certain motherboard settings that could limit kernel memory allocation.
Russuk

Re: Slow read/wight speeds hard drives

Post by Russuk »

WharfRat wrote: Thu Feb 21, 2019 10:22 pm That's exactly my results so I see you haven't changed any of those settings.

Are you setting any kernel boot parameters cat /proc/cmdline

Did you try the mem=8G boot option as described at the site you linked to :?:

Are there any BIOS memory settings that might cause this.

I read some time back about certain motherboard settings that could limit kernel memory allocation.
No I have not and would not know where to start on this or what files to edit. I did check to see if files are their but they are not. and their is nothing special in boot parameters as its from fresh install. So everything is default. Bios I have everything set to work with Linux and disabled fast boot options too made no difference.
WharfRat

Re: Slow read/wight speeds hard drives

Post by WharfRat »

Run hdparm -tT on your drives as shown below with my results:

Code: Select all

[bill@XPS] ~ $ sudo hdparm -tT /dev/sda

/dev/sda:
 Timing cached reads:   34532 MB in  1.99 seconds = 17340.00 MB/sec
 Timing buffered disk reads: 658 MB in  3.00 seconds = 219.13 MB/sec
[bill@XPS] ~ $ sudo hdparm -tT /dev/sdb

/dev/sdb:
 Timing cached reads:   33338 MB in  1.99 seconds = 16740.22 MB/sec
 Timing buffered disk reads: 534 MB in  3.01 seconds = 177.37 MB/sec
[bill@XPS] ~ $ sudo hdparm -tT /dev/sdc

/dev/sdc:
 Timing cached reads:   34238 MB in  1.99 seconds = 17192.69 MB/sec
 Timing buffered disk reads: 674 MB in  3.01 seconds = 224.21 MB/sec
[bill@XPS] ~ $ 
Russuk

Re: Slow read/wight speeds hard drives

Post by Russuk »

WharfRat wrote: Fri Feb 22, 2019 9:43 am Run hdparm -tT on your drives as shown below with my results:

Code: Select all

[bill@XPS] ~ $ sudo hdparm -tT /dev/sda

/dev/sda:
 Timing cached reads:   34532 MB in  1.99 seconds = 17340.00 MB/sec
 Timing buffered disk reads: 658 MB in  3.00 seconds = 219.13 MB/sec
[bill@XPS] ~ $ sudo hdparm -tT /dev/sdb

/dev/sdb:
 Timing cached reads:   33338 MB in  1.99 seconds = 16740.22 MB/sec
 Timing buffered disk reads: 534 MB in  3.01 seconds = 177.37 MB/sec
[bill@XPS] ~ $ sudo hdparm -tT /dev/sdc

/dev/sdc:
 Timing cached reads:   34238 MB in  1.99 seconds = 17192.69 MB/sec
 Timing buffered disk reads: 674 MB in  3.01 seconds = 224.21 MB/sec
[bill@XPS] ~ $ 
My Results

Code: Select all


/dev/sdc1:
 Timing cached reads:   8812 MB in  2.00 seconds = 4410.19 MB/sec
 Timing buffered disk reads: 374 MB in  3.01 seconds = 124.29 MB/sec


/dev/sdb1:
 Timing cached reads:   8414 MB in  2.00 seconds = 4210.51 MB/sec
 Timing buffered disk reads: 444 MB in  3.01 seconds = 147.64 MB/sec


/dev/sda1:
 Timing cached reads:   8870 MB in  2.00 seconds = 4439.26 MB/sec
 Timing buffered disk reads: 532 MB in  3.00 seconds = 177.23 MB/sec
WharfRat

Re: Slow read/write speeds hard drives

Post by WharfRat »

I'm as perplexed as you are with this.

I was surprised to see the speed of sdc as it should have been a lot faster than the other two drives.

I'm at a complete loss with this :?
Russuk

Re: Slow read/write speeds hard drives

Post by Russuk »

WharfRat wrote: Sat Feb 23, 2019 12:35 am I'm as perplexed as you are with this.

I was surprised to see the speed of sdc as it should have been a lot faster than the other two drives.

I'm at a complete loss with this :?
I have no idea myself as to why speeds are slow when read/wright when actual doing transfers its weird
Locked

Return to “Beginner Questions”