Where my GB may have gone?

[FDF]

Hi,

I have a question on my disk
It is a 500GB disk with 3 partition.
A swap of 4GB
The root of 25 GB
/home for the rest.

my question is about the root partition.
There is "only" Linux Mint LMDE 64 + Cinnamon + some basic soft (libreoffice, banshee…) Most, the automatically installed one + few games.
I had a warning during the install of the pack 4, "disx almost full…" I had to empty /var/cache/apt/archive by using

Code: Select all

sudo apt-get clean

It save the install but surprized me. The computer is new (October 2011) so the 25GB shouldn't be so full.

When I run "disk usage analyzer" I can see the size of each folder. A quick calculation shows a total size (apart of /home) of about 9 to 10 GB. so I should have about 15 GB free
While Gparted tells me: /dev/sd2 ext4 Mount point / Size 25.76 GIB Used 19.17 GiB Unused 6.58GiB
or with df:

Code: Select all

Filesystem                                              Size  Used Avail Use% Mounted on
rootfs                                                   26G   20G  5.3G  79% /
udev                                                    1.9G     0  1.9G   0% /dev
/dev/disk/by-uuid/8c1c36c0-2499-4153-8be6-4825a5f47f96   26G   20G  5.3G  79% /
tmpfs                                                   397M  828K  396M   1% /var/run
tmpfs                                                   5.0M     0  5.0M   0% /var/run/lock
tmpfs                                                   794M   91M  703M  12% /tmp
tmpfs                                                   794M  956K  793M   1% /var/run/shm
/dev/sda3                                               434G  323G   90G  79% /home


Here start the interesting question. Why sda2 appears as /dev/disk/by-uuid/8c1c36c0-2499-4153-8be6-4825a5f47f96 and not as /dev/sda2 ?
So i tried as below to see the difference:

Code: Select all

FDF@desktop:~$ df -h /
Filesystem                                              Size  Used Avail Use% Mounted on
/dev/disk/by-uuid/8c1c36c0-2499-4153-8be6-4825a5f47f96   26G   20G  5.3G  79% /
FDF@desktop:~$ df -h /dev/sda2
Filesystem      Size  Used Avail Use% Mounted on
udev            1.9G     0  1.9G   0% /dev


I don't understand the reason of the difference. Especially when gparted see sda2 and uuid/8c1c36c0-2499-4153-8be6-4825a5f47f96 as one. (see the picture below)


Do you have an idea of what can be the problem? What can use this space without it been seen during the disk space analysis?

Thanks for your help

[lmarmisa]

Interesting problem. Could you post the results of these commands?

Code: Select all

sudo parted -l
cat /etc/fstab
mount
ls -l /dev/disk/by-uuid/8c1c36c0-2499-4153-8be6-4825a5f47f96
sudo blkid


Best regards,

Luis

[FDF]

Thanks for your help.
Here are the answers, one by one with the same order.

Code: Select all

FDF@desktop:~$ sudo parted -l
[sudo] password for FDF:
Model: ATA WDC WD5000AAKX-0 (scsi)
Disk /dev/sda: 500GB
Sector size (logical/physical): 512B/512B
Partition Table: msdos

Number  Start   End     Size    Type     File system     Flags
 1      1049kB  6243MB  6242MB  primary  linux-swap(v1)
 2      6243MB  33.9GB  27.7GB  primary  ext4
 3      33.9GB  500GB   466GB   primary  ext4

Code: Select all

FDF@desktop:~$ cat /etc/fstab
# /etc/fstab: static file system information.
#
# <file system> <mount point>   <type>  <options>       <dump>  <pass>
proc   /proc   proc   defaults   0   0
# /dev/sda1
UUID=999fdca8-ebbd-48b6-be43-1027e47150c6   swap   swap   sw   0   0
# /dev/sda2
UUID=8c1c36c0-2499-4153-8be6-4825a5f47f96   /   ext4   rw,errors=remount-ro   0   1
# /dev/sda3
UUID=9319a031-1f50-45e9-aada-18e13afcea78   /home   ext4   rw,errors=remount-ro   0   0


Code: Select all

FDF@desktop:~$ mount
udev on /dev type devtmpfs (rw,relatime,size=1990532k,nr_inodes=497633,mode=755)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
/dev/disk/by-uuid/8c1c36c0-2499-4153-8be6-4825a5f47f96 on / type ext4 (rw,relatime,errors=remount-ro,user_xattr,barrier=1,data=ordered)
tmpfs on /var/run type tmpfs (rw,nosuid,noexec,relatime,size=406116k,mode=755)
tmpfs on /var/run/lock type tmpfs (rw,nosuid,nodev,noexec,relatime,size=5120k)
tmpfs on /tmp type tmpfs (rw,nosuid,nodev,relatime,size=812232k)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /var/run/shm type tmpfs (rw,nosuid,nodev,relatime,size=812232k)
/dev/sda3 on /home type ext4 (rw,relatime,errors=remount-ro,user_xattr,barrier=1,data=ordered)
fusectl on /sys/fs/fuse/connections type fusectl (rw,relatime)
binfmt_misc on /proc/sys/fs/binfmt_misc type binfmt_misc (rw,nosuid,nodev,noexec,relatime)
cgroup on /dev/cgroup/cpu type cgroup (rw,relatime,cpu,release_agent=/usr/local/sbin/cgroup_clean)
gvfs-fuse-daemon on /home/FDF/.gvfs type fuse.gvfs-fuse-daemon (rw,nosuid,nodev,relatime,user_id=1001,group_id=1001)
XXX@192.168.000.000:/home/XXX/musique on /home/FDF/Musique type fuse.sshfs (rw,nosuid,nodev,relatime,user_id=1001,group_id=1001,max_read=65536)
YYY@192.168.000.000:/home/YYY/www on /home/FDF/www type fuse.sshfs (rw,nosuid,nodev,relatime,user_id=1001,group_id=1001,max_read=65536)


Code: Select all

FDF@desktop:~$ ls -l /dev/disk/by-uuid/8c1c36c0-2499-4153-8be6-4825a5f47f96
lrwxrwxrwx 1 root root 10 Apr  9 18:07 /dev/disk/by-uuid/8c1c36c0-2499-4153-8be6-4825a5f47f96 -> ../../sda2


Code: Select all

FDF@desktop:~$ sudo blkid
/dev/sda1: UUID="999fdca8-ebbd-48b6-be43-1027e47150c6" TYPE="swap"
/dev/sda2: UUID="8c1c36c0-2499-4153-8be6-4825a5f47f96" TYPE="ext4"
/dev/sda3: UUID="9319a031-1f50-45e9-aada-18e13afcea78" TYPE="ext4"

Quite long…

[lmarmisa]

The device /dev/sda2 is not shown on some outputs. The system is showing instead the symbolic link /dev/disk/by-uuid/8c1c36c0-2499-4153-8be6-4825a5f47f96 created with its uuid. The command df seems confused using /dev/sda2 too.

Could you post the outputs of these commands?

Code: Select all

sudo fdisk -l
ls -l /dev/sda2


This procedure will run a repair command on the root partition after the reboot.

Code: Select all

sudo touch /forcefsck


Then reboot the system.

[AlbertP]

As LMDE is a kind of rolling release, you'll keep getting more and more packages including old versions in the APT cache if you update everything. If there are many packages installed you'll have to run apt clean at times to avoid this kind of disk space usage.

[FDF]

Thanks Lmarmisa.

Here are the commands and there results.

Code: Select all

FDF@desktop:~$ sudo fdisk -l
[sudo] password for FDF:

Disk /dev/sda: 500.1 GB, 500107862016 bytes
255 heads, 63 sectors/track, 60801 cylinders, total 976773168 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x00042b63

   Device Boot      Start         End      Blocks   Id  System
/dev/sda1            2048    12193334     6095643+  83  Linux
/dev/sda2        12193335    66209791    27008228+  83  Linux
/dev/sda3        66209792   976773119   455281664   83  Linux



FDF@desktop:~$ ls -l /dev/sda2
brw-rw---T 1 root disk 8, 2 Apr  9 18:07 /dev/sda2


I well apply, reboot and keep you posted.

Ok reboot with the check of sda2 is done
but not much change…

Code: Select all

FDF@desktop:~$ df -h
Filesystem                                              Size  Used Avail Use% Mounted on
rootfs                                                   26G   20G  5.3G  79% /
udev                                                    1.9G     0  1.9G   0% /dev
/dev/disk/by-uuid/8c1c36c0-2499-4153-8be6-4825a5f47f96   26G   20G  5.3G  79% /
tmpfs                                                   397M  800K  396M   1% /var/run
tmpfs                                                   5.0M     0  5.0M   0% /var/run/lock
tmpfs                                                   794M   16K  794M   1% /tmp
tmpfs                                                   794M   88K  794M   1% /var/run/shm
/dev/sda3                                               434G  323G   90G  79% /home
XXX@192.168.000.000:/home/XXX/musique               276G  235G   27G  90% /home/FDF/Musique
YYY@192.168.000.000:/home/YYY/www               276G  235G   27G  90% /home/FDF/www

To check a little deeper, are the following space usage likely?
/usr 7GB
/opt 685MB
/var 430MB
/lib 365MB

other below 50MB but /home 231GB

[lmarmisa]

Not sure if this will help you but the sticky bit of the partition /dev/sda2 is on (uppercase T on the file system permissions). This is a bit strange.

http://en.wikipedia.org/wiki/Sticky_bit

Code: Select all

FDF@desktop:~$ ls -l /dev/sda2
brw-rw---T 1 root disk 8, 2 Apr  9 18:07 /dev/sda2


Try these commands and reboot:

Code: Select all

sudo chmod -t /dev/sda2
ls -l /dev/sda2


[FDF]

As per the link you gave me:

If the sticky-bit is set on a file or directory without the execution bit set for the others category (non-user-owner and non-group-owner), it is indicated with a capital T:

That means the execution bit is not set on the root. Which seems strange.

have you check on your own computer if it is normal? or a problem/strangness on my side?

I will try the change and update the post…

OK, I have tried and here are the results.
after the change the sticky-bit is deleted, but after reboot, it re-appears as T…

[FDF]

Hello,

I still seek my missing GBs has anybody an idea? Following the great insite from Lmarisa?

Thanks and regards

[lmarmisa]

Hello,

I still seek my missing GBs has anybody an idea? Following the great insite from Lmarisa?

Thanks and regards

Hi again, FDF,

IMHO no GBs are missing.

I believe that a minor problem exists about the device /dev/sda2. Due to this problem, some commands can not show properly the device /dev/sda2 and they show instead the UUID link to that device. Additionally the command df -h /dev/sda2 is even more confused with /dev/sda2 and it shows the information associated to the device manager udev. So, that output belongs to the udev manager controller device, not to /dev/sda2.

Code: Select all

FDF@desktop:~$ df -h /dev/sda2
Filesystem      Size  Used Avail Use% Mounted on
udev            1.9G     0  1.9G   0% /dev


http://en.wikipedia.org/wiki/Udev

I was trying to look for clues about the poblem of /dev/sda2 but I am not able to give you a solution in order to fix it. Anyway, I consider that this is a minor problem.

Best regards,

Luis

[FDF]

Hi,

So you think the available space is still actually available, but seen as used, or the amount given by the "disk space analyser" is wrong? is it possible the root (without home) is about 20gb on a quite new install of Mint LMDE 64? or is it too much? Thanks for your insight anyway.

Have a good week.

[lmarmisa]

Hi,

So you think the available space is still actually available, but seen as used, or the amount given by the "disk space analyser" is wrong? is it possible the root (without home) is about 20gb on a quite new install of Mint LMDE 64? or is it too much? Thanks for your insight anyway.

Have a good week.

According to the previous commands, the root partition has approximately 20 GB used and 5GB of free space.

Type this command in order to see how the space is used:

Code: Select all

luis@mint12luisvb ~ $ sudo du -h --max-depth=1 / 2>/dev/null
0   /sys
3.1G   /usr
273M   /lib
56K   /tmp
275M   /opt
1.1G   /media
16K   /lost+found
49M   /boot
4.0K   /dev
4.0K   /selinux
8.2M   /bin
1.4M   /run
565M   /var
4.0K   /srv
8.3M   /sbin
232K   /root
35M   /etc
176M   /home
4.0K   /mnt
0   /proc
5.5G   /
luis@mint12luisvb ~ $



[Oscar799]

Moved here by moderator

[FDF]

here is the result:

Code: Select all

FDF@desktop:~$ sudo du -h --max-depth=1 / 2>/dev/null
[sudo] password for FDF:
8,6M   /bin
654M   /opt
6,6G   /usr
4,0K   /lib64
11G   /var
11M   /sbin
4,0K   /selinux
8,0K   /menus
29M   /etc
4,0K   /srv
4,0K   /mnt
16K   /lost+found
5,2M   /lib32
4,0K   /.pulse
0   /sys
0   /dev
8,0K   /debian
349M   /lib
12K   /tmp
47M   /boot
53M   /root
2,4M   /media
0   /proc
321G   /home
339G   /
FDF@desktop:~$


So, almost all in /var (the 6.6 of /usr seems quite normal)

So, I have investigated /var/, and actually /var/lib which is the heavy one. I got the culprit. BOINC it is the BOINC which is using this space… That seems much more normal now…

Thanks. I will not go further, but if someone has an idea to correct the mixed up between UUID/ and sda2/

[AlbertP]

That message about udev and /dev is probably a bug in the df command. I also get that message - on my desktop sda2 is an extended partition holding the swap. udev or /dev is not related to any partition on the disk on Linux (/dev is a filesystem exposed by the Linux kernel for the management of hardware/devices and it's not saved on any harddisk or partition). Please use sudo fdisk -l instead.

[psql]

I had the same problem after I did the update to (201204), I had a 500Gb HD, and I use only 74GB. But, Disk user analyzer show/home is using 100%. Strange no? I got messages that the HD crash was imminent.

So, I got a new hard disk with 2T, and I reinstall mint debian to be safe.
Now again Disk user analyzer tells me /home is 96% full! I give the home directory 1.7Tb! How can It be? I spend time and money thinking the 500Gb hard disk was defect.
Something is terribly wong with Disk user analyzer or something else...

Anybody had any idea of what is going on?

[AlbertP]

Could you please compare the values of the disk usage analyzer with System Monitor's values? You'll find it on the filesystem tab there.