Near 100% disk usage, df and du show very different results, lsof not the answerdu vs. df differencedisk space keeps filling up on EC2 instance with no apperent files/directoriesVirtualbox disk in CentOS mount/format issue

Covering index used despite missing column

I just entered the USA without passport control at Atlanta airport

Is the specular reflection on a polished gold sphere white or gold in colour?

Going back in time in and initial value problem

Can I enter the UK for 24 hours from a Schengen area, holding an Indian passport?

Why isn't my calculation that we should be able to see the sun well beyond the observable universe valid?

Why does std::string_view create a dangling view in a ternary expression?

What are the pros and cons for the two possible "gear directions" when parking the car on a hill?

What happened to Hopper's girlfriend in season one?

Find All Possible Unique Combinations of Letters in a Word

Print one file per line using echo

In Mistborn, why can metal in people's bodies be affected by Allomancy sometimes?

Dmesg full of I/O errors, smart ok, four disks affected

What is the "ls" directory in my home directory?

What triggered jesuits' ban on infinitesimals in 1632?

Is the continuity test limit resistance of a multimeter standard?

What is the most suitable position for a bishop here?

"Correct me if I'm wrong"

What is the highest voltage from the power supply a Raspberry Pi 3 B can handle without getting damaged?

Why isn't it a compile-time error to return a nullptr as a std::string?

Has a life raft ever been successfully deployed on a modern commercial flight?

How do internally carried IR missiles acquire a lock?

Dates on degrees don’t make sense – will people care?

Designing a magic-compatible polearm



Near 100% disk usage, df and du show very different results, lsof not the answer


du vs. df differencedisk space keeps filling up on EC2 instance with no apperent files/directoriesVirtualbox disk in CentOS mount/format issue






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;








3















The issue is that my CentOS 5.8 machine is telling me that I am nearly out of disk space when I am pretty confident this is not the case. I've done a fair amount of researching on this issue and have been unable to find a solution.



'df -h' shows 210G used, 8.6G avail



'ncdu' shows 28.6G used (same for apparent size)



As you can see, this is nearly a 10x difference in the reported 'used' space. Knowing what is stored on this drive, I think 28.6G is closer to reality.



Looking at the output of 'lsof' there are very few lines with (deleted) at the end. Moreover, the largest size of any of these lines is 6190. Finally, I've rebooted the machine a number of times which, if I understand the other threads correctly, would resolve the issue of phantom files anyhow.



Here is a summary of the output from ncdu:




22.7GiB [##########] /opt
2.8GiB [# ] /usr
1.5GiB [ ] /var
812.4MiB [ ] /root
310.6MiB [ ] /home
194.3MiB [ ] /lib
156.4MiB [ ] /etc
36.5MiB [ ] /sbin
7.3MiB [ ] /bin
128.0KiB [ ] /tmp
20.0KiB [ ] /mnt
e 16.0KiB [ ] /lost+found
e 8.0KiB [ ] /srv
e 8.0KiB [ ] /selinux
8.0KiB [ ] /media
e 4.0KiB [ ] /backup
> 0.0 B [ ] /sys
> 0.0 B [ ] /proc
> 0.0 B [ ] /net
> 0.0 B [ ] /misc
> 0.0 B [ ] /dev
> 0.0 B [ ] /boot
0.0 B [ ] .autorelabel
0.0 B [ ] .autofsck


Output of 'df -Th':




Filesystem Type Size Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
ext3 221G 210G 8.6G 97% /
/dev/sda1 ext3 99M 25M 74M 25% /boot
tmpfs tmpfs 1.7G 0 1.7G 0% /dev/shm


This post mentions that outside of phantom files there are two other possible explanations:



  1. corrupt filesystem

  2. compromised machine

I'm looking for help on how to test the validity of these explanations. Obviously, explanation #2 is particularly concerning.



Thanks for your help!










share|improve this question
























  • Possible duplicate of serverfault.com/questions/57098/du-vs-df-difference

    – user130370
    Dec 11 '13 at 8:32











  • Are you running ncdu with sudo?

    – Babken Vardanyan
    May 4 '16 at 10:28











  • This is surprising. Have you finally pinpointed the cause? Or at least some hint? What happened after that?

    – Stéphane Gourichon
    Mar 19 '17 at 16:07











  • And it's not a reserved block count issue? Check with dumpe2fs.

    – Halfgaar
    Jun 3 at 11:26

















3















The issue is that my CentOS 5.8 machine is telling me that I am nearly out of disk space when I am pretty confident this is not the case. I've done a fair amount of researching on this issue and have been unable to find a solution.



'df -h' shows 210G used, 8.6G avail



'ncdu' shows 28.6G used (same for apparent size)



As you can see, this is nearly a 10x difference in the reported 'used' space. Knowing what is stored on this drive, I think 28.6G is closer to reality.



Looking at the output of 'lsof' there are very few lines with (deleted) at the end. Moreover, the largest size of any of these lines is 6190. Finally, I've rebooted the machine a number of times which, if I understand the other threads correctly, would resolve the issue of phantom files anyhow.



Here is a summary of the output from ncdu:




22.7GiB [##########] /opt
2.8GiB [# ] /usr
1.5GiB [ ] /var
812.4MiB [ ] /root
310.6MiB [ ] /home
194.3MiB [ ] /lib
156.4MiB [ ] /etc
36.5MiB [ ] /sbin
7.3MiB [ ] /bin
128.0KiB [ ] /tmp
20.0KiB [ ] /mnt
e 16.0KiB [ ] /lost+found
e 8.0KiB [ ] /srv
e 8.0KiB [ ] /selinux
8.0KiB [ ] /media
e 4.0KiB [ ] /backup
> 0.0 B [ ] /sys
> 0.0 B [ ] /proc
> 0.0 B [ ] /net
> 0.0 B [ ] /misc
> 0.0 B [ ] /dev
> 0.0 B [ ] /boot
0.0 B [ ] .autorelabel
0.0 B [ ] .autofsck


Output of 'df -Th':




Filesystem Type Size Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
ext3 221G 210G 8.6G 97% /
/dev/sda1 ext3 99M 25M 74M 25% /boot
tmpfs tmpfs 1.7G 0 1.7G 0% /dev/shm


This post mentions that outside of phantom files there are two other possible explanations:



  1. corrupt filesystem

  2. compromised machine

I'm looking for help on how to test the validity of these explanations. Obviously, explanation #2 is particularly concerning.



Thanks for your help!










share|improve this question
























  • Possible duplicate of serverfault.com/questions/57098/du-vs-df-difference

    – user130370
    Dec 11 '13 at 8:32











  • Are you running ncdu with sudo?

    – Babken Vardanyan
    May 4 '16 at 10:28











  • This is surprising. Have you finally pinpointed the cause? Or at least some hint? What happened after that?

    – Stéphane Gourichon
    Mar 19 '17 at 16:07











  • And it's not a reserved block count issue? Check with dumpe2fs.

    – Halfgaar
    Jun 3 at 11:26













3












3








3


0






The issue is that my CentOS 5.8 machine is telling me that I am nearly out of disk space when I am pretty confident this is not the case. I've done a fair amount of researching on this issue and have been unable to find a solution.



'df -h' shows 210G used, 8.6G avail



'ncdu' shows 28.6G used (same for apparent size)



As you can see, this is nearly a 10x difference in the reported 'used' space. Knowing what is stored on this drive, I think 28.6G is closer to reality.



Looking at the output of 'lsof' there are very few lines with (deleted) at the end. Moreover, the largest size of any of these lines is 6190. Finally, I've rebooted the machine a number of times which, if I understand the other threads correctly, would resolve the issue of phantom files anyhow.



Here is a summary of the output from ncdu:




22.7GiB [##########] /opt
2.8GiB [# ] /usr
1.5GiB [ ] /var
812.4MiB [ ] /root
310.6MiB [ ] /home
194.3MiB [ ] /lib
156.4MiB [ ] /etc
36.5MiB [ ] /sbin
7.3MiB [ ] /bin
128.0KiB [ ] /tmp
20.0KiB [ ] /mnt
e 16.0KiB [ ] /lost+found
e 8.0KiB [ ] /srv
e 8.0KiB [ ] /selinux
8.0KiB [ ] /media
e 4.0KiB [ ] /backup
> 0.0 B [ ] /sys
> 0.0 B [ ] /proc
> 0.0 B [ ] /net
> 0.0 B [ ] /misc
> 0.0 B [ ] /dev
> 0.0 B [ ] /boot
0.0 B [ ] .autorelabel
0.0 B [ ] .autofsck


Output of 'df -Th':




Filesystem Type Size Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
ext3 221G 210G 8.6G 97% /
/dev/sda1 ext3 99M 25M 74M 25% /boot
tmpfs tmpfs 1.7G 0 1.7G 0% /dev/shm


This post mentions that outside of phantom files there are two other possible explanations:



  1. corrupt filesystem

  2. compromised machine

I'm looking for help on how to test the validity of these explanations. Obviously, explanation #2 is particularly concerning.



Thanks for your help!










share|improve this question
















The issue is that my CentOS 5.8 machine is telling me that I am nearly out of disk space when I am pretty confident this is not the case. I've done a fair amount of researching on this issue and have been unable to find a solution.



'df -h' shows 210G used, 8.6G avail



'ncdu' shows 28.6G used (same for apparent size)



As you can see, this is nearly a 10x difference in the reported 'used' space. Knowing what is stored on this drive, I think 28.6G is closer to reality.



Looking at the output of 'lsof' there are very few lines with (deleted) at the end. Moreover, the largest size of any of these lines is 6190. Finally, I've rebooted the machine a number of times which, if I understand the other threads correctly, would resolve the issue of phantom files anyhow.



Here is a summary of the output from ncdu:




22.7GiB [##########] /opt
2.8GiB [# ] /usr
1.5GiB [ ] /var
812.4MiB [ ] /root
310.6MiB [ ] /home
194.3MiB [ ] /lib
156.4MiB [ ] /etc
36.5MiB [ ] /sbin
7.3MiB [ ] /bin
128.0KiB [ ] /tmp
20.0KiB [ ] /mnt
e 16.0KiB [ ] /lost+found
e 8.0KiB [ ] /srv
e 8.0KiB [ ] /selinux
8.0KiB [ ] /media
e 4.0KiB [ ] /backup
> 0.0 B [ ] /sys
> 0.0 B [ ] /proc
> 0.0 B [ ] /net
> 0.0 B [ ] /misc
> 0.0 B [ ] /dev
> 0.0 B [ ] /boot
0.0 B [ ] .autorelabel
0.0 B [ ] .autofsck


Output of 'df -Th':




Filesystem Type Size Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
ext3 221G 210G 8.6G 97% /
/dev/sda1 ext3 99M 25M 74M 25% /boot
tmpfs tmpfs 1.7G 0 1.7G 0% /dev/shm


This post mentions that outside of phantom files there are two other possible explanations:



  1. corrupt filesystem

  2. compromised machine

I'm looking for help on how to test the validity of these explanations. Obviously, explanation #2 is particularly concerning.



Thanks for your help!







centos5 disk-space-utilization lsof du df






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Apr 13 '17 at 12:14









Community

1




1










asked Dec 11 '13 at 7:02









edwaaedwaa

192




192












  • Possible duplicate of serverfault.com/questions/57098/du-vs-df-difference

    – user130370
    Dec 11 '13 at 8:32











  • Are you running ncdu with sudo?

    – Babken Vardanyan
    May 4 '16 at 10:28











  • This is surprising. Have you finally pinpointed the cause? Or at least some hint? What happened after that?

    – Stéphane Gourichon
    Mar 19 '17 at 16:07











  • And it's not a reserved block count issue? Check with dumpe2fs.

    – Halfgaar
    Jun 3 at 11:26

















  • Possible duplicate of serverfault.com/questions/57098/du-vs-df-difference

    – user130370
    Dec 11 '13 at 8:32











  • Are you running ncdu with sudo?

    – Babken Vardanyan
    May 4 '16 at 10:28











  • This is surprising. Have you finally pinpointed the cause? Or at least some hint? What happened after that?

    – Stéphane Gourichon
    Mar 19 '17 at 16:07











  • And it's not a reserved block count issue? Check with dumpe2fs.

    – Halfgaar
    Jun 3 at 11:26
















Possible duplicate of serverfault.com/questions/57098/du-vs-df-difference

– user130370
Dec 11 '13 at 8:32





Possible duplicate of serverfault.com/questions/57098/du-vs-df-difference

– user130370
Dec 11 '13 at 8:32













Are you running ncdu with sudo?

– Babken Vardanyan
May 4 '16 at 10:28





Are you running ncdu with sudo?

– Babken Vardanyan
May 4 '16 at 10:28













This is surprising. Have you finally pinpointed the cause? Or at least some hint? What happened after that?

– Stéphane Gourichon
Mar 19 '17 at 16:07





This is surprising. Have you finally pinpointed the cause? Or at least some hint? What happened after that?

– Stéphane Gourichon
Mar 19 '17 at 16:07













And it's not a reserved block count issue? Check with dumpe2fs.

– Halfgaar
Jun 3 at 11:26





And it's not a reserved block count issue? Check with dumpe2fs.

– Halfgaar
Jun 3 at 11:26










1 Answer
1






active

oldest

votes


















0














You may try running e2fsck /dev/sdxy from a live Linux to check for FS corruption. The partition must be unmounted, that's why you need to boot up a live Linux.






share|improve this answer























    Your Answer








    StackExchange.ready(function()
    var channelOptions =
    tags: "".split(" "),
    id: "2"
    ;
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function()
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled)
    StackExchange.using("snippets", function()
    createEditor();
    );

    else
    createEditor();

    );

    function createEditor()
    StackExchange.prepareEditor(
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: true,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: 10,
    bindNavPrevention: true,
    postfix: "",
    imageUploader:
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    ,
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    );



    );













    draft saved

    draft discarded


















    StackExchange.ready(
    function ()
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f560600%2fnear-100-disk-usage-df-and-du-show-very-different-results-lsof-not-the-answer%23new-answer', 'question_page');

    );

    Post as a guest















    Required, but never shown

























    1 Answer
    1






    active

    oldest

    votes








    1 Answer
    1






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    0














    You may try running e2fsck /dev/sdxy from a live Linux to check for FS corruption. The partition must be unmounted, that's why you need to boot up a live Linux.






    share|improve this answer



























      0














      You may try running e2fsck /dev/sdxy from a live Linux to check for FS corruption. The partition must be unmounted, that's why you need to boot up a live Linux.






      share|improve this answer

























        0












        0








        0







        You may try running e2fsck /dev/sdxy from a live Linux to check for FS corruption. The partition must be unmounted, that's why you need to boot up a live Linux.






        share|improve this answer













        You may try running e2fsck /dev/sdxy from a live Linux to check for FS corruption. The partition must be unmounted, that's why you need to boot up a live Linux.







        share|improve this answer












        share|improve this answer



        share|improve this answer










        answered Dec 11 '13 at 7:12









        David LakatosDavid Lakatos

        17310




        17310



























            draft saved

            draft discarded
















































            Thanks for contributing an answer to Server Fault!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid


            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.

            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f560600%2fnear-100-disk-usage-df-and-du-show-very-different-results-lsof-not-the-answer%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            Popular posts from this blog

            How to write a 12-bar blues melodyI-IV-V blues progressionHow to play the bridges in a standard blues progressionHow does Gdim7 fit in C# minor?question on a certain chord progressionMusicology of Melody12 bar blues, spread rhythm: alternative to 6th chord to avoid finger stretchChord progressions/ Root key/ MelodiesHow to put chords (POP-EDM) under a given lead vocal melody (starting from a good knowledge in music theory)Are there “rules” for improvising with the minor pentatonic scale over 12-bar shuffle?Confusion about blues scale and chords

            What if the end-user didn't have the required library?What is setup.py?What is a clean, pythonic way to have multiple constructors in Python?What does Ruby have that Python doesn't, and vice versa?What is the reason for having '//' in Python?How do I create a namespace package in Python?How to package shared objects that python modules depend on?setuptools vs. distutils: why is distutils still a thing?Navigation in Windows 10 vs code not going to virtualenv library when the same library is installed at user levelPython create package for local usePackaging a project that uses multiple python versionsWhy is permission denied on pip install except for when “--user” is included at end of command?

            Why did Thanos need his ship to help him in the battle scene?Which actor plays Thanos in the Avengers mid-credits scene?Are there economic implications portrayed in comics where the buildings and cities are ruined almost daily?Old X-Men comic where team travels to alien world with a ring-like sun that needs recharging?Why does Ego need help sleeping?Is there an objective answer to who “the strongest Avenger” is?How did Banner get unstuck?Why did Thanos get hit?How did Thanos (or anyone) know the Infinity Stones would give him this power?Did Thanos leave Eitri alive for his after-sales service?In Avengers 1, why does Thanos need Loki?