MongoDB: insert operation fails but disk is freeDRBD on a disk with existing file system that takes all the placeWhy am I getting “write queue file: No space left on device” from postfix when there's 5GB of free space on disk? /tmp has changed to read onlyMongoDB upgrade on Ubuntu causing “Low Disk Space” error messageXFS: No space left on device/tmp used 100% where is files?How to enlarge the root partition on Centos 7 / ibdata1 getting too large“Operation not permitted” on files over 2GB on ext4 filesystemLogical Volume /dev/centos/root is extended but /dev/mapper/centos-root is notubuntu 18.04 lamp stack installed in root partition taking full space

Bent arrow under a node

Counterfeit checks were created for my account. How does this type of fraud work?

How could I create a situation in which a PC has to make a saving throw or be forced to pet a dog?

Is there any way to revive my Sim?

Do details of my undergraduate title matter?

Am I legally required to provide a (GPL licensed) source code even after a project is abandoned?

Is this series for Pi correct? And who has done it before?

How do you transpose samples in cents?

Why is it easier to balance a non-moving bike standing up than sitting down?

What is this plant I saw for sale at a Romanian farmer's market?

Why do you need to heat the pan before heating the olive oil?

Explicit song lyrics checker

Synaptic Static - when to roll the d6?

What is the name of the person who reconciled a line from Rudram to dakshinamurthy and Adi Shankaracharya?

How is linear momentum conserved in circular motion?

I have found ports on my Samsung smart tv running a display service. What can I do with it?

What is the highest power supply a Raspberry pi 3 B can handle without getting damaged?

Convergent Licencing

Predict the product from the reaction

How can I restore a master database from its bak file?

How to ask if I can mow my neighbor's lawn

Time at 1G acceleration to travel 100 000 light years

How to write a nice frame challenge?

What is this airplane that sits in front of Barringer High School in Newark, NJ?



MongoDB: insert operation fails but disk is free


DRBD on a disk with existing file system that takes all the placeWhy am I getting “write queue file: No space left on device” from postfix when there's 5GB of free space on disk? /tmp has changed to read onlyMongoDB upgrade on Ubuntu causing “Low Disk Space” error messageXFS: No space left on device/tmp used 100% where is files?How to enlarge the root partition on Centos 7 / ibdata1 getting too large“Operation not permitted” on files over 2GB on ext4 filesystemLogical Volume /dev/centos/root is extended but /dev/mapper/centos-root is notubuntu 18.04 lamp stack installed in root partition taking full space






.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;








2















I've seen the strange behavior of my server and first of all I looked at log file /var/log/mongodb/mongodb.log. There I saw the next lines:



Wed Jan 7 16:33:31 [FileAllocator] allocating new datafile /var/lib/mongodb/salesg_call_log.1, filling with zeroes...
Wed Jan 7 16:33:31 [FileAllocator] FileAllocator: posix_fallocate failed: errno:28 No space left on device falling back
Wed Jan 7 16:33:31 [FileAllocator] error failed to allocate new file: /var/lib/mongodb/salesg_call_log.1 size: 33554432 errno:28 No space left on device
Wed Jan 7 16:33:31 [FileAllocator] will try again in 10 seconds


I guess that it means that there is no free disk space on my server.



Then I typed command df -h:



Filesystem Size Used Avail Use% Mounted on
rootfs 9.3G 2.5G 6.5G 28% /
udev 10M 0 10M 0% /dev
tmpfs 55M 92K 55M 1% /run
/dev/mapper/jatare--web--front_system-root 9.3G 2.5G 6.5G 28% /
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 109M 0 109M 0% /run/shm
/dev/xvda1 134M 18M 109M 15% /boot


My MongoDB-files store at /var/lib/mongodb/, and there are a lot of enough space to store data.



Then I've just restarted mongodb service and apache2 service and now everything works well. But i am afraid of getting the same situation in near future.



So my question is what is the problem and how to solve it?



For @NickW:



root@jatare-web-front:~# df -i
Filesystem Inodes IUsed IFree IUse% Mounted on
rootfs 593408 46255 547153 8% /
udev 57496 273 57223 1% /dev
tmpfs 69353 189 69164 1% /run
/dev/mapper/jatare--web--front_system-root 593408 46255 547153 8% /
tmpfs 69353 3 69350 1% /run/lock
tmpfs 69353 2 69351 1% /run/shm
/dev/xvda1 72720 27 72693 1% /boot









share|improve this question
























  • What sort of server are you running? Virtualized?

    – NickW
    Jan 7 '15 at 14:31











  • It's running in cloud, like Amazon AWS.

    – Alexander Perechnev
    Jan 7 '15 at 14:33






  • 1





    posix_fallocate basically tries to find out if the entire size of the file is available on disk. Mongodb creates quite large files on disk, it's possible it was over 6.5 GB.. so, put more disk space in there if you want to avoid the issue.

    – NickW
    Jan 7 '15 at 14:42






  • 1





    Have you checked the number of inodes avaialable? df -i.

    – Chris Davidson
    Jan 7 '15 at 15:28











  • @Dayvo I've added result of df -i to my question.

    – Alexander Perechnev
    Jan 7 '15 at 21:35

















2















I've seen the strange behavior of my server and first of all I looked at log file /var/log/mongodb/mongodb.log. There I saw the next lines:



Wed Jan 7 16:33:31 [FileAllocator] allocating new datafile /var/lib/mongodb/salesg_call_log.1, filling with zeroes...
Wed Jan 7 16:33:31 [FileAllocator] FileAllocator: posix_fallocate failed: errno:28 No space left on device falling back
Wed Jan 7 16:33:31 [FileAllocator] error failed to allocate new file: /var/lib/mongodb/salesg_call_log.1 size: 33554432 errno:28 No space left on device
Wed Jan 7 16:33:31 [FileAllocator] will try again in 10 seconds


I guess that it means that there is no free disk space on my server.



Then I typed command df -h:



Filesystem Size Used Avail Use% Mounted on
rootfs 9.3G 2.5G 6.5G 28% /
udev 10M 0 10M 0% /dev
tmpfs 55M 92K 55M 1% /run
/dev/mapper/jatare--web--front_system-root 9.3G 2.5G 6.5G 28% /
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 109M 0 109M 0% /run/shm
/dev/xvda1 134M 18M 109M 15% /boot


My MongoDB-files store at /var/lib/mongodb/, and there are a lot of enough space to store data.



Then I've just restarted mongodb service and apache2 service and now everything works well. But i am afraid of getting the same situation in near future.



So my question is what is the problem and how to solve it?



For @NickW:



root@jatare-web-front:~# df -i
Filesystem Inodes IUsed IFree IUse% Mounted on
rootfs 593408 46255 547153 8% /
udev 57496 273 57223 1% /dev
tmpfs 69353 189 69164 1% /run
/dev/mapper/jatare--web--front_system-root 593408 46255 547153 8% /
tmpfs 69353 3 69350 1% /run/lock
tmpfs 69353 2 69351 1% /run/shm
/dev/xvda1 72720 27 72693 1% /boot









share|improve this question
























  • What sort of server are you running? Virtualized?

    – NickW
    Jan 7 '15 at 14:31











  • It's running in cloud, like Amazon AWS.

    – Alexander Perechnev
    Jan 7 '15 at 14:33






  • 1





    posix_fallocate basically tries to find out if the entire size of the file is available on disk. Mongodb creates quite large files on disk, it's possible it was over 6.5 GB.. so, put more disk space in there if you want to avoid the issue.

    – NickW
    Jan 7 '15 at 14:42






  • 1





    Have you checked the number of inodes avaialable? df -i.

    – Chris Davidson
    Jan 7 '15 at 15:28











  • @Dayvo I've added result of df -i to my question.

    – Alexander Perechnev
    Jan 7 '15 at 21:35













2












2








2








I've seen the strange behavior of my server and first of all I looked at log file /var/log/mongodb/mongodb.log. There I saw the next lines:



Wed Jan 7 16:33:31 [FileAllocator] allocating new datafile /var/lib/mongodb/salesg_call_log.1, filling with zeroes...
Wed Jan 7 16:33:31 [FileAllocator] FileAllocator: posix_fallocate failed: errno:28 No space left on device falling back
Wed Jan 7 16:33:31 [FileAllocator] error failed to allocate new file: /var/lib/mongodb/salesg_call_log.1 size: 33554432 errno:28 No space left on device
Wed Jan 7 16:33:31 [FileAllocator] will try again in 10 seconds


I guess that it means that there is no free disk space on my server.



Then I typed command df -h:



Filesystem Size Used Avail Use% Mounted on
rootfs 9.3G 2.5G 6.5G 28% /
udev 10M 0 10M 0% /dev
tmpfs 55M 92K 55M 1% /run
/dev/mapper/jatare--web--front_system-root 9.3G 2.5G 6.5G 28% /
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 109M 0 109M 0% /run/shm
/dev/xvda1 134M 18M 109M 15% /boot


My MongoDB-files store at /var/lib/mongodb/, and there are a lot of enough space to store data.



Then I've just restarted mongodb service and apache2 service and now everything works well. But i am afraid of getting the same situation in near future.



So my question is what is the problem and how to solve it?



For @NickW:



root@jatare-web-front:~# df -i
Filesystem Inodes IUsed IFree IUse% Mounted on
rootfs 593408 46255 547153 8% /
udev 57496 273 57223 1% /dev
tmpfs 69353 189 69164 1% /run
/dev/mapper/jatare--web--front_system-root 593408 46255 547153 8% /
tmpfs 69353 3 69350 1% /run/lock
tmpfs 69353 2 69351 1% /run/shm
/dev/xvda1 72720 27 72693 1% /boot









share|improve this question
















I've seen the strange behavior of my server and first of all I looked at log file /var/log/mongodb/mongodb.log. There I saw the next lines:



Wed Jan 7 16:33:31 [FileAllocator] allocating new datafile /var/lib/mongodb/salesg_call_log.1, filling with zeroes...
Wed Jan 7 16:33:31 [FileAllocator] FileAllocator: posix_fallocate failed: errno:28 No space left on device falling back
Wed Jan 7 16:33:31 [FileAllocator] error failed to allocate new file: /var/lib/mongodb/salesg_call_log.1 size: 33554432 errno:28 No space left on device
Wed Jan 7 16:33:31 [FileAllocator] will try again in 10 seconds


I guess that it means that there is no free disk space on my server.



Then I typed command df -h:



Filesystem Size Used Avail Use% Mounted on
rootfs 9.3G 2.5G 6.5G 28% /
udev 10M 0 10M 0% /dev
tmpfs 55M 92K 55M 1% /run
/dev/mapper/jatare--web--front_system-root 9.3G 2.5G 6.5G 28% /
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 109M 0 109M 0% /run/shm
/dev/xvda1 134M 18M 109M 15% /boot


My MongoDB-files store at /var/lib/mongodb/, and there are a lot of enough space to store data.



Then I've just restarted mongodb service and apache2 service and now everything works well. But i am afraid of getting the same situation in near future.



So my question is what is the problem and how to solve it?



For @NickW:



root@jatare-web-front:~# df -i
Filesystem Inodes IUsed IFree IUse% Mounted on
rootfs 593408 46255 547153 8% /
udev 57496 273 57223 1% /dev
tmpfs 69353 189 69164 1% /run
/dev/mapper/jatare--web--front_system-root 593408 46255 547153 8% /
tmpfs 69353 3 69350 1% /run/lock
tmpfs 69353 2 69351 1% /run/shm
/dev/xvda1 72720 27 72693 1% /boot






linux debian filesystems mongodb






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Jan 8 '15 at 13:48







Alexander Perechnev

















asked Jan 7 '15 at 14:24









Alexander PerechnevAlexander Perechnev

1216




1216












  • What sort of server are you running? Virtualized?

    – NickW
    Jan 7 '15 at 14:31











  • It's running in cloud, like Amazon AWS.

    – Alexander Perechnev
    Jan 7 '15 at 14:33






  • 1





    posix_fallocate basically tries to find out if the entire size of the file is available on disk. Mongodb creates quite large files on disk, it's possible it was over 6.5 GB.. so, put more disk space in there if you want to avoid the issue.

    – NickW
    Jan 7 '15 at 14:42






  • 1





    Have you checked the number of inodes avaialable? df -i.

    – Chris Davidson
    Jan 7 '15 at 15:28











  • @Dayvo I've added result of df -i to my question.

    – Alexander Perechnev
    Jan 7 '15 at 21:35

















  • What sort of server are you running? Virtualized?

    – NickW
    Jan 7 '15 at 14:31











  • It's running in cloud, like Amazon AWS.

    – Alexander Perechnev
    Jan 7 '15 at 14:33






  • 1





    posix_fallocate basically tries to find out if the entire size of the file is available on disk. Mongodb creates quite large files on disk, it's possible it was over 6.5 GB.. so, put more disk space in there if you want to avoid the issue.

    – NickW
    Jan 7 '15 at 14:42






  • 1





    Have you checked the number of inodes avaialable? df -i.

    – Chris Davidson
    Jan 7 '15 at 15:28











  • @Dayvo I've added result of df -i to my question.

    – Alexander Perechnev
    Jan 7 '15 at 21:35
















What sort of server are you running? Virtualized?

– NickW
Jan 7 '15 at 14:31





What sort of server are you running? Virtualized?

– NickW
Jan 7 '15 at 14:31













It's running in cloud, like Amazon AWS.

– Alexander Perechnev
Jan 7 '15 at 14:33





It's running in cloud, like Amazon AWS.

– Alexander Perechnev
Jan 7 '15 at 14:33




1




1





posix_fallocate basically tries to find out if the entire size of the file is available on disk. Mongodb creates quite large files on disk, it's possible it was over 6.5 GB.. so, put more disk space in there if you want to avoid the issue.

– NickW
Jan 7 '15 at 14:42





posix_fallocate basically tries to find out if the entire size of the file is available on disk. Mongodb creates quite large files on disk, it's possible it was over 6.5 GB.. so, put more disk space in there if you want to avoid the issue.

– NickW
Jan 7 '15 at 14:42




1




1





Have you checked the number of inodes avaialable? df -i.

– Chris Davidson
Jan 7 '15 at 15:28





Have you checked the number of inodes avaialable? df -i.

– Chris Davidson
Jan 7 '15 at 15:28













@Dayvo I've added result of df -i to my question.

– Alexander Perechnev
Jan 7 '15 at 21:35





@Dayvo I've added result of df -i to my question.

– Alexander Perechnev
Jan 7 '15 at 21:35










1 Answer
1






active

oldest

votes


















1














The only solution I've found is about 2GB-limitations in MongoDB on x32-machines. MongoDB can't store more than 2GB on x32-operation systems: http://blog.mongodb.org/post/137788967/32-bit-limitations



But I'm not sure that that was the problem.






share|improve this answer























    Your Answer








    StackExchange.ready(function()
    var channelOptions =
    tags: "".split(" "),
    id: "2"
    ;
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function()
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled)
    StackExchange.using("snippets", function()
    createEditor();
    );

    else
    createEditor();

    );

    function createEditor()
    StackExchange.prepareEditor(
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: true,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: 10,
    bindNavPrevention: true,
    postfix: "",
    imageUploader:
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    ,
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    );



    );













    draft saved

    draft discarded


















    StackExchange.ready(
    function ()
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f657896%2fmongodb-insert-operation-fails-but-disk-is-free%23new-answer', 'question_page');

    );

    Post as a guest















    Required, but never shown

























    1 Answer
    1






    active

    oldest

    votes








    1 Answer
    1






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    1














    The only solution I've found is about 2GB-limitations in MongoDB on x32-machines. MongoDB can't store more than 2GB on x32-operation systems: http://blog.mongodb.org/post/137788967/32-bit-limitations



    But I'm not sure that that was the problem.






    share|improve this answer



























      1














      The only solution I've found is about 2GB-limitations in MongoDB on x32-machines. MongoDB can't store more than 2GB on x32-operation systems: http://blog.mongodb.org/post/137788967/32-bit-limitations



      But I'm not sure that that was the problem.






      share|improve this answer

























        1












        1








        1







        The only solution I've found is about 2GB-limitations in MongoDB on x32-machines. MongoDB can't store more than 2GB on x32-operation systems: http://blog.mongodb.org/post/137788967/32-bit-limitations



        But I'm not sure that that was the problem.






        share|improve this answer













        The only solution I've found is about 2GB-limitations in MongoDB on x32-machines. MongoDB can't store more than 2GB on x32-operation systems: http://blog.mongodb.org/post/137788967/32-bit-limitations



        But I'm not sure that that was the problem.







        share|improve this answer












        share|improve this answer



        share|improve this answer










        answered Jan 8 '15 at 13:46









        Alexander PerechnevAlexander Perechnev

        1216




        1216



























            draft saved

            draft discarded
















































            Thanks for contributing an answer to Server Fault!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid


            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.

            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f657896%2fmongodb-insert-operation-fails-but-disk-is-free%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            Popular posts from this blog

            How to write a 12-bar blues melodyI-IV-V blues progressionHow to play the bridges in a standard blues progressionHow does Gdim7 fit in C# minor?question on a certain chord progressionMusicology of Melody12 bar blues, spread rhythm: alternative to 6th chord to avoid finger stretchChord progressions/ Root key/ MelodiesHow to put chords (POP-EDM) under a given lead vocal melody (starting from a good knowledge in music theory)Are there “rules” for improvising with the minor pentatonic scale over 12-bar shuffle?Confusion about blues scale and chords

            What if the end-user didn't have the required library?What is setup.py?What is a clean, pythonic way to have multiple constructors in Python?What does Ruby have that Python doesn't, and vice versa?What is the reason for having '//' in Python?How do I create a namespace package in Python?How to package shared objects that python modules depend on?setuptools vs. distutils: why is distutils still a thing?Navigation in Windows 10 vs code not going to virtualenv library when the same library is installed at user levelPython create package for local usePackaging a project that uses multiple python versionsWhy is permission denied on pip install except for when “--user” is included at end of command?

            Esgonzo ibérico Índice Descrición Distribución Hábitat Ameazas Notas Véxase tamén "Acerca dos nomes dos anfibios e réptiles galegos""Chalcides bedriagai"Chalcides bedriagai en Carrascal, L. M. Salvador, A. (Eds). Enciclopedia virtual de los vertebrados españoles. Museo Nacional de Ciencias Naturales, Madrid. España.Fotos