Otdfbt

Preserving culinary oils

Geometry affects line breaking

How to detach yourself from a character you're going to kill?

What caused the tendency for conservatives to not support climate change regulations?

Can a rogue effectively triple their speed by combining Dash and Ready?

Do creatures all have the same statistics upon being reanimated via the Animate Dead spell?

Could I be denied entry into Ireland due to medical and police situations during a previous UK visit?

What is the difference between nullifying your vote and not going to vote at all?

What does it mean when you think without speaking?

How can a single Member of the House block a Congressional bill?

Possible nonclassical ion from a bicyclic system

Why does the UK have more political parties than the US?

Intuition behind eigenvalues of an adjacency matrix

What was this black-and-white film set in the Arctic or Antarctic where the monster/alien gets fried in the end?

Looking after a wayward brother in mother's will

Rotated Position of Integers

Is a hash a zero-knowledge proof?

Creating Fictional Slavic Place Names

Can a non-EU citizen travel within the Schengen area without identity documents?

Why use water tanks from a retired Space Shuttle?

Self-Preservation: How to DM NPCs that Love Living?

When a current flow in an inductor is interrupted, what limits the voltage rise?

Why were the Night's Watch required to be celibate?

How do I subvert the tropes of a train heist?

AWS is eating up storage space

Using all space on Amazon EC2 - Medium tierAWS instances: AMI bundles and snapshots and bears, oh myEC2 Ubuntu 12.04 m1.large ami isn't showing extra drives for full 850GB Instance Storagedisk space keeps filling up on EC2 instance with no apperent files/directoriesHow to add my newly created Ec2 filesystem to /etc/fstab so that it get mounted automatically on next bootAdding EBS volume to Amazon EC2 server. Do I need to?How to reduce AWS EBS root volume size?AWS fails to resize an RHEL64 instance upon launchEC2 Dashboard says instnce running but DevOps says ec2 instance is stopping/restartingmkfs fails on ec2 t3.large instances

.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;

1

I have ec2 account setup with size of 80GB. I have uploaded ML code of 2gb on this ec2 instance. However for some reasons my instance is 99% occupied in terms of storage space

ubuntu@ip-172-31-41-142:/dev$ df xvda1
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/xvda1 76171508 75318652 836472 99% /

Something is eating up almost 98% of my ec2 instances storage space. What is it and how do I clear this space

amazon-web-services amazon-ec2

share|improve this question

asked May 16 at 6:16

AjinkyaAjinkya

1166

add a comment | 

1

I have ec2 account setup with size of 80GB. I have uploaded ML code of 2gb on this ec2 instance. However for some reasons my instance is 99% occupied in terms of storage space

ubuntu@ip-172-31-41-142:/dev$ df xvda1
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/xvda1 76171508 75318652 836472 99% /

Something is eating up almost 98% of my ec2 instances storage space. What is it and how do I clear this space

amazon-web-services amazon-ec2

share|improve this question

asked May 16 at 6:16

AjinkyaAjinkya

1166

add a comment | 

I have ec2 account setup with size of 80GB. I have uploaded ML code of 2gb on this ec2 instance. However for some reasons my instance is 99% occupied in terms of storage space

ubuntu@ip-172-31-41-142:/dev$ df xvda1
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/xvda1 76171508 75318652 836472 99% /

Something is eating up almost 98% of my ec2 instances storage space. What is it and how do I clear this space

amazon-web-services amazon-ec2

share|improve this question

asked May 16 at 6:16

AjinkyaAjinkya

1166

ubuntu@ip-172-31-41-142:/dev$ df xvda1
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/xvda1 76171508 75318652 836472 99% /

share|improve this question

asked May 16 at 6:16

AjinkyaAjinkya

1166

share|improve this question

asked May 16 at 6:16

AjinkyaAjinkya

1166

asked May 16 at 6:16

AjinkyaAjinkya

1166

asked May 16 at 6:16

AjinkyaAjinkya

1166

3 Answers
3

active

oldest

votes

3

That something may be log files which have become too large and need to be removed.

Try eliminating the ones above 4MB size:

find / -type f -size +4M -exec ls -lh ;

If you attempted file deletions, make sure there are not processes still accessing them and check into deleted ones:

find /proc/*/fd -ls | grep '(deleted)'

share|improve this answer

answered May 16 at 6:47

OvermindOvermind

1,522515

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  I do get a list of files, after executing your first command. But how do I distinguish between a log file and normal files. Do log files have any specific file extentions
  
  – Ajinkya
  May 16 at 7:07
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  For example I am no sure if "-rwxrwxr-x 21 ubuntu ubuntu 11M Mar 22 2018 /home/ubuntu/anaconda3/envs/chainer_p36/lib/libmkl_vml_mc.so -rwxrwxr-x 21 ubuntu ubuntu 11M Mar 22 2018 /home/ubuntu/anaconda3/envs/chainer_p36/lib/libmkl_gf_lp64.so " is a log file or not
  
  – Ajinkya
  May 16 at 7:16
  

  
  
  
  


• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  
  They usually have .log extension. Examples: /var/log/eb-activity.log /var/log/eb-commandprocessor.log /var/log/eb-version-deployment.log . See here some info on where to find other logs: docs.aws.amazon.com/elasticbeanstalk/latest/dg/…
  
  – Overmind
  May 16 at 8:30
  
  

  
  
  
  

add a comment | 

1

The version that I took of AWS shipped with pre-installed conda virtual environments. I needed to do

conda env list

and then delete the unnecessary virtual environments

share|improve this answer

edited May 16 at 8:12

Tim

18.5k41951

answered May 16 at 7:25

AjinkyaAjinkya

1166

add a comment | 

1

Sometimes looking for the largest directories can be a good option. Here's a method I use frequently: du -hx / | sort -hr | head -n 30 - this gives the top 30 directories occupying the most space. Change 30 to whatever number you want - I usually try to make it a few lines less than the number of lines on my terminal.

Once you have an idea of which directories are large, you can research what they're used for and how to clean them up best. e.g. If /var/cache/apt is large, you probably should consider running apt clean; if /var/log is the largest, you should work out which applications are logging the most and look into tuning their log output to be less verbose.

Of course, sometimes it's all legitimate disk space usage, and the simplest and most expedient solution is just to add more disk.

share|improve this answer

answered May 16 at 21:55

Paul GearPaul Gear

3,0441134

add a comment | 

Your Answer

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "2"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);

Sign up using Google

Sign up using Facebook

Sign up using Email and Password

Post as a guest

Name

Email

Required, but never shown

StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f967507%2faws-is-eating-up-storage-space%23new-answer', 'question_page');

);

Post as a guest

Name

Email

Required, but never shown

3

That something may be log files which have become too large and need to be removed.

Try eliminating the ones above 4MB size:

find / -type f -size +4M -exec ls -lh ;

If you attempted file deletions, make sure there are not processes still accessing them and check into deleted ones:

find /proc/*/fd -ls | grep '(deleted)'

share|improve this answer

answered May 16 at 6:47

OvermindOvermind

1,522515

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  I do get a list of files, after executing your first command. But how do I distinguish between a log file and normal files. Do log files have any specific file extentions
  
  – Ajinkya
  May 16 at 7:07
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  For example I am no sure if "-rwxrwxr-x 21 ubuntu ubuntu 11M Mar 22 2018 /home/ubuntu/anaconda3/envs/chainer_p36/lib/libmkl_vml_mc.so -rwxrwxr-x 21 ubuntu ubuntu 11M Mar 22 2018 /home/ubuntu/anaconda3/envs/chainer_p36/lib/libmkl_gf_lp64.so " is a log file or not
  
  – Ajinkya
  May 16 at 7:16
  

  
  
  
  


• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  
  They usually have .log extension. Examples: /var/log/eb-activity.log /var/log/eb-commandprocessor.log /var/log/eb-version-deployment.log . See here some info on where to find other logs: docs.aws.amazon.com/elasticbeanstalk/latest/dg/…
  
  – Overmind
  May 16 at 8:30
  
  

  
  
  
  

add a comment | 

3

That something may be log files which have become too large and need to be removed.

Try eliminating the ones above 4MB size:

find / -type f -size +4M -exec ls -lh ;

If you attempted file deletions, make sure there are not processes still accessing them and check into deleted ones:

find /proc/*/fd -ls | grep '(deleted)'

share|improve this answer

answered May 16 at 6:47

OvermindOvermind

1,522515

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  I do get a list of files, after executing your first command. But how do I distinguish between a log file and normal files. Do log files have any specific file extentions
  
  – Ajinkya
  May 16 at 7:07
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  For example I am no sure if "-rwxrwxr-x 21 ubuntu ubuntu 11M Mar 22 2018 /home/ubuntu/anaconda3/envs/chainer_p36/lib/libmkl_vml_mc.so -rwxrwxr-x 21 ubuntu ubuntu 11M Mar 22 2018 /home/ubuntu/anaconda3/envs/chainer_p36/lib/libmkl_gf_lp64.so " is a log file or not
  
  – Ajinkya
  May 16 at 7:16
  

  
  
  
  


• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  
  They usually have .log extension. Examples: /var/log/eb-activity.log /var/log/eb-commandprocessor.log /var/log/eb-version-deployment.log . See here some info on where to find other logs: docs.aws.amazon.com/elasticbeanstalk/latest/dg/…
  
  – Overmind
  May 16 at 8:30
  
  

  
  
  
  

add a comment | 

That something may be log files which have become too large and need to be removed.

Try eliminating the ones above 4MB size:

find / -type f -size +4M -exec ls -lh ;

If you attempted file deletions, make sure there are not processes still accessing them and check into deleted ones:

find /proc/*/fd -ls | grep '(deleted)'

share|improve this answer

answered May 16 at 6:47

OvermindOvermind

1,522515

find / -type f -size +4M -exec ls -lh ;

find /proc/*/fd -ls | grep '(deleted)'

share|improve this answer

answered May 16 at 6:47

OvermindOvermind

1,522515

answered May 16 at 6:47

OvermindOvermind

1,522515

answered May 16 at 6:47

OvermindOvermind

1,522515

1

The version that I took of AWS shipped with pre-installed conda virtual environments. I needed to do

conda env list

and then delete the unnecessary virtual environments

share|improve this answer

edited May 16 at 8:12

Tim

18.5k41951

answered May 16 at 7:25

AjinkyaAjinkya

1166

add a comment | 

1

The version that I took of AWS shipped with pre-installed conda virtual environments. I needed to do

conda env list

and then delete the unnecessary virtual environments

share|improve this answer

edited May 16 at 8:12

Tim

18.5k41951

answered May 16 at 7:25

AjinkyaAjinkya

1166

add a comment | 

The version that I took of AWS shipped with pre-installed conda virtual environments. I needed to do

conda env list

and then delete the unnecessary virtual environments

share|improve this answer

edited May 16 at 8:12

Tim

18.5k41951

answered May 16 at 7:25

AjinkyaAjinkya

1166

conda env list

share|improve this answer

edited May 16 at 8:12

Tim

18.5k41951

answered May 16 at 7:25

AjinkyaAjinkya

1166

edited May 16 at 8:12

Tim

18.5k41951

edited May 16 at 8:12

Tim

18.5k41951

answered May 16 at 7:25

AjinkyaAjinkya

1166

answered May 16 at 7:25

AjinkyaAjinkya

1166

1

Sometimes looking for the largest directories can be a good option. Here's a method I use frequently: du -hx / | sort -hr | head -n 30 - this gives the top 30 directories occupying the most space. Change 30 to whatever number you want - I usually try to make it a few lines less than the number of lines on my terminal.

Once you have an idea of which directories are large, you can research what they're used for and how to clean them up best. e.g. If /var/cache/apt is large, you probably should consider running apt clean; if /var/log is the largest, you should work out which applications are logging the most and look into tuning their log output to be less verbose.

Of course, sometimes it's all legitimate disk space usage, and the simplest and most expedient solution is just to add more disk.

share|improve this answer

answered May 16 at 21:55

Paul GearPaul Gear

3,0441134

add a comment | 

1

Sometimes looking for the largest directories can be a good option. Here's a method I use frequently: du -hx / | sort -hr | head -n 30 - this gives the top 30 directories occupying the most space. Change 30 to whatever number you want - I usually try to make it a few lines less than the number of lines on my terminal.

Once you have an idea of which directories are large, you can research what they're used for and how to clean them up best. e.g. If /var/cache/apt is large, you probably should consider running apt clean; if /var/log is the largest, you should work out which applications are logging the most and look into tuning their log output to be less verbose.

Of course, sometimes it's all legitimate disk space usage, and the simplest and most expedient solution is just to add more disk.

share|improve this answer

answered May 16 at 21:55

Paul GearPaul Gear

3,0441134

add a comment | 

Sometimes looking for the largest directories can be a good option. Here's a method I use frequently: du -hx / | sort -hr | head -n 30 - this gives the top 30 directories occupying the most space. Change 30 to whatever number you want - I usually try to make it a few lines less than the number of lines on my terminal.

Once you have an idea of which directories are large, you can research what they're used for and how to clean them up best. e.g. If /var/cache/apt is large, you probably should consider running apt clean; if /var/log is the largest, you should work out which applications are logging the most and look into tuning their log output to be less verbose.

Of course, sometimes it's all legitimate disk space usage, and the simplest and most expedient solution is just to add more disk.

share|improve this answer

answered May 16 at 21:55

Paul GearPaul Gear

3,0441134

share|improve this answer

answered May 16 at 21:55

Paul GearPaul Gear

3,0441134

answered May 16 at 21:55

Paul GearPaul Gear

3,0441134

answered May 16 at 21:55

Paul GearPaul Gear

3,0441134