AWS and RAM ballooningdeleting linux cached ramec2 memory usageLinux server ran out of memory stopped everything except ssh and swap was unusedWindows Server 2008 R2 Metafile RAM UsagevSphere education - What are the downsides of configuring VMs with *too* much RAM?How to use small SSD drive on server?How to limit the RAM used by Apache Tomcat on AWS micro instance?Out of memory debugging Ubuntu / AWSqemu-kvm reclamation of memory from low-use guestsOut of memory at 18% usage : where the ram goes?
The unknown and unexplained in science fiction
Crime rates in a post-scarcity economy
Searching for a sentence that I only know part of it using Google's operators
How could a humanoid creature completely form within the span of 24 hours?
Does this website provide consistent translation into Wookiee?
why it is 2>&1 and not 2>>&1 to append to a log file
Is throwing dice a stochastic or a deterministic process?
What is the meaning of "matter" in physics?
What’s the interaction between darkvision and the Eagle Aspect of the beast, if you have Darkvision past 100 feet?
A problem with Hebrew and English underlined text
Did any early RISC OS precursor run on the BBC Micro?
A♭ major 9th chord in Bach is unexpectedly dissonant/jazzy
Saying the right thing then saying the wrong thing toch kedai dibur
In the figure, a quarter circle, a semicircle and a circle are mutually tangent inside a square of side length 2. Find the radius of the circle.
How do I give a darkroom course without negs from the attendees?
How does "politician" work as a job/career?
How do I minimise waste on a flight?
My C Drive is full without reason
Why were the rules for Proliferate changed?
Is there a reason why Turkey took the Balkan territories of the Ottoman Empire, instead of Greece or another of the Balkan states?
Why can’t you see at the start of the Big Bang?
Good introductory book to type theory?
How does jetBlue determine its boarding order?
How is it believable that Euron could so easily pull off this ambush?
AWS and RAM ballooning
deleting linux cached ramec2 memory usageLinux server ran out of memory stopped everything except ssh and swap was unusedWindows Server 2008 R2 Metafile RAM UsagevSphere education - What are the downsides of configuring VMs with *too* much RAM?How to use small SSD drive on server?How to limit the RAM used by Apache Tomcat on AWS micro instance?Out of memory debugging Ubuntu / AWSqemu-kvm reclamation of memory from low-use guestsOut of memory at 18% usage : where the ram goes?
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
Is it generally accepted that AWS does not oversell RAM or CPU although I have read that micro instances may be somewhat oversold at times. Nevertheless, RAM ballooning is a widely used feature of XEN and I noticed the kernel driver and ballooning daemon are running on EC2 machines so what prevents Amazon from ballooning RAM to optimize their resource usage?
I would like to investigate this further because I ran into a situation where an 8GB EC2 Unbuntu was unable to allocate RAM to restart Tomcat although there was almost 1.8 GB of free memory according to free and top and about 4GB in disk cache that was reclaimable. I added up the RSS of all the processes and I was missing about 4GB from the free value which more or less matched the disk cache size. Yet the system kept saying OOM for a Tomcat app that has limited heap from the command line.
So either AWS is effectively ballooning or it was unable to reclaim the disk cache for some reason (maybe not fast enough to avoid the OOM?) Maybe swap would help but there is some sort of religious war about swap in AWS and I am not the admin so I can't do a thing about that.
So again to the initial question: if XEN ballooning driver is loaded and the daemons running, what prevents Amazom from ballooning? IMO it would be stupid for Amazon NOT to balloon to cover for transient spikes in resource allocation. Besides, it's such a basic feature of XEN that I think that people who insist that Amazon doesn't use it, have never set up or ran their own XEN env.
amazon-ec2 amazon-web-services memory
asked Sep 25 '17 at 22:58
Alejandro ImassAlejandro Imass
262
add a comment |
Is it generally accepted that AWS does not oversell RAM or CPU although I have read that micro instances may be somewhat oversold at times. Nevertheless, RAM ballooning is a widely used feature of XEN and I noticed the kernel driver and ballooning daemon are running on EC2 machines so what prevents Amazon from ballooning RAM to optimize their resource usage?
I would like to investigate this further because I ran into a situation where an 8GB EC2 Unbuntu was unable to allocate RAM to restart Tomcat although there was almost 1.8 GB of free memory according to free and top and about 4GB in disk cache that was reclaimable. I added up the RSS of all the processes and I was missing about 4GB from the free value which more or less matched the disk cache size. Yet the system kept saying OOM for a Tomcat app that has limited heap from the command line.
So either AWS is effectively ballooning or it was unable to reclaim the disk cache for some reason (maybe not fast enough to avoid the OOM?) Maybe swap would help but there is some sort of religious war about swap in AWS and I am not the admin so I can't do a thing about that.
So again to the initial question: if XEN ballooning driver is loaded and the daemons running, what prevents Amazom from ballooning? IMO it would be stupid for Amazon NOT to balloon to cover for transient spikes in resource allocation. Besides, it's such a basic feature of XEN that I think that people who insist that Amazon doesn't use it, have never set up or ran their own XEN env.
amazon-ec2 amazon-web-services memory
asked Sep 25 '17 at 22:58
Alejandro ImassAlejandro Imass
262
add a comment |
Is it generally accepted that AWS does not oversell RAM or CPU although I have read that micro instances may be somewhat oversold at times. Nevertheless, RAM ballooning is a widely used feature of XEN and I noticed the kernel driver and ballooning daemon are running on EC2 machines so what prevents Amazon from ballooning RAM to optimize their resource usage?
I would like to investigate this further because I ran into a situation where an 8GB EC2 Unbuntu was unable to allocate RAM to restart Tomcat although there was almost 1.8 GB of free memory according to free and top and about 4GB in disk cache that was reclaimable. I added up the RSS of all the processes and I was missing about 4GB from the free value which more or less matched the disk cache size. Yet the system kept saying OOM for a Tomcat app that has limited heap from the command line.
So either AWS is effectively ballooning or it was unable to reclaim the disk cache for some reason (maybe not fast enough to avoid the OOM?) Maybe swap would help but there is some sort of religious war about swap in AWS and I am not the admin so I can't do a thing about that.
So again to the initial question: if XEN ballooning driver is loaded and the daemons running, what prevents Amazom from ballooning? IMO it would be stupid for Amazon NOT to balloon to cover for transient spikes in resource allocation. Besides, it's such a basic feature of XEN that I think that people who insist that Amazon doesn't use it, have never set up or ran their own XEN env.
amazon-ec2 amazon-web-services memory
asked Sep 25 '17 at 22:58
Alejandro ImassAlejandro Imass
262
Is it generally accepted that AWS does not oversell RAM or CPU although I have read that micro instances may be somewhat oversold at times. Nevertheless, RAM ballooning is a widely used feature of XEN and I noticed the kernel driver and ballooning daemon are running on EC2 machines so what prevents Amazon from ballooning RAM to optimize their resource usage?
I would like to investigate this further because I ran into a situation where an 8GB EC2 Unbuntu was unable to allocate RAM to restart Tomcat although there was almost 1.8 GB of free memory according to free and top and about 4GB in disk cache that was reclaimable. I added up the RSS of all the processes and I was missing about 4GB from the free value which more or less matched the disk cache size. Yet the system kept saying OOM for a Tomcat app that has limited heap from the command line.
So either AWS is effectively ballooning or it was unable to reclaim the disk cache for some reason (maybe not fast enough to avoid the OOM?) Maybe swap would help but there is some sort of religious war about swap in AWS and I am not the admin so I can't do a thing about that.
So again to the initial question: if XEN ballooning driver is loaded and the daemons running, what prevents Amazom from ballooning? IMO it would be stupid for Amazon NOT to balloon to cover for transient spikes in resource allocation. Besides, it's such a basic feature of XEN that I think that people who insist that Amazon doesn't use it, have never set up or ran their own XEN env.
amazon-ec2 amazon-web-services memory
amazon-ec2 amazon-web-services memory
asked Sep 25 '17 at 22:58
Alejandro ImassAlejandro Imass
262
asked Sep 25 '17 at 22:58
Alejandro ImassAlejandro Imass
262
asked Sep 25 '17 at 22:58
Alejandro ImassAlejandro Imass
262
asked Sep 25 '17 at 22:58
Alejandro ImassAlejandro Imass
262
asked Sep 25 '17 at 22:58
Alejandro ImassAlejandro Imass
262
262
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
There are no Amazon EC2 instance types which oversubscribe RAM. Only The T family of instance types oversubscribe CPU, per slide 14 of https://www.slideshare.net/AmazonWebServices/deep-dive-on-amazon-ec2
The Xen documentation for the memory overcommit at feature notes "Memory overcommit may have some performance impact and may be unusable in some environments". Amazon EC2 avoids those issues and associated customer impact by not implementing it. Another reason is for Instance Isolation as described on page 4 of the Overview of AWS Security - Compute Services Whitepaper where memory is scrubbed before giving it to a guest. Think of the performance impact of doing that in a balloning scenario.
answered Apr 28 at 18:48
David FiliatraultDavid Filiatrault
46637
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "2"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f875450%2faws-and-ram-ballooning%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
There are no Amazon EC2 instance types which oversubscribe RAM. Only The T family of instance types oversubscribe CPU, per slide 14 of https://www.slideshare.net/AmazonWebServices/deep-dive-on-amazon-ec2
The Xen documentation for the memory overcommit at feature notes "Memory overcommit may have some performance impact and may be unusable in some environments". Amazon EC2 avoids those issues and associated customer impact by not implementing it. Another reason is for Instance Isolation as described on page 4 of the Overview of AWS Security - Compute Services Whitepaper where memory is scrubbed before giving it to a guest. Think of the performance impact of doing that in a balloning scenario.
answered Apr 28 at 18:48
David FiliatraultDavid Filiatrault
46637
add a comment |
There are no Amazon EC2 instance types which oversubscribe RAM. Only The T family of instance types oversubscribe CPU, per slide 14 of https://www.slideshare.net/AmazonWebServices/deep-dive-on-amazon-ec2
The Xen documentation for the memory overcommit at feature notes "Memory overcommit may have some performance impact and may be unusable in some environments". Amazon EC2 avoids those issues and associated customer impact by not implementing it. Another reason is for Instance Isolation as described on page 4 of the Overview of AWS Security - Compute Services Whitepaper where memory is scrubbed before giving it to a guest. Think of the performance impact of doing that in a balloning scenario.
answered Apr 28 at 18:48
David FiliatraultDavid Filiatrault
46637
add a comment |
There are no Amazon EC2 instance types which oversubscribe RAM. Only The T family of instance types oversubscribe CPU, per slide 14 of https://www.slideshare.net/AmazonWebServices/deep-dive-on-amazon-ec2
The Xen documentation for the memory overcommit at feature notes "Memory overcommit may have some performance impact and may be unusable in some environments". Amazon EC2 avoids those issues and associated customer impact by not implementing it. Another reason is for Instance Isolation as described on page 4 of the Overview of AWS Security - Compute Services Whitepaper where memory is scrubbed before giving it to a guest. Think of the performance impact of doing that in a balloning scenario.
answered Apr 28 at 18:48
David FiliatraultDavid Filiatrault
46637
There are no Amazon EC2 instance types which oversubscribe RAM. Only The T family of instance types oversubscribe CPU, per slide 14 of https://www.slideshare.net/AmazonWebServices/deep-dive-on-amazon-ec2
The Xen documentation for the memory overcommit at feature notes "Memory overcommit may have some performance impact and may be unusable in some environments". Amazon EC2 avoids those issues and associated customer impact by not implementing it. Another reason is for Instance Isolation as described on page 4 of the Overview of AWS Security - Compute Services Whitepaper where memory is scrubbed before giving it to a guest. Think of the performance impact of doing that in a balloning scenario.
answered Apr 28 at 18:48
David FiliatraultDavid Filiatrault
46637
answered Apr 28 at 18:48
David FiliatraultDavid Filiatrault
46637
answered Apr 28 at 18:48
David FiliatraultDavid Filiatrault
46637
answered Apr 28 at 18:48
David FiliatraultDavid Filiatrault
46637
46637
add a comment |
add a comment |
Thanks for contributing an answer to Server Fault!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f875450%2faws-and-ram-ballooning%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
