ECS Ec2 Instance hanging outgoing TCP connections The Next CEO of Stack OverflowEfficiency difference btw AWS EC2 Instance and ContainerCost diff between manual docker on ec2 and ECSIn terraform, howto attach a backing ec2 instance to an ecs serviceAWS Elastic Beanstalk CPU CappedAWS - shutdown EC2 of an ECS cluster after task is doneShutdown old EC2 instances only after creating new one in when changing ECS host ami in autoscaling groupHow to automate OS/ECS-agent updating on a EC2 instance in ECS Auto Scaling environment?AWS - ECS with ELB not working, instance IP works thoughecs instances generated via Auto Scaling group not registering to ecs clusterNeed help in finding reason behind EC2 instance not able to initiate any outgoing network activity

Read/write a pipe-delimited file line by line with some simple text manipulation

What does this strange code stamp on my passport mean?

Is it "common practice in Fourier transform spectroscopy to multiply the measured interferogram by an apodizing function"? If so, why?

Gödel's incompleteness theorems - what are the religious implications?

Small nick on power cord from an electric alarm clock, and copper wiring exposed but intact

Gauss' Posthumous Publications?

How do I secure a TV wall mount?

Arrows in tikz Markov chain diagram overlap

Can you teleport closer to a creature you are Frightened of?

What difference does it make matching a word with/without a trailing whitespace?

Is it possible to create a QR code using text?

Prodigo = pro + ago?

Car headlights in a world without electricity

Is it okay to majorly distort historical facts while writing a fiction story?

Traveling with my 5 year old daughter (as the father) without the mother from Germany to Mexico

Is a linearly independent set whose span is dense a Schauder basis?

Shortening a title without changing its meaning

How can I replace x-axis labels with pre-determined symbols?

MT "will strike" & LXX "will watch carefully" (Gen 3:15)?

Is this a new Fibonacci Identity?

Ising model simulation

What happens if you break a law in another country outside of that country?

Oldie but Goldie

Could you use a laser beam as a modulated carrier wave for radio signal?



ECS Ec2 Instance hanging outgoing TCP connections



The Next CEO of Stack OverflowEfficiency difference btw AWS EC2 Instance and ContainerCost diff between manual docker on ec2 and ECSIn terraform, howto attach a backing ec2 instance to an ecs serviceAWS Elastic Beanstalk CPU CappedAWS - shutdown EC2 of an ECS cluster after task is doneShutdown old EC2 instances only after creating new one in when changing ECS host ami in autoscaling groupHow to automate OS/ECS-agent updating on a EC2 instance in ECS Auto Scaling environment?AWS - ECS with ELB not working, instance IP works thoughecs instances generated via Auto Scaling group not registering to ecs clusterNeed help in finding reason behind EC2 instance not able to initiate any outgoing network activity










0















I'm having issue with EC2/ECS server in AWS.
In my company we're having dockerized application running on ECS cluster (it's nodes are running on Linux 2 ECS optimized cluster AMIs). ECS Cluster is located in Private VPC subnets with NAT Gateway so they can access Internet. In front of it we have Load balancers in Subnets with Internet gateway (so they can be accessed from outside). Security groups, Network ACLs are properly configured.
Further there are two docker apps. Let's call them application A and application B. Each of theme are behind Internet-Facing Application Load Balancer.

Then how it works: Application A receives requests from Internet, put request on application A and also connects to some other application. It's possible that container A and container B are running on the same ECS Cluster node.
At some point application A is not able to connect to the Internet, or works rarely.

First I've been thinking that it's a problem with application, however after logging in to the Linux I've noticed that even with stopped application A container and no other containers running (apart from ECS-agent container) - operating system is having problems establishing TCP connections, when I do curl www.google.com - first few requests are fine but one hangs, and it repeats. Ping is working.
Dockerized containers are configured to use docker bridged networking and register targets behind load balancers es EC2 instances pointing to ports on which application is listening.
Any ideas what could cause the issue?



What is worth to add is that EC2 instance reboot doesn't resolve the issue so probably it's not OS problem but hypervisor. I wanted to try to stop and start instance to it could strat on different host but it terminated immediately and new one was spwaned because it's in autoscaling group.










share|improve this question




























    0















    I'm having issue with EC2/ECS server in AWS.
    In my company we're having dockerized application running on ECS cluster (it's nodes are running on Linux 2 ECS optimized cluster AMIs). ECS Cluster is located in Private VPC subnets with NAT Gateway so they can access Internet. In front of it we have Load balancers in Subnets with Internet gateway (so they can be accessed from outside). Security groups, Network ACLs are properly configured.
    Further there are two docker apps. Let's call them application A and application B. Each of theme are behind Internet-Facing Application Load Balancer.

    Then how it works: Application A receives requests from Internet, put request on application A and also connects to some other application. It's possible that container A and container B are running on the same ECS Cluster node.
    At some point application A is not able to connect to the Internet, or works rarely.

    First I've been thinking that it's a problem with application, however after logging in to the Linux I've noticed that even with stopped application A container and no other containers running (apart from ECS-agent container) - operating system is having problems establishing TCP connections, when I do curl www.google.com - first few requests are fine but one hangs, and it repeats. Ping is working.
    Dockerized containers are configured to use docker bridged networking and register targets behind load balancers es EC2 instances pointing to ports on which application is listening.
    Any ideas what could cause the issue?



    What is worth to add is that EC2 instance reboot doesn't resolve the issue so probably it's not OS problem but hypervisor. I wanted to try to stop and start instance to it could strat on different host but it terminated immediately and new one was spwaned because it's in autoscaling group.










    share|improve this question


























      0












      0








      0








      I'm having issue with EC2/ECS server in AWS.
      In my company we're having dockerized application running on ECS cluster (it's nodes are running on Linux 2 ECS optimized cluster AMIs). ECS Cluster is located in Private VPC subnets with NAT Gateway so they can access Internet. In front of it we have Load balancers in Subnets with Internet gateway (so they can be accessed from outside). Security groups, Network ACLs are properly configured.
      Further there are two docker apps. Let's call them application A and application B. Each of theme are behind Internet-Facing Application Load Balancer.

      Then how it works: Application A receives requests from Internet, put request on application A and also connects to some other application. It's possible that container A and container B are running on the same ECS Cluster node.
      At some point application A is not able to connect to the Internet, or works rarely.

      First I've been thinking that it's a problem with application, however after logging in to the Linux I've noticed that even with stopped application A container and no other containers running (apart from ECS-agent container) - operating system is having problems establishing TCP connections, when I do curl www.google.com - first few requests are fine but one hangs, and it repeats. Ping is working.
      Dockerized containers are configured to use docker bridged networking and register targets behind load balancers es EC2 instances pointing to ports on which application is listening.
      Any ideas what could cause the issue?



      What is worth to add is that EC2 instance reboot doesn't resolve the issue so probably it's not OS problem but hypervisor. I wanted to try to stop and start instance to it could strat on different host but it terminated immediately and new one was spwaned because it's in autoscaling group.










      share|improve this question
















      I'm having issue with EC2/ECS server in AWS.
      In my company we're having dockerized application running on ECS cluster (it's nodes are running on Linux 2 ECS optimized cluster AMIs). ECS Cluster is located in Private VPC subnets with NAT Gateway so they can access Internet. In front of it we have Load balancers in Subnets with Internet gateway (so they can be accessed from outside). Security groups, Network ACLs are properly configured.
      Further there are two docker apps. Let's call them application A and application B. Each of theme are behind Internet-Facing Application Load Balancer.

      Then how it works: Application A receives requests from Internet, put request on application A and also connects to some other application. It's possible that container A and container B are running on the same ECS Cluster node.
      At some point application A is not able to connect to the Internet, or works rarely.

      First I've been thinking that it's a problem with application, however after logging in to the Linux I've noticed that even with stopped application A container and no other containers running (apart from ECS-agent container) - operating system is having problems establishing TCP connections, when I do curl www.google.com - first few requests are fine but one hangs, and it repeats. Ping is working.
      Dockerized containers are configured to use docker bridged networking and register targets behind load balancers es EC2 instances pointing to ports on which application is listening.
      Any ideas what could cause the issue?



      What is worth to add is that EC2 instance reboot doesn't resolve the issue so probably it's not OS problem but hypervisor. I wanted to try to stop and start instance to it could strat on different host but it terminated immediately and new one was spwaned because it's in autoscaling group.







      networking amazon-web-services amazon-ec2 tcp






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited yesterday







      valdek

















      asked yesterday









      valdekvaldek

      12




      12




















          0






          active

          oldest

          votes












          Your Answer








          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "2"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f960819%2fecs-ec2-instance-hanging-outgoing-tcp-connections%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Server Fault!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f960819%2fecs-ec2-instance-hanging-outgoing-tcp-connections%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          How to write a 12-bar blues melodyI-IV-V blues progressionHow to play the bridges in a standard blues progressionHow does Gdim7 fit in C# minor?question on a certain chord progressionMusicology of Melody12 bar blues, spread rhythm: alternative to 6th chord to avoid finger stretchChord progressions/ Root key/ MelodiesHow to put chords (POP-EDM) under a given lead vocal melody (starting from a good knowledge in music theory)Are there “rules” for improvising with the minor pentatonic scale over 12-bar shuffle?Confusion about blues scale and chords

          What if the end-user didn't have the required library?What is setup.py?What is a clean, pythonic way to have multiple constructors in Python?What does Ruby have that Python doesn't, and vice versa?What is the reason for having '//' in Python?How do I create a namespace package in Python?How to package shared objects that python modules depend on?setuptools vs. distutils: why is distutils still a thing?Navigation in Windows 10 vs code not going to virtualenv library when the same library is installed at user levelPython create package for local usePackaging a project that uses multiple python versionsWhy is permission denied on pip install except for when “--user” is included at end of command?

          Why did Thanos need his ship to help him in the battle scene?Which actor plays Thanos in the Avengers mid-credits scene?Are there economic implications portrayed in comics where the buildings and cities are ruined almost daily?Old X-Men comic where team travels to alien world with a ring-like sun that needs recharging?Why does Ego need help sleeping?Is there an objective answer to who “the strongest Avenger” is?How did Banner get unstuck?Why did Thanos get hit?How did Thanos (or anyone) know the Infinity Stones would give him this power?Did Thanos leave Eitri alive for his after-sales service?In Avengers 1, why does Thanos need Loki?