ECS Ec2 Instance hanging outgoing TCP connections The Next CEO of Stack OverflowEfficiency difference btw AWS EC2 Instance and ContainerCost diff between manual docker on ec2 and ECSIn terraform, howto attach a backing ec2 instance to an ecs serviceAWS Elastic Beanstalk CPU CappedAWS - shutdown EC2 of an ECS cluster after task is doneShutdown old EC2 instances only after creating new one in when changing ECS host ami in autoscaling groupHow to automate OS/ECS-agent updating on a EC2 instance in ECS Auto Scaling environment?AWS - ECS with ELB not working, instance IP works thoughecs instances generated via Auto Scaling group not registering to ecs clusterNeed help in finding reason behind EC2 instance not able to initiate any outgoing network activity

Read/write a pipe-delimited file line by line with some simple text manipulation

What does this strange code stamp on my passport mean?

Is it "common practice in Fourier transform spectroscopy to multiply the measured interferogram by an apodizing function"? If so, why?

Gödel's incompleteness theorems - what are the religious implications?

Small nick on power cord from an electric alarm clock, and copper wiring exposed but intact

Gauss' Posthumous Publications?

How do I secure a TV wall mount?

Arrows in tikz Markov chain diagram overlap

Can you teleport closer to a creature you are Frightened of?

What difference does it make matching a word with/without a trailing whitespace?

Is it possible to create a QR code using text?

Prodigo = pro + ago?

Car headlights in a world without electricity

Is it okay to majorly distort historical facts while writing a fiction story?

Traveling with my 5 year old daughter (as the father) without the mother from Germany to Mexico

Is a linearly independent set whose span is dense a Schauder basis?

Shortening a title without changing its meaning

How can I replace x-axis labels with pre-determined symbols?

MT "will strike" & LXX "will watch carefully" (Gen 3:15)?

Is this a new Fibonacci Identity?

Ising model simulation

What happens if you break a law in another country outside of that country?

Oldie but Goldie

Could you use a laser beam as a modulated carrier wave for radio signal?



ECS Ec2 Instance hanging outgoing TCP connections



The Next CEO of Stack OverflowEfficiency difference btw AWS EC2 Instance and ContainerCost diff between manual docker on ec2 and ECSIn terraform, howto attach a backing ec2 instance to an ecs serviceAWS Elastic Beanstalk CPU CappedAWS - shutdown EC2 of an ECS cluster after task is doneShutdown old EC2 instances only after creating new one in when changing ECS host ami in autoscaling groupHow to automate OS/ECS-agent updating on a EC2 instance in ECS Auto Scaling environment?AWS - ECS with ELB not working, instance IP works thoughecs instances generated via Auto Scaling group not registering to ecs clusterNeed help in finding reason behind EC2 instance not able to initiate any outgoing network activity










0















I'm having issue with EC2/ECS server in AWS.
In my company we're having dockerized application running on ECS cluster (it's nodes are running on Linux 2 ECS optimized cluster AMIs). ECS Cluster is located in Private VPC subnets with NAT Gateway so they can access Internet. In front of it we have Load balancers in Subnets with Internet gateway (so they can be accessed from outside). Security groups, Network ACLs are properly configured.
Further there are two docker apps. Let's call them application A and application B. Each of theme are behind Internet-Facing Application Load Balancer.

Then how it works: Application A receives requests from Internet, put request on application A and also connects to some other application. It's possible that container A and container B are running on the same ECS Cluster node.
At some point application A is not able to connect to the Internet, or works rarely.

First I've been thinking that it's a problem with application, however after logging in to the Linux I've noticed that even with stopped application A container and no other containers running (apart from ECS-agent container) - operating system is having problems establishing TCP connections, when I do curl www.google.com - first few requests are fine but one hangs, and it repeats. Ping is working.
Dockerized containers are configured to use docker bridged networking and register targets behind load balancers es EC2 instances pointing to ports on which application is listening.
Any ideas what could cause the issue?



What is worth to add is that EC2 instance reboot doesn't resolve the issue so probably it's not OS problem but hypervisor. I wanted to try to stop and start instance to it could strat on different host but it terminated immediately and new one was spwaned because it's in autoscaling group.










share|improve this question




























    0















    I'm having issue with EC2/ECS server in AWS.
    In my company we're having dockerized application running on ECS cluster (it's nodes are running on Linux 2 ECS optimized cluster AMIs). ECS Cluster is located in Private VPC subnets with NAT Gateway so they can access Internet. In front of it we have Load balancers in Subnets with Internet gateway (so they can be accessed from outside). Security groups, Network ACLs are properly configured.
    Further there are two docker apps. Let's call them application A and application B. Each of theme are behind Internet-Facing Application Load Balancer.

    Then how it works: Application A receives requests from Internet, put request on application A and also connects to some other application. It's possible that container A and container B are running on the same ECS Cluster node.
    At some point application A is not able to connect to the Internet, or works rarely.

    First I've been thinking that it's a problem with application, however after logging in to the Linux I've noticed that even with stopped application A container and no other containers running (apart from ECS-agent container) - operating system is having problems establishing TCP connections, when I do curl www.google.com - first few requests are fine but one hangs, and it repeats. Ping is working.
    Dockerized containers are configured to use docker bridged networking and register targets behind load balancers es EC2 instances pointing to ports on which application is listening.
    Any ideas what could cause the issue?



    What is worth to add is that EC2 instance reboot doesn't resolve the issue so probably it's not OS problem but hypervisor. I wanted to try to stop and start instance to it could strat on different host but it terminated immediately and new one was spwaned because it's in autoscaling group.










    share|improve this question


























      0












      0








      0








      I'm having issue with EC2/ECS server in AWS.
      In my company we're having dockerized application running on ECS cluster (it's nodes are running on Linux 2 ECS optimized cluster AMIs). ECS Cluster is located in Private VPC subnets with NAT Gateway so they can access Internet. In front of it we have Load balancers in Subnets with Internet gateway (so they can be accessed from outside). Security groups, Network ACLs are properly configured.
      Further there are two docker apps. Let's call them application A and application B. Each of theme are behind Internet-Facing Application Load Balancer.

      Then how it works: Application A receives requests from Internet, put request on application A and also connects to some other application. It's possible that container A and container B are running on the same ECS Cluster node.
      At some point application A is not able to connect to the Internet, or works rarely.

      First I've been thinking that it's a problem with application, however after logging in to the Linux I've noticed that even with stopped application A container and no other containers running (apart from ECS-agent container) - operating system is having problems establishing TCP connections, when I do curl www.google.com - first few requests are fine but one hangs, and it repeats. Ping is working.
      Dockerized containers are configured to use docker bridged networking and register targets behind load balancers es EC2 instances pointing to ports on which application is listening.
      Any ideas what could cause the issue?



      What is worth to add is that EC2 instance reboot doesn't resolve the issue so probably it's not OS problem but hypervisor. I wanted to try to stop and start instance to it could strat on different host but it terminated immediately and new one was spwaned because it's in autoscaling group.










      share|improve this question
















      I'm having issue with EC2/ECS server in AWS.
      In my company we're having dockerized application running on ECS cluster (it's nodes are running on Linux 2 ECS optimized cluster AMIs). ECS Cluster is located in Private VPC subnets with NAT Gateway so they can access Internet. In front of it we have Load balancers in Subnets with Internet gateway (so they can be accessed from outside). Security groups, Network ACLs are properly configured.
      Further there are two docker apps. Let's call them application A and application B. Each of theme are behind Internet-Facing Application Load Balancer.

      Then how it works: Application A receives requests from Internet, put request on application A and also connects to some other application. It's possible that container A and container B are running on the same ECS Cluster node.
      At some point application A is not able to connect to the Internet, or works rarely.

      First I've been thinking that it's a problem with application, however after logging in to the Linux I've noticed that even with stopped application A container and no other containers running (apart from ECS-agent container) - operating system is having problems establishing TCP connections, when I do curl www.google.com - first few requests are fine but one hangs, and it repeats. Ping is working.
      Dockerized containers are configured to use docker bridged networking and register targets behind load balancers es EC2 instances pointing to ports on which application is listening.
      Any ideas what could cause the issue?



      What is worth to add is that EC2 instance reboot doesn't resolve the issue so probably it's not OS problem but hypervisor. I wanted to try to stop and start instance to it could strat on different host but it terminated immediately and new one was spwaned because it's in autoscaling group.







      networking amazon-web-services amazon-ec2 tcp






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited yesterday







      valdek

















      asked yesterday









      valdekvaldek

      12




      12




















          0






          active

          oldest

          votes












          Your Answer








          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "2"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f960819%2fecs-ec2-instance-hanging-outgoing-tcp-connections%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Server Fault!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f960819%2fecs-ec2-instance-hanging-outgoing-tcp-connections%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Wikipedia:Vital articles Мазмуну Biography - Өмүр баян Philosophy and psychology - Философия жана психология Religion - Дин Social sciences - Коомдук илимдер Language and literature - Тил жана адабият Science - Илим Technology - Технология Arts and recreation - Искусство жана эс алуу History and geography - Тарых жана география Навигация менюсу

          Bruxelas-Capital Índice Historia | Composición | Situación lingüística | Clima | Cidades irmandadas | Notas | Véxase tamén | Menú de navegacióneO uso das linguas en Bruxelas e a situación do neerlandés"Rexión de Bruxelas Capital"o orixinalSitio da rexiónPáxina de Bruselas no sitio da Oficina de Promoción Turística de Valonia e BruxelasMapa Interactivo da Rexión de Bruxelas-CapitaleeWorldCat332144929079854441105155190212ID28008674080552-90000 0001 0666 3698n94104302ID540940339365017018237

          What should I write in an apology letter, since I have decided not to join a company after accepting an offer letterShould I keep looking after accepting a job offer?What should I do when I've been verbally told I would get an offer letter, but still haven't gotten one after 4 weeks?Do I accept an offer from a company that I am not likely to join?New job hasn't confirmed starting date and I want to give current employer as much notice as possibleHow should I address my manager in my resignation letter?HR delayed background verification, now jobless as resignedNo email communication after accepting a formal written offer. How should I phrase the call?What should I do if after receiving a verbal offer letter I am informed that my written job offer is put on hold due to some internal issues?Should I inform the current employer that I am about to resign within 1-2 weeks since I have signed the offer letter and waiting for visa?What company will do, if I send their offer letter to another company