how to reach 1M concurrent TCP connections? Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 23, 2019 at 00:00UTC (8:00pm US/Eastern) Come Celebrate our 10 Year Anniversary!How can I sort du -h output by sizeMore than 65536 TCP connections on LinuxToo many TCP connections causes disconnectionsdump tcp connections without tcpdumpHow to trace dropped TCP connections?How many concurrent TCP connections are supported in Windows Server OSs?Concurrent TCP connections on Azure can be upto 500K. Really?Bad throughput for single tcp connectionsHow does load balancer manage TCP connectionsCan a TCP packet don't reach the 7th OSI layer
Performance gap between vector<bool> and array
A term for a woman complaining about things/begging in a cute/childish way
Morning, Afternoon, Night Kanji
How does the math work when buying airline miles?
What is the appropriate index architecture when forced to implement IsDeleted (soft deletes)?
How to tell that you are a giant?
How can I reduce the gap between left and right of cdot with a macro?
Do I really need to have a message in a novel to appeal to readers?
How to compare two different files line by line in unix?
Do any jurisdictions seriously consider reclassifying social media websites as publishers?
Should I follow up with an employee I believe overracted to a mistake I made?
SF book about people trapped in a series of worlds they imagine
Generate an RGB colour grid
How come Sam didn't become Lord of Horn Hill?
Why is Nikon 1.4g better when Nikon 1.8g is sharper?
Project Euler #1 in C++
An adverb for when you're not exaggerating
How fail-safe is nr as stop bytes?
Dating a Former Employee
How were pictures turned from film to a big picture in a picture frame before digital scanning?
What is this clumpy 20-30cm high yellow-flowered plant?
Central Vacuuming: Is it worth it, and how does it compare to normal vacuuming?
Effects on objects due to a brief relocation of massive amounts of mass
What's the meaning of "fortified infraction restraint"?
how to reach 1M concurrent TCP connections?
Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 23, 2019 at 00:00UTC (8:00pm US/Eastern)
Come Celebrate our 10 Year Anniversary!How can I sort du -h output by sizeMore than 65536 TCP connections on LinuxToo many TCP connections causes disconnectionsdump tcp connections without tcpdumpHow to trace dropped TCP connections?How many concurrent TCP connections are supported in Windows Server OSs?Concurrent TCP connections on Azure can be upto 500K. Really?Bad throughput for single tcp connectionsHow does load balancer manage TCP connectionsCan a TCP packet don't reach the 7th OSI layer
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
I am trying to setup a environment with multiple nodes (1 receiver + 16 senders) to establish 1,000,000 (1M) concurrent TCP connections.
Using this tool: https://github.com/Microsoft/ntttcp-for-linux
Using Ubuntu 1804 with latest kernel
Currently, I am easily reached 262,156 concurrent TCP connections with 3+ senders. but after this, seems that the receiver is not able to accept any new TCP connections.
Is there any configuration on Linux I can tune to make 1M TCP connections?
What I have done:
- Receiver side:
ulimit -n 1024000
./ntttcp -P 64 -M -e ### '-e' to use epoll()
I run this command on receiver side to monitor the number of TCP connections:
ss -ta | grep ESTA | wc -l
- Sender sides
ulimit -n 1024000
echo 1024 65535 > /proc/sys/net/ipv4/ip_local_port_range
./ntttcp -s10.0.0.4 -P 64 -n 10 -l 100 ### 64,000 concurrent TCP connections from one sender
linux networking tcp performance-tuning
asked Apr 12 at 23:41
Howard ShaneHoward Shane
1061
add a comment |
I am trying to setup a environment with multiple nodes (1 receiver + 16 senders) to establish 1,000,000 (1M) concurrent TCP connections.
Using this tool: https://github.com/Microsoft/ntttcp-for-linux
Using Ubuntu 1804 with latest kernel
Currently, I am easily reached 262,156 concurrent TCP connections with 3+ senders. but after this, seems that the receiver is not able to accept any new TCP connections.
Is there any configuration on Linux I can tune to make 1M TCP connections?
What I have done:
- Receiver side:
ulimit -n 1024000
./ntttcp -P 64 -M -e ### '-e' to use epoll()
I run this command on receiver side to monitor the number of TCP connections:
ss -ta | grep ESTA | wc -l
- Sender sides
ulimit -n 1024000
echo 1024 65535 > /proc/sys/net/ipv4/ip_local_port_range
./ntttcp -s10.0.0.4 -P 64 -n 10 -l 100 ### 64,000 concurrent TCP connections from one sender
linux networking tcp performance-tuning
asked Apr 12 at 23:41
Howard ShaneHoward Shane
1061
You should check the explanations there on how they reached 12M connections on CentOS 6 (and a few "more" recent kernels too): Scaling to 12 Million Concurrent Connections: How MigratoryData Did It
– A.B
Apr 13 at 19:52
add a comment |
I am trying to setup a environment with multiple nodes (1 receiver + 16 senders) to establish 1,000,000 (1M) concurrent TCP connections.
Using this tool: https://github.com/Microsoft/ntttcp-for-linux
Using Ubuntu 1804 with latest kernel
Currently, I am easily reached 262,156 concurrent TCP connections with 3+ senders. but after this, seems that the receiver is not able to accept any new TCP connections.
Is there any configuration on Linux I can tune to make 1M TCP connections?
What I have done:
- Receiver side:
ulimit -n 1024000
./ntttcp -P 64 -M -e ### '-e' to use epoll()
I run this command on receiver side to monitor the number of TCP connections:
ss -ta | grep ESTA | wc -l
- Sender sides
ulimit -n 1024000
echo 1024 65535 > /proc/sys/net/ipv4/ip_local_port_range
./ntttcp -s10.0.0.4 -P 64 -n 10 -l 100 ### 64,000 concurrent TCP connections from one sender
linux networking tcp performance-tuning
asked Apr 12 at 23:41
Howard ShaneHoward Shane
1061
I am trying to setup a environment with multiple nodes (1 receiver + 16 senders) to establish 1,000,000 (1M) concurrent TCP connections.
Using this tool: https://github.com/Microsoft/ntttcp-for-linux
Using Ubuntu 1804 with latest kernel
Currently, I am easily reached 262,156 concurrent TCP connections with 3+ senders. but after this, seems that the receiver is not able to accept any new TCP connections.
Is there any configuration on Linux I can tune to make 1M TCP connections?
What I have done:
- Receiver side:
ulimit -n 1024000
./ntttcp -P 64 -M -e ### '-e' to use epoll()
I run this command on receiver side to monitor the number of TCP connections:
ss -ta | grep ESTA | wc -l
- Sender sides
ulimit -n 1024000
echo 1024 65535 > /proc/sys/net/ipv4/ip_local_port_range
./ntttcp -s10.0.0.4 -P 64 -n 10 -l 100 ### 64,000 concurrent TCP connections from one sender
linux networking tcp performance-tuning
linux networking tcp performance-tuning
asked Apr 12 at 23:41
Howard ShaneHoward Shane
1061
asked Apr 12 at 23:41
Howard ShaneHoward Shane
1061
asked Apr 12 at 23:41
Howard ShaneHoward Shane
1061
asked Apr 12 at 23:41
Howard ShaneHoward Shane
1061
asked Apr 12 at 23:41
Howard ShaneHoward Shane
1061
1061
You should check the explanations there on how they reached 12M connections on CentOS 6 (and a few "more" recent kernels too): Scaling to 12 Million Concurrent Connections: How MigratoryData Did It
– A.B
Apr 13 at 19:52
add a comment |
You should check the explanations there on how they reached 12M connections on CentOS 6 (and a few "more" recent kernels too): Scaling to 12 Million Concurrent Connections: How MigratoryData Did It
– A.B
Apr 13 at 19:52
You should check the explanations there on how they reached 12M connections on CentOS 6 (and a few "more" recent kernels too): Scaling to 12 Million Concurrent Connections: How MigratoryData Did It
– A.B
Apr 13 at 19:52
You should check the explanations there on how they reached 12M connections on CentOS 6 (and a few "more" recent kernels too): Scaling to 12 Million Concurrent Connections: How MigratoryData Did It
– A.B
Apr 13 at 19:52
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "2"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f962874%2fhow-to-reach-1m-concurrent-tcp-connections%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Server Fault!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f962874%2fhow-to-reach-1m-concurrent-tcp-connections%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
You should check the explanations there on how they reached 12M connections on CentOS 6 (and a few "more" recent kernels too): Scaling to 12 Million Concurrent Connections: How MigratoryData Did It
– A.B
Apr 13 at 19:52