Otdfbt

Multi tool use

If a character drops a magic item that turns on/off, does that item turn off when they drop it?

Is it a good idea to copy a trader when investing?

How to handle DM constantly stealing everything from sleeping characters?

Intersecting with the x-axis / intersecting the x-axis

Why do protein solutions have to be alkalised in biuret test?

How did Thanos not realise this had happened at the end of Endgame?

Why does the Earth follow an elliptical trajectory rather than a parabolic one?

Extending Kan fibrations, without using minimal fibrations

Can the president of the United States be guilty of insider trading?

Detect the first rising edge of 3 input signals

Passport stamps art, can it be done?

Company stopped paying my salary. What are my options?

Cropping a message using array splits

What was the notion of limit that Newton used?

Can 'sudo apt-get remove [write]' destroy my Ubuntu?

What is the name of meteoroids which hit Moon, Mars, or pretty much anything that isn’t the Earth?

Why is PerfectForwardSecrecy considered OK, when it has same defects as salt-less password hashing?

Why do unstable nuclei form?

Is it nonsense to say B -> [A -> B]?

How can I avoid subordinates and coworkers leaving work until the last minute, then having no time for revisions?

How to efficiently lower your karma

Why does a variable size struct not compile in the Arduino IDE?

We are two immediate neighbors who forged our own powers to form concatenated relationship. Who are we?

How is CoreiX like Corei5, i7 is related to Haswell, Ivy Bridge?

How to configure the sending and receiving speed of a bonded NIC on Linux?

How to configure linux routing to send packets out through the same interface they were received on?How to configure VXLAN over linux bridge?How to configure network interfaces for three NIC cards all on three different subnetsIs it possible to process millions of datagrams per second with Windows, using a vendor agnostic API?Linux: What is the right way to configure the HOSTNAME directive in /etc/sysconfig/network?Using dhcp and static ip on same nic on linux with systemd-networkdHow does AWS configure the 169.254.169.254 address on an instance?How to configure Linux to close the connection if Send-Q is never sent?How do I verify the speed of `eth0` when running under Xen 4.4 Hypervisor?How to configure HAproxy with SSTP and HTTPS

.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;

0

1

We have a RedHat 7.4 Linux server with 2 10Gbps bonded, but for some reason, it doesn't send files at speeds faster than 1Gbps to another server with a 10Gbps NIC, receiving works just fine, but not sending.

Can anybody tell me where I can check what's causing this problem and how to fix it?

As a reference we ran iPerf on both ends and receiving reaches up to 9.53Gbps, but sending never gets higher than 955Mbps.

Thanks.

linux-networking

share|improve this question

asked Apr 30 at 22:14

Jorge HernandezJorge Hernandez

11

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  What software do you use to send/receive files? What mode of iperf (tcp/udp) have you used?
  
  – Anton Danilov
  May 2 at 18:01
  
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  I think we are getting closer to an answer, it turns out the bond is set to mode=0, this mode is not supported by the switch(es) for transmission, but the switches allow for receiving, so we are going to set this mode to5 or 6 to favor transmission (5) or to balance all communication to see if it fixes it, I'll post the results of this change when it's done.
  
  – Jorge Hernandez
  May 3 at 19:06
  

  
  
  
  

add a comment | 

0

1

We have a RedHat 7.4 Linux server with 2 10Gbps bonded, but for some reason, it doesn't send files at speeds faster than 1Gbps to another server with a 10Gbps NIC, receiving works just fine, but not sending.

Can anybody tell me where I can check what's causing this problem and how to fix it?

As a reference we ran iPerf on both ends and receiving reaches up to 9.53Gbps, but sending never gets higher than 955Mbps.

Thanks.

linux-networking

share|improve this question

asked Apr 30 at 22:14

Jorge HernandezJorge Hernandez

11

• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  What software do you use to send/receive files? What mode of iperf (tcp/udp) have you used?
  
  – Anton Danilov
  May 2 at 18:01
  
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  I think we are getting closer to an answer, it turns out the bond is set to mode=0, this mode is not supported by the switch(es) for transmission, but the switches allow for receiving, so we are going to set this mode to5 or 6 to favor transmission (5) or to balance all communication to see if it fixes it, I'll post the results of this change when it's done.
  
  – Jorge Hernandez
  May 3 at 19:06
  

  
  
  
  

add a comment | 

We have a RedHat 7.4 Linux server with 2 10Gbps bonded, but for some reason, it doesn't send files at speeds faster than 1Gbps to another server with a 10Gbps NIC, receiving works just fine, but not sending.

Can anybody tell me where I can check what's causing this problem and how to fix it?

As a reference we ran iPerf on both ends and receiving reaches up to 9.53Gbps, but sending never gets higher than 955Mbps.

Thanks.

linux-networking

share|improve this question

asked Apr 30 at 22:14

Jorge HernandezJorge Hernandez

11

share|improve this question

asked Apr 30 at 22:14

Jorge HernandezJorge Hernandez

11

share|improve this question

asked Apr 30 at 22:14

Jorge HernandezJorge Hernandez

11

asked Apr 30 at 22:14

Jorge HernandezJorge Hernandez

11

asked Apr 30 at 22:14

Jorge HernandezJorge Hernandez

11

1 Answer
1

active

oldest

votes

0

There are various reasons of your issue. General ways to troubleshoot it:

1. So iperf gives the normal numbers, guess the issue isn't in network itself, but somewhere else. But check the counters of both bond member interfaces with ethtool -S and ip -s -s link show commands. Maybe iperf traffic passes trought normal leg, but file exchange traffic passes through ill leg of bond. Check the size of rings of NICs. Check the statistics of the pause frames - play with flowcontrol.


2. First check point - the storage subsystem. Slow disks can be bottleneck. Use tools like blktrace, iotop, iostat.


3. Capture the traffic with tcpdump/wireshark and analyse it. Wireshark has great built-in tools for it. Check the graph of window size - it shows existence of network issues like loss or congestions.


4. Next check point - the size of read/write socket buffers. Increase it by your app config or change the default values with sysctl (variables *_rmem and *_wmem). Check the statistic counters with netstat or nstat.


5. Look at the cpu load. Maybe one cpu core is overloaded, but other are idle.


6. Check the GRO/LRO and other offloadings. Play with it.


7. Check the congestion control algorithms.

share|improve this answer

answered May 2 at 18:34

Anton DanilovAnton Danilov

80645

add a comment | 

Your Answer

StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "2"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);

else
createEditor();

);

function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);



);

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);

Sign up using Google

Sign up using Facebook

Sign up using Email and Password

Post as a guest

Name

Email

Required, but never shown

StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f965340%2fhow-to-configure-the-sending-and-receiving-speed-of-a-bonded-nic-on-linux%23new-answer', 'question_page');

);

Post as a guest

Name

Email

Required, but never shown

0

There are various reasons of your issue. General ways to troubleshoot it:

1. So iperf gives the normal numbers, guess the issue isn't in network itself, but somewhere else. But check the counters of both bond member interfaces with ethtool -S and ip -s -s link show commands. Maybe iperf traffic passes trought normal leg, but file exchange traffic passes through ill leg of bond. Check the size of rings of NICs. Check the statistics of the pause frames - play with flowcontrol.


2. First check point - the storage subsystem. Slow disks can be bottleneck. Use tools like blktrace, iotop, iostat.


3. Capture the traffic with tcpdump/wireshark and analyse it. Wireshark has great built-in tools for it. Check the graph of window size - it shows existence of network issues like loss or congestions.


4. Next check point - the size of read/write socket buffers. Increase it by your app config or change the default values with sysctl (variables *_rmem and *_wmem). Check the statistic counters with netstat or nstat.


5. Look at the cpu load. Maybe one cpu core is overloaded, but other are idle.


6. Check the GRO/LRO and other offloadings. Play with it.


7. Check the congestion control algorithms.

share|improve this answer

answered May 2 at 18:34

Anton DanilovAnton Danilov

80645

add a comment | 

0

There are various reasons of your issue. General ways to troubleshoot it:

1. So iperf gives the normal numbers, guess the issue isn't in network itself, but somewhere else. But check the counters of both bond member interfaces with ethtool -S and ip -s -s link show commands. Maybe iperf traffic passes trought normal leg, but file exchange traffic passes through ill leg of bond. Check the size of rings of NICs. Check the statistics of the pause frames - play with flowcontrol.


2. First check point - the storage subsystem. Slow disks can be bottleneck. Use tools like blktrace, iotop, iostat.


3. Capture the traffic with tcpdump/wireshark and analyse it. Wireshark has great built-in tools for it. Check the graph of window size - it shows existence of network issues like loss or congestions.


4. Next check point - the size of read/write socket buffers. Increase it by your app config or change the default values with sysctl (variables *_rmem and *_wmem). Check the statistic counters with netstat or nstat.


5. Look at the cpu load. Maybe one cpu core is overloaded, but other are idle.


6. Check the GRO/LRO and other offloadings. Play with it.


7. Check the congestion control algorithms.

share|improve this answer

answered May 2 at 18:34

Anton DanilovAnton Danilov

80645

add a comment | 

There are various reasons of your issue. General ways to troubleshoot it:

1. So iperf gives the normal numbers, guess the issue isn't in network itself, but somewhere else. But check the counters of both bond member interfaces with ethtool -S and ip -s -s link show commands. Maybe iperf traffic passes trought normal leg, but file exchange traffic passes through ill leg of bond. Check the size of rings of NICs. Check the statistics of the pause frames - play with flowcontrol.


2. First check point - the storage subsystem. Slow disks can be bottleneck. Use tools like blktrace, iotop, iostat.


3. Capture the traffic with tcpdump/wireshark and analyse it. Wireshark has great built-in tools for it. Check the graph of window size - it shows existence of network issues like loss or congestions.


4. Next check point - the size of read/write socket buffers. Increase it by your app config or change the default values with sysctl (variables *_rmem and *_wmem). Check the statistic counters with netstat or nstat.


5. Look at the cpu load. Maybe one cpu core is overloaded, but other are idle.


6. Check the GRO/LRO and other offloadings. Play with it.


7. Check the congestion control algorithms.

share|improve this answer

answered May 2 at 18:34

Anton DanilovAnton Danilov

80645

share|improve this answer

answered May 2 at 18:34

Anton DanilovAnton Danilov

80645

answered May 2 at 18:34

Anton DanilovAnton Danilov

80645

answered May 2 at 18:34

Anton DanilovAnton Danilov

80645