K 10
svn:author
V 2
np
K 8
svn:date
V 27
2013-08-16T21:04:58.714108Z
K 7
svn:log
V 2852
Enable buffer packing by default for T5 cards.  At this point I
consistently get full 40G line rate for a single TCP connection (both
1500 MTU and 9000 MTU, both single direction and bidirectional 40G tx +
40G rx simultaneously) out of the box.

For example, this is on a recent HEAD with changes from this branch.
No tuning.  sysctl.conf is empty and loader.conf has just one line
setting a high hw.intr_storm_threshold.  No special buffer sizes or r/w
sizes are given to the benchmark programs either.

# sysctl hw.model
hw.model: Intel(R) Xeon(R) CPU E5-1620 0 @ 3.60GHz
# iperf -v
iperf version 2.0.5 (08 Jul 2010) pthreads

/* MTU 1500. */
# iperf -c ha1 -t60
------------------------------------------------------------
Client connecting to ha1, TCP port 5001
TCP window size: 32.5 KByte (default)
------------------------------------------------------------
[  3] local 10.3.166.121 port 32906 connected with 10.3.166.122 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   263 GBytes  37.6 Gbits/sec

# iperf -c ha1 -t60 -d
------------------------------------------------------------
Server listening on TCP port 5001
TCP window size: 64.0 KByte (default)
------------------------------------------------------------
------------------------------------------------------------
Client connecting to ha1, TCP port 5001
TCP window size:  265 KByte (default)
------------------------------------------------------------
[  5] local 10.3.166.121 port 54353 connected with 10.3.166.122 port 5001
[  4] local 10.3.166.121 port 5001 connected with 10.3.166.122 port 33091
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0-60.0 sec   262 GBytes  37.5 Gbits/sec
[  5]  0.0-60.0 sec   263 GBytes  37.6 Gbits/sec

/* MTU 9000. */
# iperf -c ha0 -t60
------------------------------------------------------------
Client connecting to ha0, TCP port 5001
TCP window size: 35.0 KByte (default)
------------------------------------------------------------
[  3] local 10.2.166.121 port 44734 connected with 10.2.166.122 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-60.0 sec   276 GBytes  39.6 Gbits/sec

# iperf -c ha0 -t60 -d
------------------------------------------------------------
Server listening on TCP port 5001
TCP window size: 64.0 KByte (default)
------------------------------------------------------------
------------------------------------------------------------
Client connecting to ha0, TCP port 5001
TCP window size:  291 KByte (default)
------------------------------------------------------------
[  5] local 10.2.166.121 port 53293 connected with 10.2.166.122 port 5001
[  4] local 10.2.166.121 port 5001 connected with 10.2.166.122 port 14311
[ ID] Interval       Transfer     Bandwidth
[  5]  0.0-60.0 sec   276 GBytes  39.5 Gbits/sec
[  4]  0.0-60.0 sec   276 GBytes  39.5 Gbits/sec

END