UPGRADE YOUR BROWSER

We have detected your current browser version is not the latest one. Xilinx.com uses the latest web technologies to bring you the best online experience possible. Please upgrade to a Xilinx.com supported browser:Chrome, Firefox, Internet Explorer 11, Safari. Thank you!

cancel
Showing results for 
Search instead for 
Did you mean: 
Participant dsingh
Participant
2,813 Views
Registered: ‎02-01-2018

10G Ethernet Performance with ZCU102 board using XAPP1305 solution

I am getting very poor performance results for TCP or UDP. I get lot of CRC errors. Xilinx advertises the following results for 1500 MTU.  

   

MTU TCP Tx TCP Rx UDP Tx UDP Rx
1500 2.6 Gbps 1.4 Gbps 2Gbps 800

 

The results I get are as follows. The TCP results are bad because of lot of CRC errors but even UDP results are poor. Has anyone else measured the actual performance? If any results are available for jumbo frames will appreciate if you could share those too.        

 

TCP TX:          161 Mbits/sec

TCP RX:   1.11 Gbits/sec

 

UDP TX:   1.62 Gbits/sec (With lot of Errors)

UDP RX:   355 Mbits/sec 

   

0 Kudos
16 Replies
Moderator
Moderator
2,768 Views
Registered: ‎09-12-2007

Re: 10G Ethernet Performance with ZCU102 board using XAPP1305 solution

Is this board to board, or board to NIC?

I have seen a ~ 45% performance drop in my testing board to board

0 Kudos
Participant dsingh
Participant
2,750 Views
Registered: ‎02-01-2018

Re: 10G Ethernet Performance with ZCU102 board using XAPP1305 solution

I tested both scenarios and the results were fairly similar. For the Board to NIC Test, I used a high end Aberdeen Server that we have used for years for 10G links. Using Third Party TG, I could verify that the Aberdeen server could sink 9.8 Gbps easily so my Test configurations were up to the mark.     

 

BTW, I used iperf3 for making the measurements (I don't remember if I mentioned that before). I used a Third party inline tool to determine that massive CRC errors are being seen. I also used both the Ready-To-Test solution as well as the one that I generated to include iperf3 in the image.         

0 Kudos
Moderator
Moderator
2,721 Views
Registered: ‎09-12-2007

Re: 10G Ethernet Performance with ZCU102 board using XAPP1305 solution

Can you compare your design with the one in the attached design?

 

 

0 Kudos
Participant dsingh
Participant
2,686 Views
Registered: ‎02-01-2018

Re: 10G Ethernet Performance with ZCU102 board using XAPP1305 solution

Can you please clarify what you will like me to verify? I am just working with your Ready-To-Test-Solution as per Application Note 1305. Only thing I did was to add iperf3 to the image to allow me to carry out the performance evaluation. Also my FPGA engineer was able to reproduce bit errors using IBERT which is what is making my TCP performance really terrible. But I think that even after the bit errors get fixed, I would not be able to get 2.6 Gbps TCP performance that you claim in this link - http://www.wiki.xilinx.com/Zynq+mp+Ethernet+Performance+2016.4

 

BTW, I am using ZCU102 board and not ZC706 board.

              

0 Kudos
Observer davidzhangca
Observer
2,675 Views
Registered: ‎12-11-2007

Re: 10G Ethernet Performance with ZCU102 board using XAPP1305 solution

hi Stephen,

 

Your project zip (10G_AXI_Ethernet.zip) file link in your pdf seems to be broken, can you re-create the link.

 

thanks,

 

David Zhang

 

0 Kudos
Participant dsingh
Participant
2,645 Views
Registered: ‎02-01-2018

Re: 10G Ethernet Performance with ZCU102 board using XAPP1305 solution

Hi @stephenm, Please review my last response. 

0 Kudos
Moderator
Moderator
2,643 Views
Registered: ‎09-12-2007

Re: 10G Ethernet Performance with ZCU102 board using XAPP1305 solution

The file is too big to add here. can you pm me, and ill send it on

0 Kudos
Observer davidzhangca
Observer
2,617 Views
Registered: ‎12-11-2007

Re: 10G Ethernet Performance with ZCU102 board using XAPP1305 solution

hi Stephen,

 

thanks for the info.

I happen to have a Xilinx EZmove account active, can you send the file through EZMove,

my email: David.Zhang@teledyne.com

 

regards,

 

David Zhang

0 Kudos
Moderator
Moderator
2,599 Views
Registered: ‎07-31-2012

Re: 10G Ethernet Performance with ZCU102 board using XAPP1305 solution

Hi,

 

Are you using the XAPP1305 reference design ( http://www.wiki.xilinx.com/PS+and+PL+based+Ethernet+in+Zynq+MPSoC) available to download thru the below direct link?

 

https://www.xilinx.com/cgi-bin/docs/ctdoc?cid=bigfile;d=xapp1305-ps-pl-based-ethernet-solution.zip

 

Regards

Praveen


-------------------------------------------------------------------------
Don’t forget to reply, kudo, and accept as solution.
-------------------------------------------------------------------------
0 Kudos
Moderator
Moderator
2,156 Views
Registered: ‎07-31-2012

Re: 10G Ethernet Performance with ZCU102 board using XAPP1305 solution

Hi @dsingh,

 

We are using netperf/netserver attached and NIC card for testing the 10G performance.

NIC card usually achieves better performance as said.

 

You will have to load on these files to the sd card and mount them after booting using “mount /dev/mmcblk0p1/mnt”, move to the mnt folder and run below commands-

 

On tera term :  ./netserver –D -4

On the Host PC :  netperf -H 192.168.1.4 -c -C -t TCP_STREAM

For detailed info on performance, please refer to http://www.wiki.xilinx.com/Performance+tests+procedure+and+results+with+LWIP

 

This should give them similar results as we have.

 

Regards

Praveen

 


-------------------------------------------------------------------------
Don’t forget to reply, kudo, and accept as solution.
-------------------------------------------------------------------------
Participant dsingh
Participant
2,139 Views
Registered: ‎02-01-2018

Re: 10G Ethernet Performance with ZCU102 board using XAPP1305 solution

Hi @pvenugo,

 

I am using the July 2017 solution as seen below in the image. BTW, I used iperf3 to make my measurements but I will make measurements with netperf. If I read the data that you referred to in your later post, the results that I should shoot for tcp uplink is about 3 Gbps. Please confirm.

 

BTW, I get lot of Bit Errors with both my ZC102 Evals even at bare metal. Any suggestison to deal with that?  

 

oot@localhost xhdpssa]# netperf -H 192.168.1.4 -c -C -t TCP_STREAM
MIGRATED TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 192.168.1.4 () port 0 AF_INET
Recv   Send    Send                          Utilization       Service Demand
Socket Socket  Message  Elapsed              Send     Recv     Send    Recv
Size   Size    Size     Time     Throughput  local    remote   local   remote
bytes  bytes   bytes    secs.    10^6bits/s  % S      % S      us/KB   us/KB
 
 87380  16384  16384    10.00      2956.76   1.62     27.39    0.359   3.036

  

 

Capture.PNG  

0 Kudos
Participant dsingh
Participant
2,127 Views
Registered: ‎02-01-2018

Re: 10G Ethernet Performance with ZCU102 board using XAPP1305 solution

Hi @pvenugo,

 

I made netperf performance measurement board-to-board (I didn't have a Linux machine that could run netserver to allow board to NIC measurements) and the results are as follows 

 

root@plnx_aarch64:/media# ./netperf -H 192.168.255.21 -c -C -D 5 -I 99 -l 300 -- -m 1472 s64K -S 64K

MIGRATED TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 192.168.255.21 () port 0 AF_INET : +/-49.500% @ 99% conf.

Recv          Send        Send                                                                   Utilization             Service Demand

Socket      Socket     Message       Elapsed                                        Send     Recv         Send    Recv

Size           Size          Size                Time          Throughput            local    remote        local   remote

bytes        bytes         bytes              secs.          10^6bits/s               % S      % S             us/KB   us/KB

131072    16384      1472                300.03       148.51                     9.11     11.29          20.098  24.900

---------------------------------------------------------

 

root@plnx_aarch64:/media# ./netperf -H 192.168.255.21 -c -C -t UDP_STREAM -l 300

 

Socket            Message     Elapsed        Messages                                                CPU         Service
Size                 Size             Time            Okay           Errors       Throughput        Util          Demand

bytes             bytes           secs                #                #              10^6bits/sec       % SS         us/KB

 

229376           65507       300.00           1225181        0              2140.2               25.69       3.934

229376                             300.00           904119                        1579.4              44.86        6.868

 

 

0 Kudos
Moderator
Moderator
2,084 Views
Registered: ‎07-31-2012

Re: 10G Ethernet Performance with ZCU102 board using XAPP1305 solution

Hi @dsingh,

 

I guess UDP here is 2.5Gbps and TCP is 148 Mbps. Is that right?

 

Regards

Praveen


-------------------------------------------------------------------------
Don’t forget to reply, kudo, and accept as solution.
-------------------------------------------------------------------------
0 Kudos
Participant dsingh
Participant
2,067 Views
Registered: ‎02-01-2018

Re: 10G Ethernet Performance with ZCU102 board using XAPP1305 solution

Hi @pvenugo,

 

UDP is roughly at 2.1 Gbps. I was able to push UDP to as high as 4.2 Gbps by using several parallel streams. My first main issue is a lot of CRC errors in both TCP and UDP modes which kills the TCP totally. 

 

Regards,

 

DSingh        

0 Kudos
Moderator
Moderator
1,917 Views
Registered: ‎07-31-2012

Re: 10G Ethernet Performance with ZCU102 board using XAPP1305 solution

We have tested the performance at our end and achieved the results published on wiki. Also attached the detailed document on how to test this.

It is recommended that, users must use the hardware as specified in the attached screenshots, to achieve similar performance.

I hope we have provided all the relevant details provided to close the thread now.

 

Regards

Praveen


-------------------------------------------------------------------------
Don’t forget to reply, kudo, and accept as solution.
-------------------------------------------------------------------------
0 Kudos
Explorer
Explorer
1,497 Views
Registered: ‎11-05-2008

Re: 10G Ethernet Performance with ZCU102 board using XAPP1305 solution

Hi @pvenugo,

 

  I have read your report on 10G performance test.

  It is not clear to me the exact value you get:

  the screenshot in the Testing Procedure for 10G.docx shows a 9330 Mb/s !?!?

 

Luca

0 Kudos