UPGRADE YOUR BROWSER

We have detected your current browser version is not the latest one. Xilinx.com uses the latest web technologies to bring you the best online experience possible. Please upgrade to a Xilinx.com supported browser:Chrome, Firefox, Internet Explorer 11, Safari. Thank you!

cancel
Showing results for 
Search instead for 
Did you mean: 
Participant jayshu
Participant
2,855 Views
Registered: ‎06-29-2018

Anyone have 10G working on Petalinux 2018.2?

Jump to solution

I've been trying to get the 10G ethernet working properly via 2018.2 SDK on the ZCU102 board (Rev 1.0) and it seems like I might be missing a step or so.  I've followed instructions from another message - https://forums.xilinx.com/t5/Networking-and-Connectivity/Is-there-petalinux-2017-2-support-for-10G-Ethernet-Subsystem-v2/m-p/789848/highlight/true#M11172

The difference I have from the forum message - 2018.2 is used versus 2017.2

 

I've also applied the patch to the FSBL to make sure the Si570 is outputing the 156.25 MHz and also the modification that is necessary for the device tree overlay.

 

I can bring up the 10GbE interface on the ZCU102 and ping another system with 10GbE without a problem.  Trying to accept any TCP packets is when there are no packets received.

 

Has anyone else gotten the 10G working then on 2018.2?

Tags (3)
0 Kudos
1 Solution

Accepted Solutions
Participant jayshu
Participant
2,487 Views
Registered: ‎06-29-2018

Re: Anyone have 10G working on Petalinux 2018.2?

Jump to solution

It turns out that the project, post updating to 2018.2 had an issue with the Tx and RX FIFO blocks.  Both were not set properly compared to the original 2017.3 project.  The FIFO depth is now set at 32768 and Enable Packet Mode = yes solved this issue.

View solution in original post

16 Replies
Moderator
Moderator
2,799 Views
Registered: ‎08-25-2009

Re: Anyone have 10G working on Petalinux 2018.2?

Jump to solution

Hi @jayshu,

 

XAPP1305 has not been updated to 2018.2. But we've seen some customer successfully upgraded the design themselves for AXI Ethernet + AXI DMA.

Can you please share your complete Linux bootlog file and your DTS in 2018.2?

 

Btw, we also have a MCDMA + 10G design available in 2018.1 in our lounge:

https://www.xilinx.com/member/25ge.html

You will have to request the access to get it.

"Don't forget to reply, kudo and accept as solution."
0 Kudos
Participant jayshu
Participant
2,794 Views
Registered: ‎06-29-2018

Re: Anyone have 10G working on Petalinux 2018.2?

Jump to solution

See attached text file for the Linux boot log.  You can see that the FSBL has setup the 156.25 MHz clock.  The zip file contains my files from the plnx_workspace/device-tree and meta-user/recipes-bsp/device-tree/system-user.dtsi.

0 Kudos
Participant jayshu
Participant
2,782 Views
Registered: ‎06-29-2018

Re: Anyone have 10G working on Petalinux 2018.2?

Jump to solution

As a follow to this problem here's an iperf3 output - the ZCU102 is running "iperf3 -s" while another Intel box is running as the client via: "iperf3 -c 192.168.0.2".

 

=== Output from ZCU102 terminal while Intel box is client ===

root@xilinx-zcu102-2018_2:~# iperf3 -s
-----------------------------------------------------------
Server listening on 5201
-----------------------------------------------------------
Accepted connection from 192.168.0.1, port 38560
[ 5] local 192.168.0.2 port 5201 connected to 192.168.0.1 port 38562
[ ID] Interval Transfer Bitrate
[ 5] 0.00-1.00 sec 0.00 Bytes 0.00 bits/sec
[ 5] 1.00-2.00 sec 0.00 Bytes 0.00 bits/sec
[ 5] 2.00-3.00 sec 0.00 Bytes 0.00 bits/sec
[ 5] 3.00-4.00 sec 0.00 Bytes 0.00 bits/sec
[ 5] 4.00-5.00 sec 0.00 Bytes 0.00 bits/sec
[ 5] 5.00-6.00 sec 0.00 Bytes 0.00 bits/sec
[ 5] 6.00-7.00 sec 0.00 Bytes 0.00 bits/sec
[ 5] 7.00-8.00 sec 0.00 Bytes 0.00 bits/sec
[ 5] 8.00-9.00 sec 0.00 Bytes 0.00 bits/sec
[ 5] 9.00-10.00 sec 0.00 Bytes 0.00 bits/sec
[ 5] 10.00-11.00 sec 0.00 Bytes 0.00 bits/sec
[ 5] 11.00-12.00 sec 0.00 Bytes 0.00 bits/sec
[ 5] 12.00-13.00 sec 0.00 Bytes 0.00 bits/sec

==========================================

 

On the Intel side:

===================

iperf3 -c 192.168.0.2
Connecting to host 192.168.0.2, port 5201
[ 4] local 192.168.0.1 port 38562 connected to 192.168.0.2 port 5201
^C[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1536353734.74 sec 0.00 Bytes 0.00 bits/sec 0 14.1 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-1536353734.74 sec 0.00 Bytes 0.00 bits/sec 0 sender
[ 4] 0.00-1536353734.74 sec 0.00 Bytes 0.00 bits/sec receiver

===============================

 

Reversing the setup, nothing gets sent from the ZCU102 if it is the client.

 

If I use netcat to send small messages over, it will work from either the client or server side (i.e. typing message).  However, if I chose pipe /dev/zero over, that always will hang.  Even trying to ssh will hang post login.

0 Kudos
Moderator
Moderator
2,745 Views
Registered: ‎08-25-2009

Re: Anyone have 10G working on Petalinux 2018.2?

Jump to solution

Hi @jayshu,


From the log file, it looks like neither 1G or 10G interface is up.

For 1G -

[    4.673317] macb ff0e0000.ethernet eth0: Cadence GEM rev 0x50070106 at 0xff0e0000 irq 31 (00:0a:35:00:22:01)
[    4.673334] Generic PHY ff0e0000.ethernet-ffffffff:0c: attached PHY driver [Generic PHY] (mii_bus:phy_addr=ff0e0000.ethernet-ffffffff:0c, irq=POLL)

Are you sure the driver is properly enabled in kernel config? And your PHY address is correctly set in DTS?

 

For 10G -

[    4.674031] xilinx_axienet 80010000.ethernet: couldn't find phy i/f

Are you using a 10G NIC card or a SFP for board to board connection?

 

Can you please first test the attached 2018.1 image? This is not an official release version.

 

 

"Don't forget to reply, kudo and accept as solution."
0 Kudos
Participant jayshu
Participant
2,736 Views
Registered: ‎06-29-2018

Re: Anyone have 10G working on Petalinux 2018.2?

Jump to solution

With the attached image, it does come up and I can see that iperf is working.  With the image you provided, the mac and axi interface output from the LInux boot log also has the same output as my image.

============

[ 1.655310] macb ff0e0000.ethernet: Not enabling partial store and forward
[ 1.655714] libphy: MACB_mii_bus: probed
[ 1.659452] macb ff0e0000.ethernet eth0: Could not attach to PHY
[ 1.696443] xilinx_axienet 80010000.ethernet: couldn't find phy i/f

============

 

I'm pretty sure the PHY address is correct in the DTS.  I have not touched that however, I've validated from the DTS (PL.dtsi) that it matches the right address from the design.   I did notice that your image is on eth0 versus mine on eth1.

 

For the 10G side testing, I'm using the SFP+ (using a SFP to RJ45 adapter) on the ZCU102 and then to an Intel 540T NIC on a PC.  I've validated that the SFP to RJ45 adapter is working using an older 2016.4 example and connection to Intel 540T NIC is fine too.

 

On the 1G/10G interface side, the driver has been enabled in the kernel - see below:

xilinx-network-kernel-config.png

 

0 Kudos
Participant jayshu
Participant
2,624 Views
Registered: ‎06-29-2018

Re: Anyone have 10G working on Petalinux 2018.2?

Jump to solution

As footnote on the iperf performance with the provided image.  From the default values with the MTU setup at 1500 we basically see about 1.1 Gbps over the 10GbE link.  This seems to match what others are seeing.  I was wondering if you can confirm the kernel driver settings?

0 Kudos
Moderator
Moderator
2,605 Views
Registered: ‎08-25-2009

Re: Anyone have 10G working on Petalinux 2018.2?

Jump to solution

Hi @jayshu,

 

The kernel driver settings look fine to me.

"Don't forget to reply, kudo and accept as solution."
0 Kudos
Participant jayshu
Participant
2,601 Views
Registered: ‎06-29-2018

Re: Anyone have 10G working on Petalinux 2018.2?

Jump to solution

Well, it must be the project within Vivaldo then.  Can you take a look if we provide it?  We started from 2017.3 project from Xapp1305.

0 Kudos
Participant jayshu
Participant
2,525 Views
Registered: ‎06-29-2018

Re: Anyone have 10G working on Petalinux 2018.2?

Jump to solution

Could you review if we provide the project file?  It is large so we will need to use EzMove, could you set one up and I can upload the project then?

0 Kudos
Participant jayshu
Participant
2,222 Views
Registered: ‎06-29-2018

Re: Anyone have 10G working on Petalinux 2018.2?

Jump to solution

Some more debugging on the Linux side shows issues when sending packets out from the processor.

On the A53 - the following commands were done 

dd if=/dev/zero bs=1024 count=148 | nc -vvn 192.168.0.1 12345 (Pass)
dd if=/dev/zero bs=1024 count=149 | nc -vvn 192.168.0.1 12345 (FAIL) - only 86632 bytes sent
dd if=/dev/zero bs=512 count=296 | nc -vvn 192.168.0.1 12345 (Pass)
dd if=/dev/zero bs=512 count=297 | nc -vvn 192.168.0.1 12345 (FAIL) - only 86632 bytes sent.

 

A PC was the server (command used on server: "nc --vvlnp 12345 > /dev/null".  On the FAIL commands, it never completes and will hang.

0 Kudos
Participant jayshu
Participant
2,488 Views
Registered: ‎06-29-2018

Re: Anyone have 10G working on Petalinux 2018.2?

Jump to solution

It turns out that the project, post updating to 2018.2 had an issue with the Tx and RX FIFO blocks.  Both were not set properly compared to the original 2017.3 project.  The FIFO depth is now set at 32768 and Enable Packet Mode = yes solved this issue.

View solution in original post

Adventurer
Adventurer
1,148 Views
Registered: ‎04-25-2017

Re: Anyone have 10G working on Petalinux 2018.2?

Jump to solution

@jayshu 

 

I am working on similar lines. Can you send this project for reference? We are getting a lot of issues with 10G. Please find the 10G design and suggest any mistakes if you spot one!

 

10G_design.png
0 Kudos
Observer haoze
Observer
898 Views
Registered: ‎10-11-2017

回复: Anyone have 10G working on Petalinux 2018.2?

Jump to solution
Hi jayshu, I met the same problem like you with petalinux 2018.2.And thank you for your solution. With setting fifo depth to 32768 and enable packet mode,I test the 10G ethernet performance with 138MB/s .However I want to improve the performance to 300~400MB/s. Do you have any idea?What's performance did you get when tested 10G ethernet with iperf?
0 Kudos
Participant jayshu
Participant
591 Views
Registered: ‎06-29-2018

回复: Anyone have 10G working on Petalinux 2018.2?

Jump to solution

Sorry for the late reply - I haven't checked the forum out in a few months.  My performance was no better than 2.5 to 3 Gbit/sec via TCP, however when we use the PL side for MAC only, performance is much better - near line rate (not on the ZCU board).

0 Kudos
Highlighted
Adventurer
Adventurer
579 Views
Registered: ‎04-25-2017

回复: Anyone have 10G working on Petalinux 2018.2?

Jump to solution
Hey. I am working on similar lines here. I am trying to get link on my 10G with Linux. I couldn't even get my link up. Could you please share your project with me on digital@astrome.co ??
BTW Which board did you use?
0 Kudos
Adventurer
Adventurer
577 Views
Registered: ‎04-25-2017

Re: Anyone have 10G working on Petalinux 2018.2?

Jump to solution
Hey jayshu could you please share your project over digital@astrome.co? I couldn't even get the link up on KCU105 board. And on petalinux it is not pinging.
0 Kudos