UPGRADE YOUR BROWSER

We have detected your current browser version is not the latest one. Xilinx.com uses the latest web technologies to bring you the best online experience possible. Please upgrade to a Xilinx.com supported browser:Chrome, Firefox, Internet Explorer 11, Safari. Thank you!

cancel
Showing results for 
Search instead for 
Did you mean: 
Visitor chakri
Visitor
178 Views
Registered: ‎08-22-2019

u200 card not responding on kubernetes

Hi,

I am trying to add u200 card as a service using this plugin. The card is detected properly by the plugin and the plugin is sending the request to kubelet.

In kubelet journactl logs, we find that gRPC client state is in the READY state, but the response is not at all received to kubelet and we were unable to set up the FPGA card as a separate service.

Here are the environment details:

OS - ubuntu 16.04

Kernel - 4.15.0-45-generic

kubernetes - 1.15.3

docker - 18.06.2-ce

XRT - tried with both 2019.1 and 2018.3

Kindly, help us troubleshoot this issue.

 

Thanks in advance,

Stark.

0 Kudos
4 Replies
Xilinx Employee
Xilinx Employee
120 Views
Registered: ‎10-19-2015

Re: u200 card not responding on kubernetes

Hi @chakri 

Sorry for the delay. I'm still going through my proof of concept to further assist. 

However, I see that your kernel version isn't something XRT typically works with. 

Can you double check that XRT by itself is able to find your acceleration card? 

Regards,

M

-------------------------------------------------------------------------
Don’t forget to reply, kudo, and accept as solution.
-------------------------------------------------------------------------
0 Kudos
Visitor chakri
Visitor
105 Views
Registered: ‎08-22-2019

Re: u200 card not responding on kubernetes

Hi mcertosi,

We have installed the XRT driver and all the "scan and validate" commands are working fine. In the pod, it was instructed to run "./validate.exe verify.xclbin" from plugin instructions. But we are facing error while running it saying that it mismatches the DSA timestamp. In the pod, it is showing 18.04 in LSB release and 16.04 in uname. Is this proper or any changes needed?

Can you please let me know what are the Kernel Versions supported?

 

Thanks,

Chakri

0 Kudos
Xilinx Employee
Xilinx Employee
94 Views
Registered: ‎10-19-2015

Re: u200 card not responding on kubernetes

Hi @chakri 

My only input for now is that if you are seeing a message saying there is a timestamp mismatch, the XCLBIN you are trying to load onto your board was not built against the DSA/Shell that is currently loaded on it. 

The DSA timestamp is gathered from the command 

$sudo xbutil flash scan 

the xclbin timestamp can be found in the output of 

$xclbinutil -i <xclbin .xclbin> --info

 Can you run those commands and paste their output here?

Regards,

M

-------------------------------------------------------------------------
Don’t forget to reply, kudo, and accept as solution.
-------------------------------------------------------------------------
0 Kudos
Visitor chakri
Visitor
89 Views
Registered: ‎08-22-2019

Re: u200 card not responding on kubernetes

Hi,

 

Thanks for the assistance.

We are able to detect it in the Host machine and the pod too now. Can you please let us know the better supported OS(16.04 or 18.04) and the Kernel too for XRT 2019.1 and XOCL 2018.3?

Thanks.

0 Kudos