UPGRADE YOUR BROWSER

We have detected your current browser version is not the latest one. Xilinx.com uses the latest web technologies to bring you the best online experience possible. Please upgrade to a Xilinx.com supported browser:Chrome, Firefox, Internet Explorer 11, Safari. Thank you!

SdAccle 2017.1 + KCU1500: enqueueReadBuffer from Device to Host fails with "ERROR: Failed to sync 1024/-1 bytes"

Reply
Highlighted
Observer
Posts: 43
Registered: ‎02-21-2013

SdAccle 2017.1 + KCU1500: enqueueReadBuffer from Device to Host fails with "ERROR: Failed to sync 1024/-1 bytes"

Hi,

 

During the execution of test on the host, observing error similar to this in some cases.

 

ERROR: Failed to sync 1024/-1 bytes

 

Initially saw this only bigger buffer size. However it has become more frequent and is now happening even at 1 KB

 

Debugging showed that this is during rad back of device data into Host. This code has worked realizably so far

 

q.enqueueReadBuffer(buffer_c, CL_TRUE, 0, vector_size_bytes, result_krnl.data());

 

What could be causing this? Has anyone seen this?

 

1. Host memory being corrupted?

2. Device (FPGA) being corrupted/

3. Timing issue on Device (FPGA)?

4. Data Type (int32 vs int?)

5. Buffer size?

 

Regards

Prasad

Observer
Posts: 43
Registered: ‎02-21-2013

Re: SdAccle 2017.1 + KCU1500: enqueueReadBuffer from Device to Host fails with "ERROR: Failed to sync 1024/-1 bytes"

Hello

 

I have not seen any suggestion for my original post. Unfortunately this issue still exists

Please let me know if anyone has any suggestions to work around or fix this

 

Regards

Prasad 

Xilinx Employee
Posts: 534
Registered: ‎08-17-2011

Re: SdAccle 2017.1 + KCU1500: enqueueReadBuffer from Device to Host fails with "ERROR: Failed to sync 1024/-1 bytes"

hi @pkuruganti

 

would help if you can provite small testcase and/or : 

    1. dmesg log, OS info, driver version info, PCI bus info, what board, maybe are what all OpenCL platforms on the system.
    2. did you try new SDAccel 2017.2 or older and whta's the status etc
    3. can you check that your drivers, if need to force reinstall: from xbinst board package: ./install.sh -f yes -k yes

 

thank you !

- Hervé

SIGNATURE:
* New Dedicated Vivado HLS forums* http://forums.xilinx.com/t5/High-Level-Synthesis-HLS/bd-p/hls
* Readme/Guidance* http://forums.xilinx.com/t5/New-Users-Forum/README-first-Help-for-new-users/td-p/219369

* Please mark the Answer as "Accept as solution" if information provided is helpful.
* Give Kudos to a post which you think is helpful and reply oriented.
Observer
Posts: 43
Registered: ‎02-21-2013

Re: SdAccle 2017.1 + KCU1500: enqueueReadBuffer from Device to Host fails with "ERROR: Failed to sync 1024/-1 bytes"

Hi Herve

 

I am installing 2017.2,

 

However the issue is not on all designs, which indicates that the drivers, board and OS, PCIE slot are working

 

Board is =>  KCU1500

 

PCIE is reporting => Gen3, x8

 LnkCap: Port #0, Speed 8GT/s, Width x8, ASPM unknown, Latency L0 unlimited, L1 unlimited
   ClockPM- Surprise- LLActRep- BwNot-

 

OS (from uname -r) : 4.1.15.pnotify

 

SDAccel Version => 2017.1

 

OpenCL:

 

The OpenCL code has beffers defined for inputs and outputs to kernel. Kenel is a simple MAC (multiply-add). The issue seems to happen when the buffer is filled  (result of MAC), i.e readback from kernel

 

Hope this helps

Regards

Prasad

Regards

Prasad

 

Observer
Posts: 43
Registered: ‎02-21-2013

Re: SdAccle 2017.1 + KCU1500: enqueueReadBuffer from Device to Host fails with "ERROR: Failed to sync 1024/-1 bytes"

BTW: If you have setup, I may be able to send a small test case, that you can build and try on your side
Observer
Posts: 43
Registered: ‎02-21-2013

Re: SdAccle 2017.1 + KCU1500: enqueueReadBuffer from Device to Host fails with "ERROR: Failed to sync 1024/-1 bytes"

Hello

Installing KCU1500 board package from SDAccel 2017.2 is giving following error.

It works fine with 2017.1 version (Messages from both runs are copied below)

 

With SDAccel 2017.2:

 

sudo /home/tools/xilinx/SDAccel/2017.2/bin/xbinst -f xilinx:kcu1500:4ddr-xpr:4.0 -d kcu1500_setup/

****** xbinst v2017.2_sdx (64-bit)
  **** SW Build 1972098 on Wed Aug 23 11:34:38 MDT 2017
    ** Copyright 1986-2017 Xilinx, Inc. All Rights Reserved.

ERROR: [XBINST 60-705] No device was found that matches 'xilinx:kcu1500:4ddr-xpr:4.0'. The supported devices are:

ERROR: [XBINST 60-587] Failed to add a device: specified platform xilinx:kcu1500:4ddr-xpr:4.0 is not found

 

With SDAccel 2017.1:

sudo /opt/Xilinx/SDx/2017.1/bin/xbinst -f xilinx:kcu1500:4ddr-xpr:4.0 -d kcu1500_setup/

****** xbinst v2017.1_sdx (64-bit)
  **** SW Build 1915620 on Thu Jun 22 17:54:59 MDT 2017
    ** Copyright 1986-2017 Xilinx, Inc. All Rights Reserved.

INFO: [XBINST 60-895]    Target platform: /opt/Xilinx/SDx/2017.1/platforms/xilinx_kcu1500_4ddr-xpr_4_0/xilinx_kcu1500_4ddr-xpr_4_0.xpfm
INFO: [XBINST 60-267] Packaging for PCIe...
INFO: Adding section using: 'xilinx_kcu1500_' (2052429 Bytes)
INFO: [XBINST 60-268] Packaging for PCIe...COMPLETE
INFO: [XBINST 60-667] xbinst has successfully created a board installation directory at /workspaces/kcu1500_setup.

 

Xilinx Employee
Posts: 534
Registered: ‎08-17-2011

Re: SdAccle 2017.1 + KCU1500: enqueueReadBuffer from Device to Host fails with "ERROR: Failed to sync 1024/-1 bytes"

hi @pkuruganti

 

looks like the DSA is not installed? can you run 

xocc --list_xdevices

 

note: the result would be the DSA names matching the subdirectories from the YOURSDXINSTALL/platforms directory (but this dir includes the SDSoC platforms too)

 

Also yes, you should be able to PM me with your testcase

- Hervé

SIGNATURE:
* New Dedicated Vivado HLS forums* http://forums.xilinx.com/t5/High-Level-Synthesis-HLS/bd-p/hls
* Readme/Guidance* http://forums.xilinx.com/t5/New-Users-Forum/README-first-Help-for-new-users/td-p/219369

* Please mark the Answer as "Accept as solution" if information provided is helpful.
* Give Kudos to a post which you think is helpful and reply oriented.
Observer
Posts: 43
Registered: ‎02-21-2013

Re: SdAccle 2017.1 + KCU1500: enqueueReadBuffer from Device to Host fails with "ERROR: Failed to sync 1024/-1 bytes"

Hi,

 

Looks like 2017.2 has changed the Device name in "emcconfig.jason" while the name selected in tool is same. Due to this compiles generated in 2017.1 are  compatible with 2017.2 and vice versa. Is this a new bug?

 

Regards

Prasad

 

diff -b /workspaces/test_sdaccel/gmac_cpp_int16_fill/System/emconfig.json emconfig.json
5c5
<         "ToolVersion": "2017.1"
---
>         "ToolVersion": "2017.2"
12c12
<                         "Name": "xilinx:kcu1500:4ddr-xpr:4.0",
---
>                         "Name": "xilinx_kcu1500_4ddr-xpr_4_0",

Observer
Posts: 43
Registered: ‎02-21-2013

Re: SdAccle 2017.1 + KCU1500: enqueueReadBuffer from Device to Host fails with "ERROR: Failed to sync 1024/-1 bytes"

 

Hi,

 

The device is list is shown below. So the name is listed as the one used by 2017.1 tool chain.

Can you please advise on next steps here

 

Regards

Prasad

 

/home/tools/xilinx/SDAccel/2017.2/bin/xocc --list_xdevices
xilinx:kcu1500:4ddr-xpr:4.0
xilinx:adm-pcie-ku3:2ddr:3.3
xilinx:xil-accel-rd-ku115:4ddr-xpr:3.3
xilinx:xil-accel-rd-ku115:4ddr-xpr:4.0
xilinx:zc706:linux-uart:1.0
xilinx:adm-pcie-8k5:2ddr:3.3
xilinx:adm-pcie-8k5:2ddr:4.0
xilinx:adm-pcie-7v3:1ddr:3.0
xilinx:adm-pcie-ku3:2ddr-xpr:4.0
xilinx:adm-pcie-ku3:2ddr-xpr:3.3

Observer
Posts: 43
Registered: ‎02-21-2013

Re: SdAccle 2017.1 + KCU1500: enqueueReadBuffer from Device to Host fails with "ERROR: Failed to sync 1024/-1 bytes"

Hi - Hervé

Can you please help resolving this?

Regards
Prasad