cancel
Showing results for 
Search instead for 
Did you mean: 
Highlighted
Mentor
Mentor
440 Views
Registered: ‎06-16-2013

Does VCU have a capability to draw something like VCU ROI ?

Jump to solution

Hi all

 

I'm surprised taht VCU has a capability to draw something like VCU ROI.

 

https://xilinx-wiki.atlassian.net/wiki/spaces/A/pages/235602018/Zynq+UltraScale+MPSoC+VCU+ROI+2019.2

 

If yes, I'd like to know the mechanism and how to deal with it.

Because I'd like to consider potential and extensibility of VCU.

 

I guess, it needs to help some microblaze's binary in VCU and additional RTL modules...

 

Will Xilinx have a plan to unveil this mechanism and/or some documentation (like a tutorial) in the future ?

 

Best regards,

Tags (1)
0 Kudos
1 Solution

Accepted Solutions
Highlighted
Xilinx Employee
Xilinx Employee
245 Views
Registered: ‎08-01-2007

Re: Does VCU have a capability to draw something like VCU ROI ?

Jump to solution

@watari 

These are some good questions.  Let me try to answer theses

Q1) Can we add custome IP liket this or modify DPU ?

A1) We used the DPU as an example, but you can replace the IP with your own, or even modify the DPU IP.
  See Product Guide PG338 for more information on the DPU.

 

Q2) How to collaborate with VCU, if we implement custom IP ?

A2) You would use the Software APIs to collaberate with the VCU.  See A3 below for more details.

 

Q3) Does Xilinx release some APIs to collaborate to an internal Microblaze in VCU ?

A3) Yes, there are APIs for the Zynq UltraScale+ MPSoC VCU at multiple levels.
  The Zynq UltraScale+ MPSoC VCU Control Software is a lower level API that you can use to control the VCU.
  The other option is ot use GStreamer to control the VCU.  The example code provided with the VCU ROI design is written using the GStreamer APIs.
  You can find documentation on the API Interface in Application Software Development section of the Zynq UltraScale+ MPSoC Product Guide PG252.  There are also some link there to the Github repos, which contain some example applications tht at show how to interact with the VCU at the differnt software layers.  There is also example application code provided with the general ZCU106 VCU TRD design modules that demonstrates using GStreamer to control the VCU.

Chris
Video Design Hub | Embedded SW Support

---------------------------------------------------------------------------
Don’t forget to Reply, Kudo, and Accept as Solution.
---------------------------------------------------------------------------

View solution in original post

4 Replies
Xilinx Employee
Xilinx Employee
417 Views
Registered: ‎08-01-2007

Re: Does VCU have a capability to draw something like VCU ROI ?

Jump to solution

The VCU has had support for ROI (Region of Interest) encoding for some time, but this is the first real demonstration.

The VCU ROI TRD that you mentioned below, is the Xilinx tutorial on how to implement this.  It uses the Xilinx DPU (Deep learning Processor Unit) IP to detect the region, in this case a face, from a trained model.  It then passes the dected region information on to the VCU so that higher quality is given the region of interest when encoding the frame.

As mentioned, this design is a rather complex design, using the DPU and DNNDK Toolchain.  It assumes you are already familiar with these tools, so you may need to look at training for those tools to help you understand the full design.

 

Chris
Video Design Hub | Embedded SW Support

---------------------------------------------------------------------------
Don’t forget to Reply, Kudo, and Accept as Solution.
---------------------------------------------------------------------------
Highlighted
Mentor
Mentor
358 Views
Registered: ‎06-16-2013

Re: Does VCU have a capability to draw something like VCU ROI ?

Jump to solution

Hi @chrisar 

 

Thank you for your explanation.

 

I understood the purpose of this TRD.

BTW I have some additional question to investigate capability of VCU.

 

Q1) Can we add custome IP liket this or modify DPU ?

Q2) How to collaborate with VCU, if we implement custom IP ?

Q3) Does Xilinx release some APIs to collaborate to an internal Microblaze in VCU ?

 

I'm very interesting this approach to surveillance market by Xilinx.

And I'd like to use like this approach to other market...

 

Best regards,

0 Kudos
Highlighted
Xilinx Employee
Xilinx Employee
246 Views
Registered: ‎08-01-2007

Re: Does VCU have a capability to draw something like VCU ROI ?

Jump to solution

@watari 

These are some good questions.  Let me try to answer theses

Q1) Can we add custome IP liket this or modify DPU ?

A1) We used the DPU as an example, but you can replace the IP with your own, or even modify the DPU IP.
  See Product Guide PG338 for more information on the DPU.

 

Q2) How to collaborate with VCU, if we implement custom IP ?

A2) You would use the Software APIs to collaberate with the VCU.  See A3 below for more details.

 

Q3) Does Xilinx release some APIs to collaborate to an internal Microblaze in VCU ?

A3) Yes, there are APIs for the Zynq UltraScale+ MPSoC VCU at multiple levels.
  The Zynq UltraScale+ MPSoC VCU Control Software is a lower level API that you can use to control the VCU.
  The other option is ot use GStreamer to control the VCU.  The example code provided with the VCU ROI design is written using the GStreamer APIs.
  You can find documentation on the API Interface in Application Software Development section of the Zynq UltraScale+ MPSoC Product Guide PG252.  There are also some link there to the Github repos, which contain some example applications tht at show how to interact with the VCU at the differnt software layers.  There is also example application code provided with the general ZCU106 VCU TRD design modules that demonstrates using GStreamer to control the VCU.

Chris
Video Design Hub | Embedded SW Support

---------------------------------------------------------------------------
Don’t forget to Reply, Kudo, and Accept as Solution.
---------------------------------------------------------------------------

View solution in original post

Highlighted
Mentor
Mentor
225 Views
Registered: ‎06-16-2013

Re: Does VCU have a capability to draw something like VCU ROI ?

Jump to solution

Hi @chrisar 

 

Thank you for your answer !

I'm sure that like this application is Xilinx's (or FPGA's) strengths in AI or other markets.

 

I hope Xilinx unveils like this strengths in the future !

 

Thanks a lot.

Best regards,