UPGRADE YOUR BROWSER

We have detected your current browser version is not the latest one. Xilinx.com uses the latest web technologies to bring you the best online experience possible. Please upgrade to a Xilinx.com supported browser:Chrome, Firefox, Internet Explorer 11, Safari. Thank you!

Yesterday, Xilinx announced the reVISION stack for software-defined embedded-vision apps. Today, there’s two demo videos

by Xilinx Employee ‎03-14-2017 10:09 AM - edited ‎05-04-2017 02:21 PM (2,608 Views)

 

Yesterday, Xilinx announced the reVISION stack for software-defined, embedded-vision apps. (See “Xilinx reVISION stack pushes machine learning for vision-guided applications all the way to the edge.”) Today, there’s a video demo of an application built with the reVISION stack and a second with more technical detail on optical flow. The first demo shows a working system that accepts video from two cameras, performs an optical flow transformation on one video stream, processes a recorded video stream from an SD card through a CNN, and then merges the video and optical-flow representations and outputs the resulting video on an HDMI screen. All of these operations occur within one Xilinx Zynq UltraScale+ ZU9EG MPSoC running on a Xilinx ZCU102 eval kit.

 

Here’s a block diagram of the demo showing how the three video streams are captured, processed, and displayed by the Zynq UltraScale+ MPSoC:

 

 

reVISION demo block diagram.jpg 

 

 

The two image sensors in this first demo are worthy of note. One is the new Sony IMX274LQC 4K60 image sensor designed for industrial applications. It’s connected to the ZCU102 eval kit over a MIPI interface running through one of the eval kit’s FMC connectors. The second camera is a Stereolabs ZED 2K stereo camera interfaced over USB 3.0, a high-speed native interface for the Zynq UltraScale+ MPSoC.

 

Here’s the 2-minute video of the operating demo:

 

 

 

 

 

For more details on the optical-flow part of the demo, here’s another 2-minute video:

 

 

 

 

 

Labels
About the Author
  • Be sure to join the Xilinx LinkedIn group to get an update for every new Xcell Daily post! ******************** Steve Leibson is the Director of Strategic Marketing and Business Planning at Xilinx. He started as a system design engineer at HP in the early days of desktop computing, then switched to EDA at Cadnetix, and subsequently became a technical editor for EDN Magazine. He's served as Editor in Chief of EDN Magazine, Embedded Developers Journal, and Microprocessor Report. He has extensive experience in computing, microprocessors, microcontrollers, embedded systems design, design IP, EDA, and programmable logic.