cancel
Showing results for 
Search instead for 
Did you mean: 
Highlighted
Visitor
Visitor
3,143 Views
Registered: ‎08-29-2017

Zybo as USB Webcam

Jump to solution

Hello everyone,

 

I am really new to this embedded system, basically, i want to use Zybo as USB webcam. I want to connect an action cam through HDMI Input and do an OpenCV filtering, which then I'll send the output through the USB-OTG port of the Zybo.

 

Any idea how can I do this?

I really need a hint on how to do this

Any help appreciated.

0 Kudos
1 Solution

Accepted Solutions
Highlighted
Voyager
Voyager
4,990 Views
Registered: ‎06-24-2013

Re: Zybo as USB Webcam

Jump to solution

Hey @merflinch5_,

 

Sounds like a nice project ...

You will need the following parts ...

  • An HDMI receiver core (IP)
  • An OpenCV kernel for the filtering
  • Color space conversion
  • Some kind of Image Compression (e.g. MJPEG IP)
  • An Interface to the PS (streaming or memory)
  • A gadget driver which acts as UVC (camera device)

 

Hope this helps,

Herbert

-------------- Yes, I do this for fun!

View solution in original post

8 Replies
Highlighted
Voyager
Voyager
4,991 Views
Registered: ‎06-24-2013

Re: Zybo as USB Webcam

Jump to solution

Hey @merflinch5_,

 

Sounds like a nice project ...

You will need the following parts ...

  • An HDMI receiver core (IP)
  • An OpenCV kernel for the filtering
  • Color space conversion
  • Some kind of Image Compression (e.g. MJPEG IP)
  • An Interface to the PS (streaming or memory)
  • A gadget driver which acts as UVC (camera device)

 

Hope this helps,

Herbert

-------------- Yes, I do this for fun!

View solution in original post

Highlighted
Visitor
Visitor
3,120 Views
Registered: ‎08-29-2017

Re: Zybo as USB Webcam

Jump to solution

HI @hpoetzl, thanks for replying!

 

 

Now let me understand your points, first thing I need to do is to have a block design which will have an HDMI Receiver core, then it will be connected to color space conversion, then MJPEG IP, from the MJPEG IP I need to have an AXI Mem Interconnect or AXI BRAM which will then connected to the PS. From the PS i need to have an OpenCV kernel and run the application which will send the video output to the UVC gadget driver.. Am I right?

0 Kudos
Highlighted
Voyager
Voyager
3,114 Views
Registered: ‎06-24-2013

Re: Zybo as USB Webcam

Jump to solution

Hey @merflinch5_,

 

HI @hpoetzl, thanks for replying!

You're welcome!

 

... first thing I need to do is to have a block design ...

Not necessarily, but it is definitely an option (you can also instantiate the IP).

 

... which will have an HDMI Receiver core ...

Yes, you need that to get the HDMI from the action camera into the fabric.

 

... then it will be connected to color space conversion ...

Depends on the input and the requirements of the compressor, but usually yes.

 

... then MJPEG IP ...

Or some other compression supported by UVC.

 

... from the MJPEG IP I need to have an AXI Mem Interconnect ...

Yes, you need to get the data to the PS side, unless you want to deal with the USB OTG in the PL (which usually is not trivial)

 

... or AXI BRAM ...

Would be an option as well, but that is not a nice interface for streaming.

 

... from the PS i need to have an OpenCV kernel ...

It would be better to use HLS or similar to put your OpenCV funtionality into the PL.

But in any case, you want to put it before the compressor :)

 

... and run the application which will send the video output to the UVC gadget driver

If all went well, the output of the compressor can be (almost) directly used to feed the UVC gadget driver.

 

Best,

Herbert

-------------- Yes, I do this for fun!
Highlighted
Visitor
Visitor
3,109 Views
Registered: ‎08-29-2017

Re: Zybo as USB Webcam

Jump to solution
Alright, @hpoetzl, i think i got the hang of it for the PL part!

Yeah I was thinking to have my opencv filter from the HLS Video Library

Now, for the PS part, though.. How can I make the output of compressor passed to/detected by the UVC gadget driver? Sorry for the trouble! It just hard to find the solution for this problem, hehe..
0 Kudos
Highlighted
Voyager
Voyager
3,106 Views
Registered: ‎06-24-2013

Re: Zybo as USB Webcam

Jump to solution

Hey @merflinch5_,

 

How can I make the output of compressor passed to/detected by the UVC gadget driver?

Probably best to create a new thread for this, as it is quite specific.

 

Best,

Herbert

-------------- Yes, I do this for fun!
0 Kudos
Highlighted
Visitor
Visitor
3,083 Views
Registered: ‎08-29-2017

Re: Zybo as USB Webcam

Jump to solution
Sorry for late reply, @hpoetzl

Alright then. I really appreciate your help!
0 Kudos
Highlighted
Voyager
Voyager
3,076 Views
Registered: ‎06-24-2013

Re: Zybo as USB Webcam

Jump to solution

You're welcome!

 

All the best,

Herbert

-------------- Yes, I do this for fun!
0 Kudos
Highlighted
Scholar
Scholar
1,938 Views
Registered: ‎03-22-2016

Re: Zybo as USB Webcam

Jump to solution

@merflinch5_

The zybo web page has a sample design that does some basic processing. It is a good start. 

I placed my zybo connected to a HeroCam through HDMI and output through VGA to a monitor. 

It uses framebuffers so you don't really need to be that speed sensitive.

https://reference.digilentinc.com/learn/programmable-logic/tutorials/zybo-hdmi-demo/start

 

vitorian.com --- We do this for fun. Always give kudos. Accept as solution if your question was answered.
I will not answer to personal messages - use the forums instead.
0 Kudos