cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
284 Views
Registered: ‎09-19-2019

Video displayed is slow after the video is scaled through multiscaler

Hello,

We are using RTSP streaming to stream the video from the IP camera.

The captured video from the IP camera is scaled through Soft scalar using the gstreamer command as shown below:

gst-launch-1.0 rtspsrc location=rtsp://admin:888888@192.168.5.21:5001/udp/av0_0 latency=0 io-mode=4 ! rtph264depay ! h264parse ! queue leaky=2 ! omxh264dec internal-entropy-buffers=3 low-latency=1 ! queue leaky=2 ! videoscale method=0 ! video/x-raw, width=1280, height=720 ! videoconvert ! autovideosink sync=false async=false

Our requirement is to use multiscaler to scale the video. We are using multiscaler linux driver for this purpose. We are using the below gstreamer command for the same.

gst-launch-1.0 rtspsrc location=rtsp://admin:888888@192.168.5.21:5001/udp/av0_1 latency=0 io-mode=4 ! rtph264depay ! h264parse ! omxh264dec ! v4l2video0convert capture-io-mode=4 output-io-mode=4 ! video/x-raw,width=1920,height=1080 ! kmssink bus-id=fd4a0000.zynqmp-display fullscreen-overlay=1 sync=false async=false

We have observed that, the video displayed after soft scaling is as expected. But, the video displayed is slow after scaling through multiscalar.

Could you please suggest on this, to display the video with no delay after using the multiscalar.


With regards,
Ashwini

0 Kudos
Reply
3 Replies
214 Views
Registered: ‎02-24-2020

If you set "sync=true" does Gstreamer complain about dropping frames? What is the message you see?

If so I would recommend you start short-cutting your pipeline to try and figure out what the slow component is. Basically start removing things from the end and start piping them into fakevideosink like:

gst-launch-1.0 rtspsrc location=rtsp://admin:888888@192.168.5.21:5001/udp/av0_1 latency=0 io-mode=4 ! rtph264depay ! h264parse ! omxh264dec ! v4l2video0convert capture-io-mode=4 output-io-mode=4 ! video/x-raw,width=1920,height=1080 ! fakevideosink

 It may also be worth trying a different video source, like videotestsrc to see how frames going into v4l2videoconvert do.

I also assume you are doing this on a part that has a VCU?

Ken Sloat - Embedded Software Engineer
https://www.designlinxhs.com
0 Kudos
Reply
167 Views
Registered: ‎09-19-2019

Hii @ksloatdesignlinx 

Thank you for your response.

We have observed that, when we run gst-inspect-1.0 we get the below output:

root@root:~# gst-inspect-1.0 -a | grep xm2msc

 

 

 

[ 82.725905] xilinx-multiscaler a0100000.v_multi: Channel 0 instance created
[ 82.739457] xilinx-multiscaler a0100000.v_multi: Channel 0 instance released
[ 82.746567] xilinx-multiscaler a0100000.v_multi: Channel 1 instance created
[ 82.754651] xilinx-multiscaler a0100000.v_multi: Channel 1 instance released
[ 82.761717] xilinx-multiscaler a0100000.v_multi: Channel 2 instance created
[ 82.769807] xilinx-multiscaler a0100000.v_multi: Channel 2 instance released
[ 82.776862] xilinx-multiscaler a0100000.v_multi: Channel 3 instance created
[ 82.784934] xilinx-multiscaler a0100000.v_multi: Channel 3 instance released
[ 82.791995] xilinx-multiscaler a0100000.v_multi: Channel 4 instance created
[ 82.800082] xilinx-multiscaler a0100000.v_multi: Channel 4 instance released
[ 82.807138] xilinx-multiscaler a0100000.v_multi: Channel 5 instance created
[ 82.815211] xilinx-multiscaler a0100000.v_multi: Channel 5 instance released
[ 82.822265] xilinx-multiscaler a0100000.v_multi: Channel 6 instance created
[ 82.830390] xilinx-multiscaler a0100000.v_multi: Channel 6 instance released
[ 82.837449] xilinx-multiscaler a0100000.v_multi: Channel 7 instance created
[ 82.845421] xilinx-multiscaler a0100000.v_multi: Channel 7 instance released
[ 83.064070] xilinx-multiscaler a0100000.v_multi: Channel 0 instance created
[ 83.076722] xilinx-multiscaler a0100000.v_multi: Channel 0 instance released
[ 83.083780] xilinx-multiscaler a0100000.v_multi: Channel 1 instance created
[ 83.091818] xilinx-multiscaler a0100000.v_multi: Channel 1 instance released
[ 83.098940] xilinx-multiscaler a0100000.v_multi: Channel 2 instance created
[ 83.106949] xilinx-multiscaler a0100000.v_multi: Channel 2 instance released
[ 83.114004] xilinx-multiscaler a0100000.v_multi: Channel 3 instance created
[ 83.122017] xilinx-multiscaler a0100000.v_multi: Channel 3 instance released
[ 83.129071] xilinx-multiscaler a0100000.v_multi: Channel 4 instance created
[ 83.137042] xilinx-multiscaler a0100000.v_multi: Channel 4 instance released
[ 83.144096] xilinx-multiscaler a0100000.v_multi: Channel 5 instance created
[ 83.152074] xilinx-multiscaler a0100000.v_multi: Channel 5 instance released
[ 83.159131] xilinx-multiscaler a0100000.v_multi: Channel 6 instance created
[ 83.167097] xilinx-multiscaler a0100000.v_multi: Channel 6 instance released
[ 83.174152] xilinx-multiscaler a0100000.v_multi: Channel 7 instance created
[ 83.182018] xilinx-multiscaler a0100000.v_multi: Channel 7 instance released


* (gst-inspect-1.0:2657): WARNING *: 13:22:35.024: tried to get connection-id after disabling DTLS

* (gst-inspect-1.0:2657): WARNING *: 13:22:35.029: tried to get connection-id after disabling DTLS

* (gst-inspect-1.0:2657): CRITICAL *: 13:22:36.316: Failed to get connection to xfconfd: Could not connect: Connection refused

 

 

 

 

But, the expected output is shown below as mentioned in the link 

https://xilinx-wiki.atlassian.net/wiki/spaces/A/pages/75399218/Multi-Scaler+Linux+Driver

root@root:~# gst-inspect-1.0 -a | grep xm2msc
v4l2video0convert: String. Default: "xm2msc"
v4l2video1convert: String. Default: "xm2msc"
v4l2video2convert: String. Default: "xm2msc"
v4l2video3convert: String. Default: "xm2msc"
v4l2video4convert: String. Default: "xm2msc"
v4l2video5convert: String. Default: "xm2msc"
v4l2video6convert: String. Default: "xm2msc"
v4l2video7convert: String. Default: "xm2msc"
 
Could you please give your valuable input on this?
 
With regards,
Ashwini
0 Kudos
Reply
119 Views
Registered: ‎02-24-2020

What happens if you directly do the following?

gst-inspect-1.0 v4l2video0convert

 

Ken Sloat - Embedded Software Engineer
https://www.designlinxhs.com
0 Kudos
Reply