UPGRADE YOUR BROWSER

We have detected your current browser version is not the latest one. Xilinx.com uses the latest web technologies to bring you the best online experience possible. Please upgrade to a Xilinx.com supported browser:Chrome, Firefox, Internet Explorer 11, Safari. Thank you!

cancel
Showing results for 
Search instead for 
Did you mean: 
Adventurer
Adventurer
760 Views
Registered: ‎10-03-2018

Issues With GStreamer Based Test Pattern and Encoding

Jump to solution

Hello Everyone!

We are suffering a couple issues with UHD (3840x2160) within GStreamer. 

Our environment is the ZCU-106 rev. C under Xilinx release 2018.2.  

My specific issues/questions are:

  1. The "testvideosrc" smpte test pattern generator appears to be hugely CPU intensive. 
  2. I am unable to create an AVC or HEVC [H.264 or H.265] encoded video which claims to be in the BT.709 colour-space. 
  3. The GStreamer encoding quality of HEVC is awful compared to AVC. 

Attached is a batch file which demonstrates the problem with HEVC. 

The first problem is evidenced by the test requiring over ten minutes to run, as follows:

drwxr-xr-x  2 root root 4096 Nov 29 23:33 .
drwxr-xr-x 18 root root 4096 Nov 29 23:14 ..
-rwxr--r--  1 root root  874 Nov 29 23:20 xilinx-question.001.bash
root@zcu106_vcu_trd:/media/sata/xilinx-question.001.2018-11.29# time ./xilinx-question.001.bash >& xilinx-question.001.output

real    9m51.311s
user    10m35.698s
sys     0m38.826s
root@zcu106_vcu_trd:/media/sata/xilinx-question.001.2018-11.29# la
total 735976
drwxr-xr-x  2 root root      4096 Nov 29 23:33 .
drwxr-xr-x 18 root root      4096 Nov 29 23:14 ..
-rwxr--r--  1 root root       874 Nov 29 23:20 xilinx-question.001.bash
-rw-r--r--  1 root root 753328610 Nov 29 23:43 xilinx-question.001.mp4
-rw-r--r--  1 root root    286964 Nov 29 23:43 xilinx-question.001.output
root@zcu106_vcu_trd:/media/sata/xilinx-question.001.2018-11.29#

The second problem is evidenced by inspecting the stream properties in the ".mp4" file. 

 

The third problem will be evident when you play the ".mp4" video file. 

I've attached the test file and an image of the stream properties for reference (Xilinx won't allow me to attach the captured textual output). 

Any help you can give is appreciated. 

Thanks!
--Peimann

Kind Regards,
Peimann, S. M.
----
Toddlers are the Storm-Troopers of the Great God Entropy.
Physics: Not Just a Good Idea, It's THE LAW.
xilinx-question.001.mp4-codec-information.png
0 Kudos
1 Solution

Accepted Solutions
Moderator
Moderator
475 Views
Registered: ‎11-09-2015

Re: Issues With GStreamer Based Test Pattern and Encoding

Jump to solution

Hi @peimann,

As mentioned by @chrisar this was not implemented in 2018.3. Thus this is a feature request. You will need to wait at least 2019.1 to be released. But we cannot guaranty it will be implemented. It will be depending on the needs from all our customers.

You might want to contact your FAE for more details or to emphasize on your interest.

Best Regards,


Florent
Product Application Engineer - Xilinx Technical Support EMEA
**~ Don't forget to reply, give kudos, and accept as solution.~**
0 Kudos
13 Replies
Xilinx Employee
Xilinx Employee
691 Views
Registered: ‎08-01-2007

Re: Issues With GStreamer Based Test Pattern and Encoding

Jump to solution

@peimannI've replicated your results for both the CPU and the BT.709 color space results and I'm looking both of them on the ZCU106 Rev 1.0 board.

 

P.S. Sorry you couldn't add the text output.  If you can't attach the file, you could also try to add it in a code box at the end of your post.

Chris
Video Design Hub | Embedded SW Support

---------------------------------------------------------------------------
Don’t forget to Reply, Kudo, and Accept as Solution.
---------------------------------------------------------------------------
0 Kudos
Adventurer
Adventurer
682 Views
Registered: ‎10-03-2018

Re: Issues With GStreamer Based Test Pattern and Encoding

Jump to solution

Thanks for Your Reply @chrisar,

The output is rather large.  Last time I tried to attach as a file the board rejected it.  I'll rename as a .text and try once again...

Did not like .text, will try as .txt...

That didn't work, either.  Will try as an archive with one file...

Kind Regards,
Peimann

Kind Regards,
Peimann, S. M.
----
Toddlers are the Storm-Troopers of the Great God Entropy.
Physics: Not Just a Good Idea, It's THE LAW.
0 Kudos
Xilinx Employee
Xilinx Employee
653 Views
Registered: ‎08-01-2007

Re: Issues With GStreamer Based Test Pattern and Encoding

Jump to solution

@peimannThank you for the file.  I did some investigation and found that the large CPU usage is expected when using videotestsrc for such a large resolution.  The reason is that videotestsrc can't use a DMA copy, so the CPU has to do a memcopy which is loading down the CPU.

As for the second issue with color space that it going to take some time to find the root cause.  It isn't clear where the request to set BT.701 is being dropped.

Chris
Video Design Hub | Embedded SW Support

---------------------------------------------------------------------------
Don’t forget to Reply, Kudo, and Accept as Solution.
---------------------------------------------------------------------------
Highlighted
Adventurer
Adventurer
642 Views
Registered: ‎10-03-2018

Re: Issues With GStreamer Based Test Pattern and Encoding

Jump to solution

Thanks for the first answer @chrisar, I appreciate your help. 

Also, that you are still looking into the colour space issue. 

I will try to determine whether HD is serviceable.  Do you know if DMA is adequate at that resolution? 

Have you looked at the video generated using HEVC?  Mine shows frequent drop-out to gray, although that might be playback error.  I cannot tell.  The file is about 735 MByte, so uploading is a non-starter. 

Kind Regards,
Peimann, S. M.
----
Toddlers are the Storm-Troopers of the Great God Entropy.
Physics: Not Just a Good Idea, It's THE LAW.
0 Kudos
Xilinx Employee
Xilinx Employee
624 Views
Registered: ‎08-01-2007

Re: Issues With GStreamer Based Test Pattern and Encoding

Jump to solution

@peimannHD resolutions should be fine.  The VCU and support up to 1 stream at 4Kp60 or 4 Streams of 1080p60 since both are the same bandwidth.  But you do need to make sure that your full pipeline can support the bandwidth as the Programmable Logic (PL) can create custom video pipelines.


I did some testing with 100 frames rather than 3600, in order to speed up the testing and I didn't see any drop outs.  Keep in mind that 4Kp60 is pretty high bandwidth and needs to have a proper pipeline.  In  you case since the source is software generated there is a possibility that the generator does drop frames.  Also as you pointed out it could also depend on how you are viewing the results.

Let's keep this thread focused on the color space issue and if you have other questions open a new thread for new topics.

Chris
Video Design Hub | Embedded SW Support

---------------------------------------------------------------------------
Don’t forget to Reply, Kudo, and Accept as Solution.
---------------------------------------------------------------------------
Adventurer
Adventurer
613 Views
Registered: ‎10-03-2018

Re: Issues With GStreamer Based Test Pattern and Encoding

Jump to solution

Thanks @chrisar,

I'll try to stay on topic in this thread. 

That said, I will test and verify, so that throughput is a dead issue. 

Have a Great Evening!

Kind Regards,
Peimann, S. M.
----
Toddlers are the Storm-Troopers of the Great God Entropy.
Physics: Not Just a Good Idea, It's THE LAW.
0 Kudos
Adventurer
Adventurer
558 Views
Registered: ‎10-03-2018

Re: Issues With GStreamer Based Test Pattern and Encoding

Jump to solution

Good Morning @chrisar,

Have you had any luck finding any more information on the colour space problem?

Thanks,
Scott

Kind Regards,
Peimann, S. M.
----
Toddlers are the Storm-Troopers of the Great God Entropy.
Physics: Not Just a Good Idea, It's THE LAW.
0 Kudos
Xilinx Employee
Xilinx Employee
548 Views
Registered: ‎08-01-2007

Re: Issues With GStreamer Based Test Pattern and Encoding

Jump to solution

@peimannWe are still looking into this.

Chris
Video Design Hub | Embedded SW Support

---------------------------------------------------------------------------
Don’t forget to Reply, Kudo, and Accept as Solution.
---------------------------------------------------------------------------
0 Kudos
Xilinx Employee
Xilinx Employee
512 Views
Registered: ‎08-01-2007

Re: Issues With GStreamer Based Test Pattern and Encoding

Jump to solution

We have confirmed that support for BT.709 has not been implemented in 2018.3 and earlier.
We have filed a CR (Change Request) and the plan is to address in a future release.

Chris
Video Design Hub | Embedded SW Support

---------------------------------------------------------------------------
Don’t forget to Reply, Kudo, and Accept as Solution.
---------------------------------------------------------------------------
0 Kudos
Adventurer
Adventurer
503 Views
Registered: ‎10-03-2018

Re: Issues With GStreamer Based Test Pattern and Encoding

Jump to solution

Good Afternoon @chrisar,

Thanks for the feed-back. 

I've attached comparative outputs from the original test and under the vcu_sdirxtx build from the pre-built cases. 

Can you give me a time estimate on when we might see an expected resolution date?

Thank You,
Scott M. Peimann

Kind Regards,
Peimann, S. M.
----
Toddlers are the Storm-Troopers of the Great God Entropy.
Physics: Not Just a Good Idea, It's THE LAW.
0 Kudos
Moderator
Moderator
476 Views
Registered: ‎11-09-2015

Re: Issues With GStreamer Based Test Pattern and Encoding

Jump to solution

Hi @peimann,

As mentioned by @chrisar this was not implemented in 2018.3. Thus this is a feature request. You will need to wait at least 2019.1 to be released. But we cannot guaranty it will be implemented. It will be depending on the needs from all our customers.

You might want to contact your FAE for more details or to emphasize on your interest.

Best Regards,


Florent
Product Application Engineer - Xilinx Technical Support EMEA
**~ Don't forget to reply, give kudos, and accept as solution.~**
0 Kudos
Adventurer
Adventurer
466 Views
Registered: ‎10-03-2018

Re: Issues With GStreamer Based Test Pattern and Encoding

Jump to solution

Thank You @florentw and @chrisar,

I'm going to close this issue based on the performance aspect.  I will write a new one to deal with only the colour-space issue that we are working to track down. 

I really do appreciate the help you have given us. 

Merry Christmas!

Kind Regards,
Peimann, S. M.
----
Toddlers are the Storm-Troopers of the Great God Entropy.
Physics: Not Just a Good Idea, It's THE LAW.
0 Kudos
Moderator
Moderator
463 Views
Registered: ‎11-09-2015

Re: Issues With GStreamer Based Test Pattern and Encoding

Jump to solution

Thanks. Merry Christmas to you ;)


Florent
Product Application Engineer - Xilinx Technical Support EMEA
**~ Don't forget to reply, give kudos, and accept as solution.~**
0 Kudos