vMix Forums
»
General
»
Feature Requests
»
Support for NV12 stream from USB video sources
Rank: Advanced Member
Groups: Registered
Joined: 7/1/2015(UTC) Posts: 1,151   Location: Houston TX Thanks: 319 times
Was thanked: 263 time(s) in 233 post(s)
|
The Logitech Brio 4K webcam can only deliver 4K stream using MJPEG or NV12 encoding. Logitech promotes MJPEG as the nominal prefered codec. However, when set to use MJPEG there are several frames of latency to the resulting stream. It has been discovered that there's not such latency when Brio is used with the MS Camera app. This app apparently uses NV12 encoding. In the process of developing their own 4K USB3 webcam, Sub2r found that they had to use MS Camera to create 4K sample clips from their prototype. Being FPGA based, they were able to implement NV12 encoding in their camera, allowing them to capture real 4K30 sample clips. It would be great if vMix supported NV12 so that people could get the most out of the market leading 4K webcam.
|
|
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 7/11/2015(UTC)
Posts: 354
Location: NJ
Thanks: 9 times
Was thanked: 45 time(s) in 38 post(s)
|
Thanks for posting this. +1
|
|
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 6/6/2017(UTC)
Posts: 40
Location: Mississippi, United States
Thanks: 8 times
Was thanked: 2 time(s) in 2 post(s)
|
+1 - Seems like a good idea to me.
|
|
|
|
|
|
Rank: Administration
Groups: Administrators
Joined: 1/13/2010(UTC) Posts: 5,214 Location: Gold Coast, Australia Was thanked: 4301 time(s) in 1523 post(s)
|
Hi,
vMix definitely does support NV12 and it appears in the video format dropdown list.
If there is an error when selecting it then there must be more going on behind the scenes.
Regards,
Martin
vMix
|
 2 users thanked admin for this useful post.
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 7/1/2015(UTC) Posts: 1,151 Location: Houston TX Thanks: 319 times
Was thanked: 263 time(s) in 233 post(s)
|
Martin,
Thanks for the reality check. I just tried accessing Brio using NV12 and it does work as you say.
Alas, my license does not allow me to test in 4k. Perhaps AlanZ can try this and report back.
Looking back in my email exchange with Rich from Sub2R, they reported that they could not achieve 4K30 using Direct Show. They said that it had to done using MMF.
In Q2-2017 they were not able to achieve 4K using the vMix demo. They used MS Camera for simple local recording. And something called "Aria" as well.
|
|
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 7/11/2015(UTC)
Posts: 354
Location: NJ
Thanks: 9 times
Was thanked: 45 time(s) in 38 post(s)
|
With the exception of "Default" and "MJPG" (which has a lag), all other formats yield this error when attempting to add the camera in 4k resolutions AlanZ attached the following image(s):  brio-4kerror.jpg (70kb) downloaded 3 time(s).You cannot view/download attachments. Try to login or register.
|
|
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 7/11/2015(UTC)
Posts: 354
Location: NJ
Thanks: 9 times
Was thanked: 45 time(s) in 38 post(s)
|
By the way, I can input the brio at 1920x1080 in YUY2
|
|
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 7/1/2015(UTC) Posts: 1,151 Location: Houston TX Thanks: 319 times
Was thanked: 263 time(s) in 233 post(s)
|
OK, so the problems doesn't relate to codecs as originally thought. Nonetheless, it's not possible to use the Brio in 4k with vmix without considerable unexplained latency.
In contrast, the MS Camera app does not exhibit this latency when operating at 4k30.
Brio does not support H264 encoding, so that's not the issue.
It's vexing.
|
|
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 12/10/2017(UTC) Posts: 96 Thanks: 13 times
Was thanked: 15 time(s) in 13 post(s)
|
I don't mean to step out of line, but it sounds like there is a great opportunity here.
If the guys and gals at vMix do not have access to this device, sending them one, on loan for testing purposes, to work a solution with is possible.
|
|
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 7/1/2015(UTC) Posts: 1,151 Location: Houston TX Thanks: 319 times
Was thanked: 263 time(s) in 233 post(s)
|
TuesdaysLive wrote:I don't mean to step out of line, but it sounds like there is a great opportunity here.
If the guys and gals at vMix do not have access to this device, sending them one, on loan for testing purposes, to work a solution with is possible. If Martin would like a Brio I will certainly see that he gets one. Just say the word.
|
|
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 7/11/2015(UTC)
Posts: 354
Location: NJ
Thanks: 9 times
Was thanked: 45 time(s) in 38 post(s)
|
A year ago, I had a conversation with Tim when they visited Atlanta, and I seem to recall that he said he already had a Brio in house.
|
1 user thanked AlanZ for this useful post.
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 7/11/2015(UTC)
Posts: 354
Location: NJ
Thanks: 9 times
Was thanked: 45 time(s) in 38 post(s)
|
One thing I mentioned in another thread...
When adding a brio at 2160p, MJPG, as we all know, gives significant lag.
HOWEVER, clicking the "Use VMR" box at the top right of the camera selection screen DRAMATICALLY reduces the lag.
Hopefully, this might give a clue as to how to optimize using this little 4k camera.
|
|
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 7/11/2015(UTC)
Posts: 354
Location: NJ
Thanks: 9 times
Was thanked: 45 time(s) in 38 post(s)
|
Any thoughts about the VMR setting? Any downside?
|
|
|
|
|
|
Rank: Administration
Groups: Administrators
Joined: 1/13/2010(UTC) Posts: 5,214 Location: Gold Coast, Australia Was thanked: 4301 time(s) in 1523 post(s)
|
Hi all, Here is a beta that includes MediaFoundation support for the Brio so that it will work with NV12 @ 4K. https://www.vmix.com/download/vmix21.48.beta.exeA new camera option with MF at the end of the name should show up which will default to NV12 when set to 3840x2160. Note that the Brio is variable frame rate in low light conditions, so dropped frames are normal in many situations, and this may increase perceived latency but it should be on par with the Microsoft camera app. Regards, Martin vMix
|
1 user thanked admin for this useful post.
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 7/11/2015(UTC)
Posts: 354
Location: NJ
Thanks: 9 times
Was thanked: 45 time(s) in 38 post(s)
|
Martin, I'm downloading the beta now... it's downloading very slowly.
I'll report back ASAP.
Thanks for looking into this!
|
|
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 7/11/2015(UTC)
Posts: 354
Location: NJ
Thanks: 9 times
Was thanked: 45 time(s) in 38 post(s)
|
Martin, I am not getting the results you mentioned in your message with .48 beta Here are two screenshots of camera selection (one has legacy devices checked). No mention of MF, and selecting NV12 complains about the resolution. When selecting default, I get the usual lag. Your thoughts? Note that this is a desktop i7 machine with a 1050Ti card, windows 10 v1803 AlanZ attached the following image(s): brio-a.jpg (33kb) downloaded 0 time(s). brio-b.jpg (39kb) downloaded 0 time(s).You cannot view/download attachments. Try to login or register.
|
|
|
|
|
|
Rank: Administration
Groups: Administrators
Joined: 1/13/2010(UTC) Posts: 5,214 Location: Gold Coast, Australia Was thanked: 4301 time(s) in 1523 post(s)
|
Looks like you might be running 32bit vMix. 64bit is required for this feature...
|
|
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 7/11/2015(UTC)
Posts: 354
Location: NJ
Thanks: 9 times
Was thanked: 45 time(s) in 38 post(s)
|
Martin, VMix 32 bit is not an option on my menu, and the title bar says 64 bit AlanZ attached the following image(s): brio-c.jpg (71kb) downloaded 3 time(s).You cannot view/download attachments. Try to login or register.
|
|
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 7/11/2015(UTC)
Posts: 354
Location: NJ
Thanks: 9 times
Was thanked: 45 time(s) in 38 post(s)
|
Martin,
Is there anything else to try with this beta build?
|
|
|
|
|
|
Rank: Administration
Groups: Administrators
Joined: 1/13/2010(UTC) Posts: 5,214 Location: Gold Coast, Australia Was thanked: 4301 time(s) in 1523 post(s)
|
Not sure why it is not working for you. Should be "Logitech BRIO MF" in the list. Does it work fine in the Windows 10 "Camera" app?
You can check the logs in Documents\vMixStorage maybe there is a reason it is not loading the device.
Also check the vMix install folder to ensure that there are two files in the avplugins\MFPlugin folder,
one is a dll, the other is an xml file to determine what devices are supported (Brio only for now).
Regards,
Martin
vMix
|
|
|
|
|
|
vMix Forums
»
General
»
Feature Requests
»
Support for NV12 stream from USB video sources
Forum Jump
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.
Important Information:
The vMix Forums uses cookies. By continuing to browse this site, you are agreeing to our use of cookies.
More Details
Close
