logo

Live Production Software Forums


Welcome Guest! To enable all features please Login or Register.

Notification

Icon
Error

Options
Go to last post Go to first unread
lael  
#1 Posted : Monday, June 26, 2017 1:51:40 AM(UTC)
lael

Rank: Advanced Member

Groups: Registered
Joined: 2/18/2017(UTC)
Posts: 75

Thanks: 22 times
Was thanked: 4 time(s) in 4 post(s)

We're about to purchase our own streaming setup for a school. The aim is to live stream robotics competitions as well as school sporting events, professional forums/panels etc.

One of the things we need to do is to provide IMAG inside events - mostly in a situation where people will be able to see both the speaker / game and the screen at the same time. Because of this we're concerned about latency in getting video from the camera, into vmix, processed with titles / scores etc and then back out to display. I understand that it has been fairly common for people to use a BM ATEM system in parallel (eg; split the video feeds into ATEM and into vMix) so that ATEM does IMAG and vMix does streaming to avoid these issues.

We would like to avoid this double up in cost and functionality if possible. Is anyone running vMix as IMAG as well as livestreaming & recording? What sort of latencies are you getting? Would you be willing to post a video of live capture showing both the vmix screen and the live IMAG output so we can see what latencies are 'normal' and best case scenario?

In terms of hardware, at the moment we are thinking BM capture - decklink 4k pro, and something like the Ruby reference system, but a little more specc'd up with a 1080 graphics card. Cameras - still working on, but likely with a conversion to SDI back to the computer, though we would like to use the BirdDog to take advantage of NDI if it is released soon and has low latency.
DWAM  
#2 Posted : Monday, June 26, 2017 5:25:34 AM(UTC)
DWAM

Rank: Advanced Member

Groups: Registered
Joined: 3/20/2014(UTC)
Posts: 2,721
Man
France
Location: Bordeaux, France

Thanks: 243 times
Was thanked: 794 time(s) in 589 post(s)
Hi Lael!

if you really want to avoid this latency issue, it will cost much more than just an ATEM which also has latency btw (a little less anyway).

If you just want to display the close up camera on speakers with no other information, you can use a video router like BMD Smart VideoHub for example.

If you need to add titles, make compositing, etc, the best option for no latency is to use an Analogway switcher or multiviewer.

Another option is to use an hardware switcher like Panasonics or Sonys.

As of vMix, depending on your hardware and your load, you can get an acceptable latency of 5/6/7 frames, as you can see in this video

However in order to avoid video loops, I'm using a 2 vMix setup here, where the main vMix ingests all cameras and does the production for streaming + providing inputs feeds via NDI to vMix 2 which handles the big screen presentation. With this setup, it's important to realize that some of the latency is not vMix related, but comes from the beamer itself.

Hope this helps
Guillaume
thanks 3 users thanked DWAM for this useful post.
DVE on 8/10/2017(UTC), lael on 8/16/2017(UTC), sinc747 on 9/1/2017(UTC)
AElli  
#3 Posted : Monday, June 26, 2017 6:16:13 AM(UTC)
AElli

Rank: Advanced Member

Groups: Registered
Joined: 6/6/2016(UTC)
Posts: 106
Location: UK

Thanks: 2 times
Was thanked: 13 time(s) in 12 post(s)
IMO Imag is one of the most difficult things to accomplish if you're producing on a budget.

There are many aspects of production that introduce latency. Starting with 'in camera' latency, through various converters HDMI-SDI etc, cable types and ending with the projector itself ( project scaling etc ) it all adds up. Knowing what to buy really does make a difference here, so search out someone in ur area as an adviser who has knowledge of this.

Watching the BBC's coverage of Glastonbury these last few evenings there were many occasions where lip sync was off between the artist and the big screens. (and I wouldn't call Glastonbury low budget)
thanks 1 user thanked AElli for this useful post.
lael on 6/26/2017(UTC)
lael  
#4 Posted : Monday, June 26, 2017 12:23:14 PM(UTC)
lael

Rank: Advanced Member

Groups: Registered
Joined: 2/18/2017(UTC)
Posts: 75

Thanks: 22 times
Was thanked: 4 time(s) in 4 post(s)
Thanks Guillaume,

At the moment, if we can't get an 'acceptable' latency, I think we will probably go for a hardware switching system. At the moment we are thinking the BlackMagic ATEM Production Studio 4K or the ATEM Television Studio HD. I understand they have latency, but I believe around 50ms total to screen if assuming sdi camera out - switcher - sdi - screen (depending on projector).

Is it possible to use vMix for creating titles etc and as a media input (eg, videos, slides etc) for the ATEM switcher? and to split the SDI output back to the vMix computer for recording and streaming?

From my brief look at Analogway after your comment they look beautiful and like they're probably out of the budget - please point me in the right direction if I missed something similar in the price range of the ones above.

I looked at your video, but there was no way to see the delay as it didn't look like you were running live feed back to the screen?

DWAM wrote:
Hi Lael!

if you really want to avoid this latency issue, it will cost much more than just an ATEM which also has latency btw (a little less anyway).

If you just want to display the close up camera on speakers with no other information, you can use a video router like BMD Smart VideoHub for example.

If you need to add titles, make compositing, etc, the best option for no latency is to use an Analogway switcher or multiviewer.

Another option is to use an hardware switcher like Panasonics or Sonys.

As of vMix, depending on your hardware and your load, you can get an acceptable latency of 5/6/7 frames, as you can see in this video

However in order to avoid video loops, I'm using a 2 vMix setup here, where the main vMix ingests all cameras and does the production for streaming + providing inputs feeds via NDI to vMix 2 which handles the big screen presentation. With this setup, it's important to realize that some of the latency is not vMix related, but comes from the beamer itself.

Hope this helps
Guillaume

lael  
#5 Posted : Monday, June 26, 2017 12:24:53 PM(UTC)
lael

Rank: Advanced Member

Groups: Registered
Joined: 2/18/2017(UTC)
Posts: 75

Thanks: 22 times
Was thanked: 4 time(s) in 4 post(s)
Thanks - any suggestions on where to start?

AElli wrote:
IMO Imag is one of the most difficult things to accomplish if you're producing on a budget.

There are many aspects of production that introduce latency. Starting with 'in camera' latency, through various converters HDMI-SDI etc, cable types and ending with the projector itself ( project scaling etc ) it all adds up. Knowing what to buy really does make a difference here, so search out someone in ur area as an adviser who has knowledge of this.

Watching the BBC's coverage of Glastonbury these last few evenings there were many occasions where lip sync was off between the artist and the big screens. (and I wouldn't call Glastonbury low budget)

DWAM  
#6 Posted : Monday, June 26, 2017 4:27:09 PM(UTC)
DWAM

Rank: Advanced Member

Groups: Registered
Joined: 3/20/2014(UTC)
Posts: 2,721
Man
France
Location: Bordeaux, France

Thanks: 243 times
Was thanked: 794 time(s) in 589 post(s)
Quote:
I looked at your video, but there was no way to see the delay as it didn't look like you were running live feed back to the screen?

Yep sorry I should have indicated moments where you can see it. An example:
?t=27m15s

You will get more than 50ms with ATEMs. I just did a production with them, it's more like 4 frames, so around 100/125ms... And we had Led walls, not a beamer.

As of analogway, you're right. If you don't have a real budget, there is NO WAY to get 0 (or acceptable) latency.

The cheapest solution is certainly what I already told you: use a video router.

Guillaume
thecloudmediagroup  
#7 Posted : Tuesday, June 27, 2017 12:11:38 AM(UTC)
thecloudmediagroup

Rank: Advanced Member

Groups: Registered
Joined: 2/27/2013(UTC)
Posts: 312
Man
United States

Thanks: 8 times
Was thanked: 78 time(s) in 43 post(s)
We get about 175 milliseconds or so of latency which is acceptable to me. The people in the audio booth that get a live audio signal and the slightly delayed video feed do not notice a sync issue with speech and video. Acceptable is a subjective term.

If you go with vMix for the IMAG solution I would definitely use the Magewell capture cards and output your signal in 60p. The faster frame rate cuts down your latency because vMix is able to send out a frame after a 60th of a second instead of a 30th of a second. Also send the native resolution to your screen to cut down any latency with scaling.

We have been doing IMAG with vMix in our church for probably 4 years. The video below is an older video with a hair more latency than we have now.

thanks 1 user thanked thecloudmediagroup for this useful post.
stigaard on 9/2/2017(UTC)
lael  
#8 Posted : Tuesday, June 27, 2017 4:52:29 AM(UTC)
lael

Rank: Advanced Member

Groups: Registered
Joined: 2/18/2017(UTC)
Posts: 75

Thanks: 22 times
Was thanked: 4 time(s) in 4 post(s)
Thanks for posting - I saw your example from your post back in 2014 on these forums and was curious if it had changed. Are you recommending magewell cards over blackmagic ones?

What connections do you have in play for this from camera to projector? What have you done to decrease latency since then?


thecloudmediagroup wrote:
We get about 175 milliseconds or so of latency which is acceptable to me. The people in the audio booth that get a live audio signal and the slightly delayed video feed do not notice a sync issue with speech and video. Acceptable is a subjective term.

If you go with vMix for the IMAG solution I would definitely use the Magewell capture cards and output your signal in 60p. The faster frame rate cuts down your latency because vMix is able to send out a frame after a 60th of a second instead of a 30th of a second. Also send the native resolution to your screen to cut down any latency with scaling.

We have been doing IMAG with vMix in our church for probably 4 years. The video below is an older video with a hair more latency than we have now.


richardgatarski  
#9 Posted : Tuesday, June 27, 2017 9:13:10 AM(UTC)
richardgatarski

Rank: Advanced Member

Groups: Registered
Joined: 2/18/2014(UTC)
Posts: 1,837
Location: Stockholm

Thanks: 144 times
Was thanked: 297 time(s) in 250 post(s)
In addition to what is said above there is also a Performance setting in vMix for "Low latency capture". We use that, and 50p input, sending out to IMAG via a Fullscreen output, which gives is an "acceptable" latency. Sometimes, when posible, the PA audio is slightly delayed (say 50 ms) that help a bit. We have used an ATEM TV studio for IMAG only, but the marginal gain is not worth the extra cost/setup time (we typically do production at different conference venues).

You can estimte the latency we have in this clip. Best is to compare the hand movements (stage vs IMAG), as the audio recording is not from a mike in the room, but from the house mixer into our production system where we added some delay to compensate for other stuff.

If you intend to route video via NDI and then to IMAG, you will most likely see the delay Guillaume demonstrates.

BTW, Guillaume: in your two-step setup, why don't you do the IMAG switching in vMix 1 (with camera Inputs), and the "full production" in the vMix 2 (fed via NDI from the first)? This way you would eliminate the NDI latency...
thanks 2 users thanked richardgatarski for this useful post.
DVE on 8/10/2017(UTC), lael on 8/16/2017(UTC)
DWAM  
#10 Posted : Tuesday, June 27, 2017 10:49:22 AM(UTC)
DWAM

Rank: Advanced Member

Groups: Registered
Joined: 3/20/2014(UTC)
Posts: 2,721
Man
France
Location: Bordeaux, France

Thanks: 243 times
Was thanked: 794 time(s) in 589 post(s)
Quote:
BTW, Guillaume: in your two-step setup, why don't you do the IMAG switching in vMix 1 (with camera Inputs), and the "full production" in the vMix 2 (fed via NDI from the first)? This way you would eliminate the NDI latency...

3 main reasons:
- the first one is I prefer to do the production recording and streaming over uncompressed signals rather than NDI feeds.
- I also measured that the loss is close to null when doing so. NDI inputs in vMix are immediately available to network. It's quicker to send an input via NDI to another computer than to display it to vMix output. The whole process is around 2ms. Saving 2ms is not enough to improve significantly the IMAG workflow imho (and not interesting enough to convince me to do the production on NDI feeds > point #1)
- at the time I did this particular production I also had hardware and licence considerations to deal with

I also remember it was easier to do that way as we had to provide audio to the PA for some media we had to deal with, so only vMix2 was plugged to the PA mixer while playing the media and at the same time providing vMix1 with the slides screen captures and the videos feeds over NDI. This way, audio and video sync was perfect for the audience in the venue. And it was easy for the audio guy to send everything but vMix2 to vMix1 via an AUX out.

Since that I could experiment another workflow using a SmartSwitch video router which gave us close to perfect results:

- all cams going to the video router
- vMix1 getting all cams from the video router
- vMix2 getting all cams from vMix1 over NDI (vMix was a laptop without capture card)
- vMix2 output going to the video router

- one destination output of the router going to the beamer directly
- then just have to "switch" inputs for this destination between cam2 (the close-up shot) and vMix2 output mainly for multiviews, slides, media, etc...

This way when the close-up shot is fullscreen on the beamer, there is no latency at all and about 6 or 7 frames for everything else which was only visible when using the close-up shot inside a multiview.

For better solution, using an Analogway is compulsary.
thanks 3 users thanked DWAM for this useful post.
richardgatarski on 6/27/2017(UTC), DVE on 8/10/2017(UTC), lael on 8/16/2017(UTC)
thecloudmediagroup  
#11 Posted : Tuesday, June 27, 2017 12:47:12 PM(UTC)
thecloudmediagroup

Rank: Advanced Member

Groups: Registered
Joined: 2/27/2013(UTC)
Posts: 312
Man
United States

Thanks: 8 times
Was thanked: 78 time(s) in 43 post(s)
lael wrote:
Thanks for posting - I saw your example from your post back in 2014 on these forums and was curious if it had changed. Are you recommending magewell cards over blackmagic ones?

What connections do you have in play for this from camera to projector? What have you done to decrease latency since then?


thecloudmediagroup wrote:
We get about 175 milliseconds or so of latency which is acceptable to me. The people in the audio booth that get a live audio signal and the slightly delayed video feed do not notice a sync issue with speech and video. Acceptable is a subjective term.

If you go with vMix for the IMAG solution I would definitely use the Magewell capture cards and output your signal in 60p. The faster frame rate cuts down your latency because vMix is able to send out a frame after a 60th of a second instead of a 30th of a second. Also send the native resolution to your screen to cut down any latency with scaling.

We have been doing IMAG with vMix in our church for probably 4 years. The video below is an older video with a hair more latency than we have now.




I would definitely recommend Magewell over Black Magic. Black Magic cards work, but I've seen consistently lower latency with Magewell.

Our main camera is going HDMI over Cat 5 cable to our vMix machine. I want to say we changed the output resolution of the TV to its native resolution which was 1376x768 or something close to that. I would say your TV or Projector scaling your image to its native resolution can add an easy 50ms of delay or so. That's one of the first things I would check.

Make sure your low latency check box is selected as well.
thanks 3 users thanked thecloudmediagroup for this useful post.
DVE on 8/10/2017(UTC), lael on 8/16/2017(UTC), stigaard on 9/2/2017(UTC)
stevespaw  
#12 Posted : Tuesday, June 27, 2017 1:18:00 PM(UTC)
stevespaw

Rank: Advanced Member

Groups: Registered
Joined: 3/12/2015(UTC)
Posts: 482
Man
Location: Kansas City, MO USA

Thanks: 151 times
Was thanked: 75 time(s) in 57 post(s)
We have used a Tricaster for years with IMag events for very large corporate events and never had a complaint. vMix does have more. A BlackMagic ATEM is a hardware switcher with no scaling, it is as low as an AnalogWay. With scaling on, the AnalogWay is more.

All of this depend dramatically on the size of the venue Just the audio delay in a lager space is usually a much bigger issue.

My 2 cents, :-)

Steve
thanks 2 users thanked stevespaw for this useful post.
DVE on 8/10/2017(UTC), lael on 8/16/2017(UTC)
DVE  
#13 Posted : Thursday, August 10, 2017 4:50:54 PM(UTC)
DVE

Rank: Advanced Member

Groups: Registered
Joined: 6/2/2016(UTC)
Posts: 40
Man
Location: Everett, WA

Thanks: 11 times
Was thanked: 3 time(s) in 3 post(s)
Very helpful thread. Thanks guys!
livingwell  
#14 Posted : Thursday, August 31, 2017 2:40:26 PM(UTC)
livingwell

Rank: Member

Groups: Registered
Joined: 8/30/2017(UTC)
Posts: 18
Location: Salem, VA

Thanks: 2 times
Was thanked: 2 time(s) in 2 post(s)
stevespaw wrote:
We have used a Tricaster for years with IMag events for very large corporate events and never had a complaint. vMix does have more. A BlackMagic ATEM is a hardware switcher with no scaling, it is as low as an AnalogWay. With scaling on, the AnalogWay is more.

All of this depend dramatically on the size of the venue Just the audio delay in a lager space is usually a much bigger issue.

My 2 cents, :-)

Steve


I wonder how much more Vmix Can be optimized to get even lower latency in the future? Tricaster is Software based as well just paired with hardware so it can be done..

Right now we are getting 6 frames of latency with our testing. That's with my personal Ursa mini's SDI going into my decklink quad, then into vmix, out the Nvidia 1050 Ti HDMI port, into an HDMI->SDI converter, Distribution AMP, then out to the projector and TVs from that.

I may try removing the Distribution amp and see how much that cuts down. We are looking at getting PTZs with NDI on them for when we buy cameras soon. It looks like the Blackamgic Decklink Quad is putting about 3 frames of latency in itself.
kane  
#15 Posted : Thursday, August 31, 2017 5:04:16 PM(UTC)
kane

Rank: Advanced Member

Groups: Registered
Joined: 3/24/2016(UTC)
Posts: 331
Location: Chicago, IL

Was thanked: 143 time(s) in 94 post(s)
livingwell wrote:

I wonder how much more Vmix Can be optimized to get even lower latency in the future? Tricaster is Software based as well just paired with hardware so it can be done..


TriCaster is mostly software, but it is running our own built video IO hardware and drivers so we can talk to it directly to make it operate as desired. With 3rd party video IO cards you have to use the provided API to access the device.

Kane Peterson
NewTek
Thremir  
#16 Posted : Thursday, August 31, 2017 7:43:52 PM(UTC)
Thremir

Rank: Advanced Member

Groups: Registered
Joined: 9/17/2013(UTC)
Posts: 173
Man
Location: Norway

Thanks: 10 times
Was thanked: 56 time(s) in 29 post(s)
Quote:
I wonder how much more Vmix Can be optimized to get even lower latency in the future? Tricaster is Software based as well just paired with hardware so it can be done..

Right now we are getting 6 frames of latency with our testing. That's with my personal Ursa mini's SDI going into my decklink quad, then into vmix, out the Nvidia 1050 Ti HDMI port, into an HDMI->SDI converter, Distribution AMP, then out to the projector and TVs from that.

I may try removing the Distribution amp and see how much that cuts down. We are looking at getting PTZs with NDI on them for when we buy cameras soon. It looks like the Blackamgic Decklink Quad is putting about 3 frames of latency in itself.


Beware that the Ursa Mini has some extra frames of delay on the sdi out!!
livingwell  
#17 Posted : Thursday, August 31, 2017 11:09:58 PM(UTC)
livingwell

Rank: Member

Groups: Registered
Joined: 8/30/2017(UTC)
Posts: 18
Location: Salem, VA

Thanks: 2 times
Was thanked: 2 time(s) in 2 post(s)
Thremir wrote:


Beware that the Ursa Mini has some extra frames of delay on the sdi out!!


I figured it did, they're just what I have on hand for my film making. Any ideas how much delay is on the ursa mini itself? We picked up a PTZ Optics 20x SDI Gen2 to test with which we hope to upgrade to NDI firmware after we get it.
livingwell  
#18 Posted : Friday, September 1, 2017 9:26:43 AM(UTC)
livingwell

Rank: Member

Groups: Registered
Joined: 8/30/2017(UTC)
Posts: 18
Location: Salem, VA

Thanks: 2 times
Was thanked: 2 time(s) in 2 post(s)
kane wrote:
livingwell wrote:

I wonder how much more Vmix Can be optimized to get even lower latency in the future? Tricaster is Software based as well just paired with hardware so it can be done..


TriCaster is mostly software, but it is running our own built video IO hardware and drivers so we can talk to it directly to make it operate as desired. With 3rd party video IO cards you have to use the provided API to access the device.

Kane Peterson
NewTek


With NDI the at somepoint could become mostly a thing of the past though.

I'd love to see a Tricaster system demo someday if you guys ever came through the area, It's way way outside the budget for my church but my film production company keeps getting asked to do IMAG for concerts/touring acts so it may be something we have to look into down the road.

BTW, do you happen to know anything about this? https://forums.vmix.com/...aspx?g=posts&t=11644
livingwell  
#19 Posted : Friday, September 1, 2017 6:32:36 PM(UTC)
livingwell

Rank: Member

Groups: Registered
Joined: 8/30/2017(UTC)
Posts: 18
Location: Salem, VA

Thanks: 2 times
Was thanked: 2 time(s) in 2 post(s)
I guess I can't really ask for much more. Vmix is putting out 1 frames delay (render time stays at 1ms), and I have tested it with timecode pictures. The Ursa mini is the worst at 3 frames latency and the projector is 2-3 frames. So If I can get lower latency out of the PTZOptics 20x-SDI and work on the projector some I can get in an acceptable range I hope. I want to be at 3-4 frames latency.
kane  
#20 Posted : Saturday, September 2, 2017 12:53:55 AM(UTC)
kane

Rank: Advanced Member

Groups: Registered
Joined: 3/24/2016(UTC)
Posts: 331
Location: Chicago, IL

Was thanked: 143 time(s) in 94 post(s)
livingwell wrote:

BTW, do you happen to know anything about this? https://forums.vmix.com/...aspx?g=posts&t=11644


The LC11 (or any of the NewTek control surfaces) use their own protocol for communication, they do not appear as a keyboard or MIDI device.

Kane Peterson
NewTek
thanks 1 user thanked kane for this useful post.
livingwell on 9/2/2017(UTC)
Users browsing this topic
Guest
Forum Jump  
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.