vMix Forums
»
General
»
Feature Requests
»
Automated video mixing linked to audio input
Rank: Member
Groups: Registered
Joined: 4/16/2016(UTC)
Posts: 10
Location: Norway
Thanks: 2 times
|
The main Norwegian TV broadcaster (NRK) has made a system to automate video mixing of radio programs. The system does something like this: - When a person talks, this person is live. - When two or more talks at the same time, a camera covering everyone is live. - When a person talks for a long time, the previous person is live for a certain amount of time before switching back. As you probably understand, it uses audio to de the switching. Each camera is “linked” to the audio from that person. But it also has some algorithms which makes the switching looks more human. Their self-made system is called AutoCam and is used when there is only radio people at work (eg during nights shows). The show host can overrun the automated video mixing with an x-key stick. Here is a link to an article (on Norwegian!) about a maraton radio show where this system was used during night: https://nrkbeta.no/2016/...-tv-fra-p3aksjonen-2016/ At least you can see the pictures.:) This feature in vmix could be very interesting for - radio stations wanting a to do a video stream of their shows - churches wanting to stream their services - video podcasters wanting to concentrate more on content and guests (also on vmix-call) than switching between cameras. At least I would be very interested. There was a topic about automated mixing a year ago, but it seems this is differs from what I am suggesting. https://forums.vmix.com/....aspx?g=posts&t=6280Best regards Runar
|
|
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 3/7/2012(UTC) Posts: 2,636  Location: Canada Thanks: 33 times
Was thanked: 506 time(s) in 475 post(s)
|
@ RabR This "plug-in" was developed a few years ago by Sondrey, and AFAIK taken over by Tom Sinclair at Eastern Shore Broadcasting, but I'm not sure where it stands now (I assume it is still available) https://forums.vmix.com/....aspx?g=posts&t=3678Hope that helps some. Ice
|
 1 user thanked IceStream for this useful post.
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 8/2/2013(UTC) Posts: 1,072  Location: Fairhope, Alabama USA Thanks: 553 times
Was thanked: 200 time(s) in 166 post(s)
|
|
|
|
|
|
|
Rank: Member
Groups: Registered
Joined: 4/16/2016(UTC)
Posts: 10
Location: Norway
Thanks: 2 times
|
Thank you for showing me this thread about this software.
It seems though that vMix Audio Controlled Switcher (ACS) has no “intelligence”. It just switches when the audio level is passing a certain point. Maybe Tom Sinclair could tell more about this.
The NRK AutoCam is also “thinking” a bit like a human producer. As far as I know it does these things (and I guess more):
- When a person has been speaking for a certain time, it switches back to the previous person for a certain amount of time before it goes back again to the speaker.
- It is delaying before changing camera angel based on when it did the last switching – to prevent too fast switching.
- When there is silence more than a certain number of seconds, it goes to the wide shot.
All this programming is made to make it look more professional and not only trigged by audio.
As it is said in the other thread, it is possible to use audio triggers in vmix to do something similar to the ACS plugin, but I think this will be too simplistic.
Maybe Martin & Co will be hesitant to make this a feature of vmix since Eastern Shore Broadcasting is selling the ACS plugin that seem to do a simplified version of it. But I think it would be very nice if the vmix-team would look into it and making this a feature of a future version of vmix! :)
|
|
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 3/20/2014(UTC) Posts: 2,721  Location: Bordeaux, France Thanks: 243 times
Was thanked: 794 time(s) in 589 post(s)
|
Hi Runar
the latest (beta) version of vMixUTC introduced "conditions" for triggers.
I have not experimented myself what you're asking for but I feel like it's doable. Input switching based on audio already works nicely, there must be a way for dealing with all your expectations.
Guillaume
|
|
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 10/13/2012(UTC) Posts: 1,162  Location: Melbourne Thanks: 220 times
Was thanked: 199 time(s) in 181 post(s)
|
The ACS program does have a bit more smarts in it than you suggest. The best way to see if it will meet your needs is to purchase it and try. It is not expensive. Then as a paying customer ask for some enhancements. Tom and the developers are responsive
|
|
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 8/2/2013(UTC) Posts: 1,072 Location: Fairhope, Alabama USA Thanks: 553 times
Was thanked: 200 time(s) in 166 post(s)
|
With the demise of the ACS software, we are left with vMix switching cameras based on the volume of any given mic. That actually works very well.
There is another feature of ACS that is not covered by vMix Trigger function and that is the situation when two mic trigger camera cuts at the same time.
It would be a great new feature of Triggers to solve this problem.
- Tom
P.S. I get emails from people wanting this feature about this every week!
|
|
|
|
|
|
Rank: Member
Groups: Registered
Joined: 4/28/2018(UTC)
Posts: 25
Location: NZ
Was thanked: 7 time(s) in 3 post(s)
|
Do we have a solution for this yet?
Has anyone come across a solution for audio controlled switching in 2019.
|
|
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 12/27/2012(UTC) Posts: 5,218  Location: Belgium Thanks: 291 times
Was thanked: 955 time(s) in 790 post(s)
|
Quote:Has anyone come across a solution for audio controlled switching in 2019. Does yelling at an operator count ? (sorry couldn't resist ) I do know yelling at the computer now works (the vMix voice control)
|
|
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 4/23/2017(UTC) Posts: 1,214 Location: Germany Thanks: 3 times
Was thanked: 168 time(s) in 150 post(s)
|
With a Sennheiser TCC2 microphone you can get the room coordinates for the source it detects and send those to control a PTZ cam. This wouldn't be exactly what you intend to do but maybe a first step.
|
|
|
|
|
|
vMix Forums
»
General
»
Feature Requests
»
Automated video mixing linked to audio input
Forum Jump
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.
Important Information:
The vMix Forums uses cookies. By continuing to browse this site, you are agreeing to our use of cookies.
More Details
Close
