vMix Forums
»
General
»
General Discussion
»
match slider movement to keyed Background
Rank: Newbie
Groups: Registered
Joined: 12/17/2022(UTC) Posts: 5 ![Germany Germany](/Content/images/flags/DE.png) Thanks: 3 times
|
Hello there!
we have a Basic Studio setup, 3 Cameras, all static, with a greenscreen in the Background. Now we want to have more movement in our daily business and were thinking about getting a motorized-slider + cam. Now since we are using greenscreen to generate our BG, we can setup two scenes with a Background that is tilted towards the right in one and towards the left in the other and is moved via merge. now wer want to set up some sort of api trickery to control the scene in Vmix at the same merge speed, that roughly matches the sliders Paralax-ish shot. Has anybody did something like this and can share some insight on our idea? For testing we thought about something like the NEEWER ER1 Motorized Carbon Fiber Camera Slider.
BTW: No Keying in post is not an option since most productions are streamed live ;)
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 10/6/2020(UTC) Posts: 98 ![France France](/Content/images/flags/FR.png) Was thanked: 21 time(s) in 21 post(s)
|
The human eye is remarkably sensitive to movements that don't look right, so if the transition speed doesn't match the movement of the slider, it will look wonky. I would guess that the slider has a speed curve, with an acceleration and deceleration to avoid hard stops and starts, which you will also need to match if you don't want things to look wonky.
Generally speaking, for dynamic background replacement like you have in mind, you would need some kind of motion tracking system sending data to graphics software which renders the background in real time. For example, some PTZ cameras emit tracking data so that a virtual camera in the graphics software can replicate the PTZ values, rendering out the background from the point-of-view of the real camera. Unity and Unreal are often used for 3D virtual sets, as well as TouchDesigner and Notch, as they can render out the background in real-time and send the image to the video-switcher as a background for the keyed camera shot.
Having said all that, if your background is a 2D image which could be repositioned to match the motion of the slider, it might be worth trying a simpler approach...
You might want to look into whether the slider controller can send out tracking values, with real-time data about the position of the slider. If so, a software package like TouchDesigner or Chataigne, that can read in values from one system, remap the values to another range and send them as commands to vMix, might allow you to move the background layer in response to the slider position. For example, the vMix web API has a 'SetPanX' command, which could move the position of a background image. The SetPanX command takes a value between -2 (full left) and 2 (full right), while the slider might send out values between 0 and 65535 (or some other range of values), hence the need for some 'translation' by other software in-between.
|
![thanks](/Themes/yafpro/heart_small.png) 1 user thanked matkeane for this useful post.
|
|
|
Rank: Newbie
Groups: Registered
Joined: 12/17/2022(UTC) Posts: 5 ![Germany Germany](/Content/images/flags/DE.png) Thanks: 3 times
|
yes, we thought about the "wonkyness" and the test will show how it turns out. I thought about the implementation of Unreal or unity, but i have never worked with either of those and we wanted to find out, if there was a way of getting it to work without an engine live rendering everything Background related. Plus we have a single PC controlling vmix and everything else in the ecosystem and i was afraid, that a live-render would stress the system too much, making it unstable...
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 4/23/2017(UTC) Posts: 1,174 ![Man Man](/Themes/yafpro/male.gif) Location: Germany Thanks: 3 times Was thanked: 167 time(s) in 149 post(s)
|
How about pre-producing the background move. Then when you switch to the slide cam you trigger the background movie as well. Or but them into layers. Another option is using a virtual set in vMix. You can set the speed to custom matching the slide duration. Professionally one would use a cam tracker like Stype and use that data to live render a 3D scene on LED background. A good demo is from last IBC
|
![thanks](/Themes/yafpro/heart_small.png) 1 user thanked mavik for this useful post.
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 10/6/2020(UTC) Posts: 98 ![France France](/Content/images/flags/FR.png) Was thanked: 21 time(s) in 21 post(s)
|
Originally Posted by: mavik ![Go to Quoted Post Go to Quoted Post](/Themes/yafpro/icon_latest_reply.gif) How about pre-producing the background move. Then when you switch to the slide cam you trigger the background movie as well. That's a really good idea! To build on it - you could film a tracking marker in your studio using the slider, so as to record the real move - speed curves and all - then track the movement in something like After Effects to get a perfectly matched animated background. You'd just have to be sure that you can sync the trigger of the slider and the background animation - A client of mine has a slider that just slides back-and-forth infinitely (or until the batteries run out!) but I don't think it sends a trigger when it starts a move.
|
![thanks](/Themes/yafpro/heart_small.png) 1 user thanked matkeane for this useful post.
|
|
|
Rank: Newbie
Groups: Registered
Joined: 12/17/2022(UTC) Posts: 5 ![Germany Germany](/Content/images/flags/DE.png) Thanks: 3 times
|
Okay, thank you so much for the ideas, Yeah we have tried out some stuff with the virtual studio, and thats kind of the way we thought to go. Stype looks very interesting, i am going to take a look at that!
|
|
|
|
Rank: Newbie
Groups: Registered
Joined: 12/17/2022(UTC) Posts: 5 ![Germany Germany](/Content/images/flags/DE.png) Thanks: 3 times
|
Originally Posted by: matkeane ![Go to Quoted Post Go to Quoted Post](/Themes/yafpro/icon_latest_reply.gif) Originally Posted by: mavik ![Go to Quoted Post Go to Quoted Post](/Themes/yafpro/icon_latest_reply.gif) How about pre-producing the background move. Then when you switch to the slide cam you trigger the background movie as well. That's a really good idea! To build on it - you could film a tracking marker in your studio using the slider, so as to record the real move - speed curves and all - then track the movement in something like After Effects to get a perfectly matched animated background. You'd just have to be sure that you can sync the trigger of the slider and the background animation - A client of mine has a slider that just slides back-and-forth infinitely (or until the batteries run out!) but I don't think it sends a trigger when it starts a move. that is a very smart idea, so we can eliminate the curve speed issue! Thank you!
|
|
|
|
Rank: Advanced Member
Groups: Registered
Joined: 3/7/2012(UTC) Posts: 2,622 ![Man Man](/Themes/yafpro/male.gif) Location: Canada Thanks: 33 times Was thanked: 503 time(s) in 472 post(s)
|
I am curious to know how much “untracked” camera movement you can get away with. Software like Vset 3D and Wasp3D show samples of stationary cameras used in 3D sets which look pretty convincing, so a lot will depend on the parallax movement and angle changes in relation to the camera’s footprint on the background. I am guessing a smaller subject (standing talent) on a large set is less “disruptive” to the human brain than a larger footprint item (like a desk and/or medium shot or CU of talent) which will require “coordinated” or tracked camera movements.
Ice
|
|
|
|
vMix Forums
»
General
»
General Discussion
»
match slider movement to keyed Background
Forum Jump
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.
Important Information:
The vMix Forums uses cookies. By continuing to browse this site, you are agreeing to our use of cookies.
More Details
Close