logo

Live Production Software Forums


Welcome Guest! To enable all features please Login or Register.

Notification

Icon
Error

Options
Go to last post Go to first unread
JoostH  
#1 Posted : Thursday, April 22, 2021 6:40:00 PM(UTC)
JoostH

Rank: Member

Groups: Registered
Joined: 11/30/2020(UTC)
Posts: 29
Netherlands

Thanks: 1 times
I'm trying to improve my chroma key setup. I'm struggling with a green contour, mainly around my hair. This is puzzling me because I use blue screen as background. (I want to use blue because I've greenish eyes, I don't wear blue cloths and I want to background to be blue-ish anyhow). In the first image you see the bare setup. The lighting setup consists of two lamps for the foreground (me) and three for the background. It could still be a bit better, but I'd expect this to be good enough (right?)

vMix Capture 22 april 2021 09-46-10.jpg (107kb) downloaded 13 time(s).

The second image shows my problem in a very exaggerated way. I've selected the backround with the Chroma Key colour picker but set the Chroma Key Filter slider to zero. Where does this green color come from?? I'd understand if it would be blue. Apparently this is something in the chroma key algorithm. Do I miss something?

vMix Capture 22 april 2021 09-47-56.jpg (168kb) downloaded 2 time(s).

Chroma Key Filter slider to 40%. Still exaggerated, but shows the actual problem best. If the green halo would be sam colour as my background, it would already be more acceptable

vMix Capture 22 april 2021 09-48-44.jpg (225kb) downloaded 0 time(s).

Chroma Key Filter slider to 80% This is the best I get without anti aliasing. Not REALLY bad, but if one is critical there are too many artifacts: this is eating into my contours, in my righ sleeve the chair is shining through and there is still some green contour. Moreover, this setting is a critical comprimise. With a slight change in lighting conditions or clothing, it already shifts.

vMix Capture 22 april 2021 09-50-49.jpg (227kb) downloaded 2 time(s).


A bit better wrt the contour is Chroma Key Filter slider to 80% + medium Anti aliasing. However, the anti- aliasing only masks the green and it adds other artifacts.


vMix Capture 22 april 2021 09-51-31.jpg (222kb) downloaded 1 time(s).

My questions to you:

  1. Where does the green halo come from? Can I change it to colour of the background?
  2. Is this the best result I can expect in vMix? If not, would could I do more to improve it?
  3. Is there an option to add a possibly more advanced (more refined, more robust) chroma key solution in the system (for a reasonable budget)?
  4. Am I unrealistically critical for this budget?


Thanks in advance!

Joost
ask  
#2 Posted : Friday, April 23, 2021 11:15:45 AM(UTC)
ask

Rank: Advanced Member

Groups: Registered
Joined: 10/13/2012(UTC)
Posts: 1,161
Australia
Location: Melbourne

Thanks: 220 times
Was thanked: 199 time(s) in 181 post(s)
This is a lighting issue. Do a google search for "3 point lighting chromakey" and read up/watch some of the results.

You can also try moving your "blue screen" further back to reduce any spill.
JoostH  
#3 Posted : Friday, April 23, 2021 6:37:05 PM(UTC)
JoostH

Rank: Member

Groups: Registered
Joined: 11/30/2020(UTC)
Posts: 29
Netherlands

Thanks: 1 times
Originally Posted by: ask Go to Quoted Post
This is a lighting issue. Do a google search for "3 point lighting chromakey" and read up/watch some of the results.

You can also try moving your "blue screen" further back to reduce any spill.


Thanks for your reply and suggestions. Space is very tight unfortunately. At least for now, I have to deal with a distance of 1-1.5m between me and the background. The lighting setup is a 5 point one: 2 foreground (left/right) + 3 background (left/right/top-middle). If you say "lighting issue", I can think of two different improvement directions:

  1. further improving the background lighting: more even, brighter
  2. adding a separation light (lighting the head and shoulders from the back) to separate hair and background better


Frankly, I've avoided the separation light so far as, to my feeling this would also be unnatural for informal the living room feel that I like to achieve. But perhaps I just have to. That would also give more room to brighten the background and not interfer with the hair. I don't notice much spill, so that is not my main consideration for now.

What is likely to give the most contribution? Or do I really have to do all?
Vince Beck  
#4 Posted : Saturday, April 24, 2021 4:09:28 AM(UTC)
Vince Beck

Rank: Advanced Member

Groups: Registered
Joined: 7/28/2019(UTC)
Posts: 351
United States
Location: Santa Rosa

Thanks: 1 times
Was thanked: 51 time(s) in 51 post(s)
Honestly, your lighting is not bad. Yes, you usually need at least 3 meters between you and the screen, but this should not be this bad.

You do have lighter hair, which the blue screen should be better for. Maybe reach out to Martin, since they probably only tested on green screens.


matkeane  
#5 Posted : Saturday, April 24, 2021 7:13:50 PM(UTC)
matkeane

Rank: Advanced Member

Groups: Registered
Joined: 10/6/2020(UTC)
Posts: 98
France

Was thanked: 21 time(s) in 21 post(s)
i agree that the lighting setup is not bad at all given the physical constraints of the space you're in.

Quote:
1. further improving the background lighting: more even, brighter


Brighter is not necessarily better. If anything a slightly underexposed, evenly-lit chroma backdrop is easier to key than an overexposed one, as hotspots wash out the colour. You can use the RGB parade view, or the zebra function in a video camera, to check for lighter areas on your bluescreen. Don't worry about vignetting as you can crop stuff near the edges, but try to get even exposure around your subject.

Quote:
2. adding a separation light (lighting the head and shoulders from the back) to separate hair and background better


A backlight often helps reduce colour fringing around the edges. I'd be tempted to see if you can get away with just 2 lights on your backdrop, and use the top one - which is currently creating a little hotspot above you - as a rim light on your hair and shoulders. And, if your replacement background image of the living room had a table lamp in there behind you, it would be coherent with the lighting setup and not look strange.

It's been years since I used a blue screen, and green screen dominates chroma setups to the extent that I do wonder if some keying algorithms make assumptions about key colour & spill correction, which might explain the green fringe you're seeing. If you've ever used something like the Keylight plug-in for post-production keying, there are a lot of parameters to tweak in order to pull a nice key, so a real-time key with only 2 sliders is going to have to compromise somewhere. I'm not aware of anything in the same price range as vMix that offers a real-time tweakable chroma key. An external software keyer will cost you some latency (at best a roundtrip via NDI), and hardware keyers were traditionally very expensive, although the Blackmagic Atem switchers include a keyer, but I've never tried it.
JoostH  
#6 Posted : Sunday, April 25, 2021 1:10:57 AM(UTC)
JoostH

Rank: Member

Groups: Registered
Joined: 11/30/2020(UTC)
Posts: 29
Netherlands

Thanks: 1 times
Originally Posted by: Vince Beck Go to Quoted Post
Honestly, your lighting is not bad. Yes, you usually need at least 3 meters between you and the screen, but this should not be this bad.

You do have lighter hair, which the blue screen should be better for. Maybe reach out to Martin, since they probably only tested on green screens.




Thanks for your comment, I've reached out to Martin for an explanation of the green fringes.

JoostH  
#7 Posted : Sunday, April 25, 2021 1:23:16 AM(UTC)
JoostH

Rank: Member

Groups: Registered
Joined: 11/30/2020(UTC)
Posts: 29
Netherlands

Thanks: 1 times
Originally Posted by: matkeane Go to Quoted Post
i agree that the lighting setup is not bad at all given the physical constraints of the space you're in.

Quote:
1. further improving the background lighting: more even, brighter


Brighter is not necessarily better. If anything a slightly underexposed, evenly-lit chroma backdrop is easier to key than an overexposed one, as hotspots wash out the colour. You can use the RGB parade view, or the zebra function in a video camera, to check for lighter areas on your bluescreen. Don't worry about vignetting as you can crop stuff near the edges, but try to get even exposure around your subject.

Thanks for the confirmation and further suggestions.


Originally Posted by: matkeane Go to Quoted Post


Quote:
2. adding a separation light (lighting the head and shoulders from the back) to separate hair and background better


A backlight often helps reduce colour fringing around the edges. I'd be tempted to see if you can get away with just 2 lights on your backdrop, and use the top one - which is currently creating a little hotspot above you - as a rim light on your hair and shoulders. And, if your replacement background image of the living room had a table lamp in there behind you, it would be coherent with the lighting setup and not look strange.


I'm planning an experiment. The suggestion of the fake table lamp is a nice one. Although for day-time streams (I use this for live telco's and webinars) it could be still a bit weird. But it's worth a try.


Originally Posted by: matkeane Go to Quoted Post

It's been years since I used a blue screen, and green screen dominates chroma setups to the extent that I do wonder if some keying algorithms make assumptions about key colour & spill correction, which might explain the green fringe you're seeing. If you've ever used something like the Keylight plug-in for post-production keying, there are a lot of parameters to tweak in order to pull a nice key, so a real-time key with only 2 sliders is going to have to compromise somewhere.

That's a fair comment. I reached out to Martin to get his input on this.


Originally Posted by: matkeane Go to Quoted Post

I'm not aware of anything in the same price range as vMix that offers a real-time tweakable chroma key. An external software keyer will cost you some latency (at best a roundtrip via NDI), and hardware keyers were traditionally very expensive, although the Blackmagic Atem switchers include a keyer, but I've never tried it.


Actually, your comment plus some searching pointed me to the BM ATEM mini. Price point (under 300$) would be acceptable to me, if it really solves this issue. I've found some nice demo's, unfortunately from guys with either a cap or a sleeker hairdo then mine ;). Worth some further research.

Thnx!!!!!

Anyone here with handson experience with the Black Magic ATEM mini????
JoostH  
#8 Posted : Sunday, April 25, 2021 3:39:32 AM(UTC)
JoostH

Rank: Member

Groups: Registered
Joined: 11/30/2020(UTC)
Posts: 29
Netherlands

Thanks: 1 times
I did some further research on the BlackMagic ATEM line. I turns out that the ATEM mini line (cheapest version 265 euro) has a different keyer than the regular (non-mini) line. The cheapest version of that line is 875 euro. That is too expensive in my case, and feature wise not as handy for als the mini. I find very good reviews and demos on the keyer of the regular line. The demos of the mini line are inconclusive for me.

Anyone experience?
admin  
#9 Posted : Sunday, April 25, 2021 3:56:51 PM(UTC)
admin

Rank: Administration

Groups: Administrators
Joined: 1/13/2010(UTC)
Posts: 5,137
Man
Location: Gold Coast, Australia

Was thanked: 4135 time(s) in 1487 post(s)
I have sent an email, but also will reply here for the benefit of others.

Take a look at the blue screens colours in a photo editing app (I am using Paint.Net as an example).
Use the eye dropper tool to pick a colour and look at the RGB values.

Note the green is very high, almost as high as the blue at some points.
This means it is not really a blue screen at all, due to camera white balance, lighting, the screen or simply
because blue is not a very good colour for keying with digital video cameras.

Green screens have a much easier colour separation due to how camera sensors work and should pretty much always be used
unless it is critical to have something green in the scene.

Regards,

Martin
vMix
thanks 1 user thanked admin for this useful post.
eduardocfs on 4/25/2021(UTC)
JoostH  
#10 Posted : Sunday, April 25, 2021 9:18:19 PM(UTC)
JoostH

Rank: Member

Groups: Registered
Joined: 11/30/2020(UTC)
Posts: 29
Netherlands

Thanks: 1 times
Indeed I've had some further conversation with this with Martin. Apparently the issue is too complex to explain without going in the details of the algorithm. My simplified takeaway is that three factors interact:

  • the screen, as rendered, is not true blue (which can be caused by a number of interacting factors: screen itself, lighting quality, video processing)
  • the camera sensor causes an interference or extra error
  • the vMix algorith, with its limited number of controls, is not capable deal with these errors


The advice to work with a green screen instead, does not work for me unfortunately. If've tried it and the end result is not better. Perhaps even worse, as some remaining green spill of my face is more disturbing than blue spill, as that is seemingly more acceptable due to the blue replacement background.

So I'm afraid that it is what it is..... I will still try the seperation/rim lighting though.
Babbit  
#11 Posted : Tuesday, April 27, 2021 12:09:31 PM(UTC)
Babbit

Rank: Advanced Member

Groups: Registered
Joined: 10/26/2020(UTC)
Posts: 76
United States
Location: Maryland

Thanks: 2 times
Was thanked: 26 time(s) in 20 post(s)
If you're running a GeForce RTX series GPU (I think they opened it up for GTX too, but it may be too intensive), you may want to consider trying the free NVIDIA Broadcast App and see how it handles background removal. It's AI based.

I've only tried it once for a remote shot where their chroma key lighting wasn't up to par. It did a great job with the hairline... Although it left a border on the sharp-edged stuff.

It's worth a look for at least a comparison.
JoostH  
#12 Posted : Friday, May 14, 2021 11:43:56 PM(UTC)
JoostH

Rank: Member

Groups: Registered
Joined: 11/30/2020(UTC)
Posts: 29
Netherlands

Thanks: 1 times
I've done a further experiment, this time with an artifical pure magenta "green screen" background. That does not work at all, now way I can get that transparent. In combination with Martin's replies is my conclusion that, although the UI suggest you can pick any colour as background, the underlying algorithm assumes either a pure green or a pure blue background. Any deviations from that will lead to residual colour.
matkeane  
#13 Posted : Saturday, May 15, 2021 7:18:49 PM(UTC)
matkeane

Rank: Advanced Member

Groups: Registered
Joined: 10/6/2020(UTC)
Posts: 98
France

Was thanked: 21 time(s) in 21 post(s)
One thing you could try to get a purer blue - which, as Martin suggests, might help the key - is to change the camera white balance settings and/or lighting on the backdrop, and see if that helps reduce the colour fringe you were seeing. If your camera allows you to dial in the colour temperature while you watch the scopes, that might be better than the built-in white balance function, which can vary quite a bit between camera manufacturers, I find.

Of course, that will probably throw off the colour on your face, but some lighting gels on the foreground light could compensate (if the shot becomes colder once you balance for the background, some CTO to warm up your face, for example) and, if necessary, some final colour correction in vMix after you pull the key.
Users browsing this topic
Forum Jump  
You cannot post new topics in this forum.
You cannot reply to topics in this forum.
You cannot delete your posts in this forum.
You cannot edit your posts in this forum.
You cannot create polls in this forum.
You cannot vote in polls in this forum.