A research group of the University of Washington has developed a real-time, high-resolution background replacement technique which operates at 30fps in 4K resolution, and 60fps for HD on a modern GPU. The technique is based on background matting, where an additional frame of the background is captured and used in recovering the alpha matte and the foreground layer.

This works like the virtual background function of Zoom/WebEx/Teams (but much better!).

Would be a great new feature for vMix as it would eliminate the need for a green screen.

Example Video:


Project Website:
https://grail.cs.washing...s/background-matting-v2/

The code is available under the MIT license on Github:
https://github.com/PeterL1n/BackgroundMattingV2