Netflix Open-Sources VOID AI Framework for Video Object Removal

Netflix has open-sourced VOID, an artificial intelligence framework designed to remove objects from videos while automatically adjusting the physical effects those objects created in the scene. The framework handles complex adjustments including lighting changes, shadows, and reflections that would normally require manual correction by visual effects artists. By releasing VOID as open-source software, Netflix makes this advanced video editing technology available to the broader filmmaking and development community. The framework represents a significant automation of rotoscoping and cleanup work traditionally performed frame-by-frame by VFX professionals.

Netflix's VOID AI Framework Release

• ▪Netflix has open-sourced an AI framework called VOID.

Technical Capabilities of Object Removal and Physics Adjustment

• ▪Netflix's VOID AI framework can remove objects from videos.
• ▪Netflix's VOID AI framework automatically adjusts the physical effects that removed objects had on the rest of the scene.

Perspective of Visual effects industry professionals

• ▪Netflix's VOID framework's ability to automatically adjust lighting, shadows, and reflections could reduce demand for specialized VFX cleanup artists.
• ▪Netflix's VOID framework could automate rotoscoping tasks that currently require manual frame-by-frame work by visual effects artists.

Perspective of Open-source AI community

• ▪Netflix's open-sourcing of VOID enables researchers and developers to build upon the framework for new video editing applications.
• ▪Netflix's decision to open-source VOID makes advanced video object removal technology accessible to independent filmmakers and smaller studios.

2 sources