Sony recently released a new virtual production tool set, including a camera and display virtual production plug-in (“Camera and Display Plugin”) and virtual production color calibration tool (“Color Calibrator”) to help filmmakers improve pre-production efficiency and on-set workflow. New toolset works with Sony CineAltaV cinema cameras, Crystal LED and other HDR-enabled LED In-camera visual rendering.
Based on the feedback from the creative community, Sony cooperated with Epic Games and launched this virtual production tool suite after rigorous testing to optimize the film and television production process and improve creative efficiency.
Camera and display virtual production plug-in
The Camera and Display Virtual Production Plugin is a plugin for Unreal Engine that helps production teams identify and resolve common issues in the virtual production workflow. For example, due to the different color characteristics of different cameras and LED displays, it is very common for art departments in charge of virtual productions to be unable to predict the actual color performance of a particular camera.
Camera and Display Virtual Production Plugin User Interface
The Sony Camera and Display Virtual Production Plug-in is a great solution to many common problems including these. When installed in Unreal Engine, the virtual CineAltaV in the plug-in allows filmmakers to reproduce the setup of CineAltaV, CineAltaV 2, and Black Color LED screens. This allowed the virtual art department to leverage CineAltaV’s color pipeline to create assets during the pre-production phase, before costly crews went on set. The virtual CineAltaV feature in the camera and display virtual production plug-in can also simulate the camera’s exposure index and ND filter, recreate the shallow depth of field effect, and help the production team determine the choice of lens during the pre-production process. This plug-in can also display corresponding moiré (note: moiré, which will cause colorful high-frequency irregular stripes in the picture) alarms according to the dot pitch and other characteristics of the LED display, helping the production team in the pre-production process Make adjustments to camera position and camera movement to save setup time on set.
Camera and Display Virtual Production Plugin User Interface
In addition, users can export the settings of the virtual CineAltaV and screen virtual production plug-in from the plug-in to CineAltaV and CineAltaV 2 for live use. During filming, the plug-in can continue to provide moiré alerts, identifying issues that may not be noticeable in on-set monitoring but may become apparent in post-production.
Virtual Production Color Calibration Tool
Sony Virtual Production Color Calibration Tool is an application based on Windows 10 environment. It ensures accurate color reproduction when shooting LED displays with CineAltaV. This calibration tool greatly reduces the work of testing, reshoots or complex LUTs during shooting or production. Instead, the on-set workflow can be improved by intuitively calibrating the effects of LED displays, including HDR-enabled LED displays, through the interface to achieve the desired color effects in CineAltaV.
Virtual Production Color Calibration Tool Set Application Schematic
The test pattern is displayed on the LED display and automatically analyzed by CineAltaV and the Color Calibration Tool plugin to generate a 3D LUT. Sony Virtual Production color calibration tools can be applied to LED controllers, color management tools or Unreal Engine, making the calibration process simple and repeatable.
