In the past, content creators looking to populate scenes have had to make a choice. While volumetric video can offer a faster turnaround and a more natural performance than a CG digihuman, the amount of data generated meant large files that increase the demands on the hardware. To solve that issue, Arcturus created Accelerated Volumetric Video (AVV), the world’s first high performance volumetric video codec. With AVV, volumetric files are significantly compressed, while maintaining the quality of the data. That allows creators building a virtual environment to play back more volumetric video characters in real time than ever before. Users have access to similar Levels of Detail (LoDs) tools found in game engines to prioritize the character nearest the camera, leading to better playback performance and higher quality characters.
“With each new generation of any visual technology, the demands on the hardware are an issue that can definitely slow adoption. It could be exactly what a project needs, but if it isn’t practical to use, no one benefits,” said Arcturus CEO, Kamal Mistry. “AVV makes volumetric video a viable solution for digital scenes looking to add a high quantity of human characters.”
Along with improved scalability, the AVV codec also adds a handful of features all designed to improve the visual quality of a volumetric character.
Texture Analysis — An automatic texture detail analysis improves compression and helps build multi-resolution textures, leading to more optimized playback and improved visual quality.
Normals Transfer — Surface normal can now be transferred from the source capture data to the compressed final result to improve relighting in a game engine.
Smart Texture — Poly and texture budgets are prioritized toward facial features, leading to higher quality facial details.
Motion Vectors — Motion data can now be encoded in an AVV file to improve visual quality in game engines, for fast action clips and engine antialiasing.
Continued Support for OMS — Creators working on mobile applications, planning on streaming will still have access to Arcturus’s current OMS codec.
While HoloSuite users can now access the full complement of features, the tools have already been employed in multiple professional ventures, including an as-yet-unannounced Dimension Studios virtual production project, and the recently released — and critically acclaimed — remake of the classic game,
The 7th Guest VR from Vertigo Games.
“The original 7th Guest managed to tell an engaging story using full motion video, but for virtual reality we wanted to elevate that experience and use full 3D recordings of the performers, captured through volumetric video,” said Paul van der Meer, project lead for Vertigo Games. “We worked closely with Arcturus to compress the data with almost no loss and reduce the original volumetric assets by a quarter. For the first time ever in VR, we were able to include multiple volumetric video streams featuring real performances in 3D, giving players a new and compelling experience.”
Pricing/Availability
Accelerated Volumetric Video is an add-on; free for experimentation and non-commercial use for HoloSuite subscribers. Annual HoloSuite licenses are available for commercial and private use. Special pricing for education is available upon request.
About Arcturus
Arcturus is a global leader in volumetric video, offering a full range of solutions for capture, editing and distribution of volumetric projects for any industry. Founded in 2016 by some of the leading storytellers and innovators from transformative organizations like Pixar, Netflix, Dreamworks, Autodesk, Google and YouTube, Arcturus began by launching “HoloSuite,” a fully agnostic SAAS post-production platform, featuring the industry-leading tools for editing, compressing and streaming volumetric video. In 2023, it expanded its offerings to include capture solutions after taking over the Mixed Reality Capture Studios (MRCS) business from Microsoft. Arcturus is now the sole provider for MRCS licenses, and is responsible for its ongoing development.
As part of its efforts to bring volumetric video to a wider audience, Arcturus works closely with a wide range of customers focused on bringing volumetric humans to virtual production, mixed reality and more, while also helping broadcast partners introduce new options to help expand live events.