LOS ANGELES, CA— Vicon motion capture systems were used by VFX powerhouse Industrial Light & Magic (ILM) to create visual effects for the summer’s biggest box office hit, The Avengers. The superhero-themed blockbuster features digital characters driven by Vicon motion-captured performances for scenes that showcase the Hulk, Iron Man, foot soldiers and virtual crowds.
ILM Digital Supervisor Mike Sanders has been working with Vicon systems for almost 15 years at the company. “One of the first things we did on The Avengers was bring actor Mark Ruffalo in for a shoot on our mocap stage to do what we call ‘rapid prototyping.’ We applied his performance captured by the Vicon cameras onto a 3D model of the Hulk to give him live performance feedback in real time. This allowed Ruffalo to explore his posture, motion and timing of actions as the Hulk, and was an exciting way for the director [Joss Whedon] and actor to engage with the digital character in a very interactive way.”
Over the course of a year, ILM completed approximately 24 motion capture shoots for The Avengers, both as front-loaded sequences for character motion libraries and fine-tuned shot-specific performances. Animation driven by the Vicon mocap data for the Hulk, Iron Man, foot soldiers and digital crowds was used throughout the film. Full body performance of the Hulk was captured with the Vicon system both on the mocap stage and on location during principle shooting, where Ruffalo was often performing in one of ILM’s Imocap suits alongside the film’s other cast members.
ILM is one of Vicon’s longest standing customers in the entertainment market and has used its motion capture systems on films including the Academy Award-winning Rango, as well as all of the films in the
Transformers,
Pirates of the Caribbean,
Iron Man franchises and many others. ILM has seen its use of motion capture technologies evolve over the last 17 years from a strictly post production and visual effects role to a tool used across the pitch, pre-production, production and post production phases in the life-cycle of a typical project.
“At ILM the motion capture stage is another tool in the artist’s arsenal,” Sanders explained. “Sometimes studios will hire us for pitch viz, to rapidly prototype characters and very quickly produce a cut scene of a movie that’s at 80-90% render quality to help convince IP stakeholders whether or not they should move forward with developing that property. We’ve also used mocap to capture virtual camera moves, actors in character exploration or motion study sessions during casting, to help studios evaluate a director’s ability to develop certain projects and for location scouting in digital environments using a tracked virtual camera.”
ILM also uses Blade, Vicon’s motion capture software, to reproduce an actor’s skeletal motion from a 3D point cloud. The point cloud is created using 2D data collected from the cameras during a performance. ILM’s proprietary animation system, Zeno, allows them to automatically retarget performance data from the mocap stage onto animator’s character rigs in real time. In live feedback sessions, Zeno can automatically generate decimated or lower level resolution characters off of the hero mesh so that the character’s topology is the same, but is optimized for speed and real time rendering.
ILM is currently evaluating the latest generation, 16 megapixel Vicon T-160 cameras. “The advanced resolution definitely helps us get cleaner data, less noise and sees markers farther and longer. It goes into occlusion a lot better, the calibrations are faster as well. Overall we’ve stuck with Vicon systems over the years based on the robustness and quality of the hardware, and the relationship and development service that we’ve always gotten from Vicon, which is critical for our industry,” Sanders concluded.