Henson Digital Puppetry Studio
What is the Henson Digital Puppetry Studio?
Integrated with motion capture and real-time game engine, Henson puppeteers use the award-winning Henson Digital Puppetry Studio to create complete CG character performances in real time. This includes the puppeteering of full facial animation for characters and creatures. With the Henson Digital Puppetry Studio, we can “shoot” CG scenes as if they were live action and bring the magic of Henson puppetry into the CG world.
Perfect for
Realtime Animation
Visual Effects
Previz & Animatics
Live Interactive Experiences
Video Game Cinematics
Character Animation Dev.
Social Media Campaigns
Go behind-the-scenes and learn how we combined live action with full realtime CG animation using the Henson Digital Puppetry Studio!
‘Earth to Ned’ Uses Real-Time Digital Puppetry for Final Pixel TV
Pre-Production Services
Henson’s Design Capabilities unite artistry and technology across every stage of virtual production. Our work begins with Character and Creature Design, shaping expressive, story-driven designs that capture personality and emotion.
Our Environment Design completes the picture, creating immersive digital worlds that enhance each performance and storytelling moment.
Through Asset Creation, we model, texture, groom, and rig each character with precision before bringing it into our Henson Digital Puppetry System. There, a puppeteer refines expressions and movement, customizing performance controls to make the character truly come alive—typically within one to five days.
Henson Performance Control System
At the heart of Henson’s virtual production pipeline is the Henson Performance Control System, the core technology behind the Henson Digital Puppetry Studio. Evolving from the same system that powers Henson’s animatronic puppets, this innovative tool allows puppeteers to perform CG characters with the same creativity, spontaneity, and fluidity as live-action puppets. With custom hand controls and foot pedals offering 32 programmable dual-direction inputs, puppeteers can design and trigger expressive movements, blending gestures and emotions in real time to bring digital characters vividly to life.
Real-Time Production
The Henson Performance Control System integrates seamlessly into motion capture environments, combining facial animation from the puppeteer with full-body performance data captured through optical tracking or inertial suits. This real-time integration produces a complete, synchronized character performance that mirrors the nuance of traditional puppetry.
Henson’s virtual camera controllers extend this realism further. Modeled after traditional TV pedestal cameras, they offer full zoom, pan, tilt, crane, and dolly control, allowing operators to shoot CG animation with the same dynamic flexibility as a live-action multi-camera setup. Meanwhile, the props station enables on-set interaction by triggering prop actions and handoffs, reducing the need for keyframe animation and enhancing the naturalism of the scene.
To capture and refine every performance, the Henson Take Recorder records every input from the puppetry system and virtual cameras. This multi-track approach allows for unparalleled flexibility in post-production—directors, DPs, and puppeteers can isolate and fine-tune specific moments, from a camera move to an eyeline adjustment. All captured data flows seamlessly into Unreal Engine or Maya for continued refinement and integration.
Created with the Henson Digital Puppetry Studio
FAQ
Please reach out if the following answers don’t fully address your questions.
-
Our asset build schedule looks like a traditional CG asset build schedule. We model, texture, groom, and rig the character. Once the character is rigged, it is ready for our Henson Performance Control System. At this point, a puppeteer takes over. The puppeteer works with the system to design character expressions and customize the system for performance. Depending on the character and the production this takes anywhere from 1-5 days.
-
Yes! We can adapt any rigged character to be performed on our puppetry system. Adapting the rigging takes anywhere from a few days to a few weeks (depending on the existing rig). Once the asset is up and running on our system, we can help you cast a puppeteer to custom program the digital puppetry system in collaboration with your creative lead.
If your model does not have a rig, we can create one from scratch.
-
We can run 6 puppeteering rigs (combined with 6 additional mocap actors) to capture 6 characters at a time. If the scene requires additional characters, we can layer them in through additional takes.
-
Primetime Emmy 2009: Outstanding Achievement in Engineering Development presented to Jim Henson’s Creature Shop for The Henson Digital Puppetry Studio
Academy Award 1992: Academy of Motion Picture Arts and Sciences Scientific and Engineering Award for the development of the Henson Performance Control System
-
Depending on the complexity of the scenes, we can shoot 10-12 minutes of animation per day.
-
Yes. Our hardware and software interface with both Maya and Unreal Engine. We can integrate into any CG workflow that uses those DCC packages.
-
No facial capture or A.I. is used in the performance of our characters. All expressions are driven by the puppeteers through the Henson Performance Control System.