modern tools While movies are becoming increasingly accessible to independent and amateur filmmakers alike, realistic CG characters (like it or not) are still in the realm of big-budget projects. Staying. Wonder Dynamics aims to change that with a platform that allows creators to literally drag and drop her CG characters into any scene as if they were professionally captured and edited.
Yes, that sounds a little too promising. Your skepticism is justified, but as a skeptic myself, I have to say that I was very impressed with what this startup showed about the company’s web-based editor, Wonder Studio. This is not a toy like an AR filter. This is a serious tool, a tool co-founder Nikola Todorovic and he Tye Sheridan coveted. And most importantly, it makes the artist’s job easier, rather than replacing it completely.
“The goal has always been to make tools for Empower the artist. People who have big dreams don’t always have the resources to make them come true,” Sheridan said. ready player one — so his familiarity with the intricacies of CG-assisted production and motion capture is very direct.
Todorovic and Sheridan have known and worked together for many years, but they often hit a wall. Their company, which has operated mostly in stealth so far, raised $2.5 million in a seed round in early 2021 and his A round of another $10 million later that year.
Software for creating, editing, compositing, and coloring 3D models (especially other steps in the filmmaking process) is much easier to buy and use these days, but it’s hard to actually create a CG character. The process of placing it in the scene is still very simple. complicated.
Nikola Todorovic (left) and Tye Sheridan (right), founders of Wonder Dynamics.
Suppose you want to include a robot companion in a sci-fi movie scene. Artists creating models, textures, etc. are only the first step. Unless you want to animate manually (not recommended!), you’ll need a motion capture studio or on-set gear, a reflector ball, a green screen, and everything else. Apply motion primitives from them to CG skeletons to replace characters with actors. However, the 3D model must match the lighting direction and color, film cast and grain, etc. Hopefully we can even hire people to capture and characterize them.
Unless they happen to be experts all With so much time on hand within these individual pre- and post-production processes, it’s simply out of scope and budget for most filmmakers. At the end of the day, major VFX work like adding dragons and superheroes could cost him as much as $20,000 a second, not to mention days of tech labor. As such, indie movies tend to lack any noticeable VFX of him, let alone a fully animated character.
Wonder Studio is a platform that makes this process as easy as selecting filters and brushes in Photoshop. It may sound too good to be true, but Sheridan and Todorovic said he has been working on the project for three years and the results show it. “We wanted to build something basic, and that’s why it took so long,” says Sheridan.
“We built something that automates this whole process and animates it live frame by frame. No motion capture is needed. It automatically detects actors based on a single camera. We do the movement, the lighting, the color, and we replace the actors completely with CG,” explains Todorovic.
But crucially, we don’t just do this on live cams by sticking them on camera like Tiktok or spitting out questionable ‘final’ products. All the actual work that VFX artists would normally create or work with would still be produced. And, as he noted cautiously, nothing is trained on the artist’s existing work.
Final shots, motion capture data, masks and 3D environments produced by Wonder Studio.
“We take motion capture, clean plates, masks, blender scenes and analyze them for noise and grain,” he continued. That is, his 3D representation of the environment, including animation and motion data (including hands and faces), shots of actors and no replacements, frame-by-frame character and object outlines, terrain and other features. You can also track actors throughout the scene at multiple angles, so everything automatically matches the quality of the shot.
Here’s how the process actually works.
More examples and details can be found on the company’s site.
A lot of this kind of work is monotonous, a lot of it is monotonous, done the same way over and over again as part of the overall VFX process. These “objective, non-creative” tasks are so called because they are technical necessities rather than expressive results, but they are undoubtedly “dirty, boring, dangerous”, “dull”, It falls into the three D’s of automation.
“Artists cannot be replaced by AI. We aim to enhance and empower artists. This does not disrupt what they are doing. Automate the % and leave the subjective work behind,” explains Todorovic. “The beauty of AI is that it simplifies the very complex.”
Don’t worry that many people will lose their jobs because of this. The VFX industry is aggressively working, especially with companies like Marvel and Netflix insisting on regular releases of the highly demanding CG work that must be done by dozens of independent his VFX houses. overwhelmed by One is a cloak, another is an explosion, another is a digital makeup, and another is a deformable surface. And they are all reserved for years. Sure, they’re paying the bills, but they spend half the time manually outlining the subject actors in every frame, so if they can take on double the work, he’s probably It will do it in 1 second.
Of course, it all depends on the quality of the results, and automation of these processes tends to fail. Of course, you get tools that automatically detect the movement of selected actors and output a rough animation of your model. But you have to tell him which actor it is in every shot, and even if it’s all over, he won’t magically become a CG character. I have to hand it off to the next team who knows what to do with a set of coordinates and Bezier curves.
Sheridan and Todorovic wanted Wonder Studio to be simple enough for kids to use, yet powerful enough for VFX professionals. So you can output the raw data if you want and use the drag-and-drop functionality right out of the box.
Wonder Studio comes with a number of ready-to-use sample models, but they are not meant to be used directly in a movie. It’s like a set of CG character archetypes that actually work. Robots of varying severity, suspicious Gollum-like “Sam” (a small alien man), and more.
“We want artists to create their own. You get your FBX [a common 3D media format] Textures are assembled on the platform, just like importing into Blender, Unreal, etc.” Models can also be made available for purchase on the platform.
Even these basic elements may suffice for pitch, rough cuts, or pre-visualization, although the latter is often done by stunt staff and has very little VFX. Wouldn’t it be great to see what a Wolverine costume or a slimy sewer monster would actually look like in the fight choreography you’re proposing, not just the storyboard? Or a short sci-fi movie with just a robotic cashier or a mutant street sweeper that exudes a casual, futuristic vibe, isn’t even an option right now. Entry-level CG characters open up entire genres that have been constrained by big budgets.
More features are planned, from CG environments where characters can be composited, to capturing camera motion in any medium so that it can be simulated, studied, fine-tuned, and reused.
“It’s a big first step, but the big picture is that we want to create a platform where any kid can direct a movie by just sitting in front of a computer and typing,” said Sheridan. Starting with a free tier that anyone can try, more advanced features for professionals and heavy users are available in various paid plans. They plan to work directly with VFX houses to create and improve integrations and workflows.
Their hope is that this will be a combination of low- and no-budget filmmaking and the kind of unforbidden flight of imagination that only someone with the resources of James Cameron could conceive, do, let alone conceive. It’s about starting to fill in the gaps.
The platform is currently in beta, but is already being used by acclaimed action directors Russo Brothers for an upcoming Netflix movie with Millie Bobby Brown and Chris Pratt. No word on whether it will be replaced, but it’s still a strong endorsement.
“I may be biased, but making movies has got to be one of the coolest jobs ever,” Sheridan said of the release announcing Wonder Studio’s debut. said in “We are storytellers at heart, and we are just building technology as a means to tell better stories. Offers.”
