Rokoko
Rokoko Vision is an AI-powered motion capture solution that allows creators to easily record and interpret human movement in 3D animation. By utilising machine ...
Last verified:
What is Rokoko?
Rokoko Vision (formerly called Rokoko Video) is a free AI-powered browser-based motion capture tool that extracts 3D motion data from video footage and retargets it to 3D characters. Users can upload a pre-recorded video file or record their movements directly using a computer webcam, with the option to upgrade to a dual-camera setup for enhanced tracking accuracy. The tool processes the video in Rokoko's AI-powered motion engine to automatically extract the motion file of the actor's body and limbs.
Key features include limitless free usage for recordings up to 15 seconds, single-camera and dual-camera tracking options, cloud-based video processing (taking 30-40 seconds per 10 seconds of video), and the ability to view and clean mocap data in Rokoko Studio. Users can apply advanced filters like foot locking and foot lock to improve data quality, retarget animations to custom characters, and export files in .FBX or .BVH format with various skeleton options (HIK, Mixamo, etc.) for use in Blender, Cinema 4D, Unity, Unreal Engine, Maya, and other 3D tools.
Rokoko Vision is designed for everyone from creators just starting out to studio animators looking for quick pre-visualization. It's ideal for hobbyists, beginner enthusiasts, 3D digital creators, VFX artists, game developers, film production teams, and anyone interested in character animation without needing expensive mocap suits, fancy technology, or tracking equipment. The tool makes motion capture accessible to everyone with just a computer and a camera.
Rokoko pricing
Pricing model: Free
Rokoko Vision is completely free with limitless usage for recordings up to 15 seconds. Single-camera setup is free indefinitely. Dual-camera setup can be trialed for free for 14 days, after which a Plus subscription plan is required. A free Rokoko Starter account is required to use the tool. Rokoko Studio software for editing and exporting is also free. Starter accounts do not include active customer support or Rokoko's integration plugins for streaming data to DCC software.
Rokoko pros
- Completely free with limitless usage for recordings up to 15 seconds
- Browser-based - no software installation required to start
- Works with standard webcams and smartphones as camera input
- Dual-camera setup provides superior accuracy and depth perception
- No expensive mocap suit or tracking equipment needed
- Process takes only 30-40 seconds per 10 seconds of video
- Exports to both .FBX and .BVH formats for broad compatibility
- Multiple skeleton options including HIK and Mixamo
- Foot locking filter available in Rokoko Studio for data cleanup
- Can retarget animations to custom imported characters
- Supports single-camera setup completely free
- Dual-camera trial available for 14 days before requiring Plus plan
- Works on any standard desktop web browser
- Compatible with major 3D tools: Blender, C4D, Unity, Unreal, Maya
- Clear background and lighting requirements make setup straightforward
- Active Discord community for support and creator engagement
- Multiple tutorial resources available for learning workflows
- Ideal for pre-visualization and quick animation ideas
Rokoko cons
- Only supports recordings up to 15 seconds for free usage
- Dual-camera requires Plus subscription after 14-day free trial
- AI relies on complete view of performer - occluded limbs reduce tracking quality
- Only captures one performer per recording, not multiple people
- No finger tracking available - requires Smartgloves for that
- Post-processed data means not real-time animation generation
- Requires stable camera on tripod for best results
- Dark or black clothing reduces capture quality
- Loose clothing negatively impacts tracking accuracy
- Needs well-lit environment with clear background contrast
- Studio Beta edition required (not Studio Legacy) for editing/exporting
- Starter accounts don't include active customer support
- Starter accounts lack integration plugins for streaming to DCC software
- Processing time can vary depending on server loads
- Background and lighting distance requirements limit tracking space flexibility
Frequently asked questions about Rokoko
How long does it take to process the mocap?
After capturing the motion and trimming the clip, you can click 'Animate' to begin processing the data. Generally, for every 10 seconds of data, it'll take around 30-40 seconds to process. But sometimes it can take a little longer, depending on server loads.
Where can I learn how to use Rokoko Vision?
You can find step-by-step guides and tutorials on the Rokoko website. You can also head to their Discord to engage directly with the Rokoko team and other creators from the community who are animating their characters with Rokoko Vision.
Why is Rokoko Vision dual-camera more accurate than single-camera?
Dual-camera inputs allows the AI system to better reconstruct the motion than a single camera input, as it can better estimate depth and get a clearer view of a performer's body at all times through occlusion reduction. Single camera is free and dual camera can be trialed for free for 14 days, after which a Plus subscription plan is required.
I recorded a video but don't see any mocap data in Rokoko Studio, why?
Check these four things: 1) Make sure you are using Rokoko Studio (not Studio Legacy), 2) Make sure that you are logged into vision.rokoko.com and Rokoko Studio with the same account (Rokoko ID), 3) If you are part of multiple Teams in Rokoko Studio, make sure that you are using the correct one by clicking your name and selecting Switch teams, 4) Restart Rokoko Studio to hard refresh the data. Still need help? Contact [email protected].
What cameras and webcams are compatible with Rokoko Vision?
The camera requirements are different depending on whether you are using single- or dual-cam in Rokoko Vision. All necessary information about compatible cameras and webcams can be found in the Rokoko quick start guide.
What are the tips to optimize capture quality?
Follow these steps: 1) The full body of one individual must be in the frame at all times, 2) Avoid loose clothing as well as dark or black clothing, 3) Ensure the camera is always stable (for example, on a tripod), 4) Make sure your environment is well lit and with a clear background creating contrast between the performer and the background.
Why buy inertial mocap tools like Smartsuit Pro II if I can use Rokoko Vision?
Rokoko Vision is great for entry into motion capture and pre-visualization, but inertial mocap tools like Smartsuit Pro II and Smartgloves are needed for: 1) Higher data quality especially for complex motions, 2) No occlusion issues since sensor-based mocap doesn't require complete view of performer, 3) Real-time data generation instead of post-processed, 4) Face and finger capture (Smartgloves needed for finger tracking), 5) More flexible tracking space independent of lighting/background, 6) Multiple performer recordings (up to 5 performers at once with inertial mocap).
What video file formats can I upload?
You can select a supported video file format from your hard drive. The tool works with any pre-recorded footage as long as there is a clear view on the subject's body motion for the mocap capture to work properly.
Can I use my smartphone as a webcam for Rokoko Vision?
Yes, for both single and dual camera setup, it can be very convenient to use your Android or iPhone as a webcam. Rokoko provides setup guides for using smartphones as webcams to avoid cable issues and have the most flexible setup.
What do I do after processing to get the animation into my 3D software?
Once Rokoko Vision finishes processing, you can preview the final result directly on the website and either download it as an .fbx file or open it in Rokoko Studio to edit it. In Rokoko Studio, you can further edit your recording, retarget the movement to an imported custom character, access more export formats and options, or stream the animation directly to another 3D software application like Blender, Unreal, Unity, or iClone.