Intel® 3DAT: Markerless Motion Capture
Intel 3DAT is available as an edge- or cloud-based SDK that can be applied to any human motion application. Intel® 3DAT uses computer vision and AI to perform laboratory-grade motion capture with ordinary video—no sensor suits, markers, or green screens required.
See How Intel® 3DAT Uses AI to Capture and Analyze Human Performance
Intel® 3DAT uses AI to recognize, track, and analyze over 1,000 biomechanics data points from standard video. Intel® 3DAT allows customers to create rich and powerful biomechanics-driven products, such as web and mobile applications with detailed performance data and three-dimensional visualizations.
Intel® 3DAT SDK Use Cases
Intel® 3DAT is available as an edge- or cloud-based SDK that can be applied to virtually any study of human motion. Developers can use the Intel® 3DAT SDK to analyze motion and deliver results in virtually any context, from sports to physical therapy and personal fitness.
Intel® 3DAT for Sports Science and Performance
Intel 3DAT was developed by the Olympic Technology Group at Intel to showcase AI & Computer Vision at Tokyo 2020 as a broadcast technology. Now Intel engineers and independent developers are applying 3DAT markerless motion capture to elite athletics and the unique biomechanics of specific sports.
Golf
Baseball and Softball
Track and Field
Intel® 3DAT for Fitness and Training
Intel® 3DAT can process data locally or in the cloud, which means you can deliver markerless motion capture and biomechanics analysis to practically any application or device. Use Intel® 3DAT to augment existing applications or create entirely new ways to train.
Smart Home Gyms
Virtual Trainers and Assistants
Shoe and Equipment Fitting
Intel® 3DAT for Rehabilitation and Health
3DAT can give medical practitioners detailed biomechanics data about a patient’s articulation, flexibility, and range of motion—all without sensors or wearables. Documenting a patient’s motion in the moment and over time can provide unprecedented insight into patients’ health and progress.
Intel® 3DAT Case Studies
Intel® 3DAT is proving itself with early adopters in broadcasting, athletics, and training, but these pilots are just scratching the surface of what can be done. Explore what innovators are doing today and imagine the possibilities.
Watching Sports in a Whole New Way with Intel® 3DAT
Intel® 3DAT made its broadcast debut at the 2020 U.S. Olympic Team Trials ‒ Track & Field and provided new insights into performance at the Olympic Games Tokyo 2020. Multiple cameras captured race footage, which 3DAT transformed into heat maps that revealed each runner’s acceleration and peak speed.
Purdue Baseball Puts Pressure on the Base Paths with Intel® 3DAT
Purdue baseball is using Intel® 3DAT to help players adjust their posture, increase their speed, and steal more bases. The coaching staff worked with Purdue PhD engineering student Breana Cappuccilli and Intel developers to adapt the Intel® 3DAT SDK to the team’s specific needs. Now the team is bringing the speed on every play.
Video credit: Rebecca McElhoe/Purdue University
Exos Puts Intel 3DAT to the Test training NFL Hopefuls
Exos used Intel® 3DAT to capture previously unmeasurable performance metrics in the moment so coaches and players can put them to work immediately.
Intel® 3DAT Features and Capabilities
Person and Object Detection
Intel® 3DAT automatically detects and tracks people and objects in every video frame. Bounding boxes highlight data collected from human movement and sports equipment, like balls, bats, clubs, racquets, and more.
Multi-Camera 3D Triangulation
Multi-camera 3D triangulation uses synchronized video footage and proprietary calibration to capture highly accurate 3D key points with as few as two cameras or as many as eight cameras.
Multi-Person Tracking (in Development)
When used with multiple cameras, multi-person tracking will be able to capture and analyze several individuals at once. It will continue tracking even when people are blocked from a camera’s view.
2D Skeletal Pose
Intel® 3DAT uses proprietary deep learning models to extract full-body skeletal and object key points, including up to 20 joint centers. Developers can create custom filters and process sports- and activity-specific joints and motion.
3D Inferred Skeletal Pose
Intel® 3DAT can infer three-dimensional motion from a single camera by estimating the depth of each skeletal point. Poses are optimized for sagittal and frontal views.
Inverse Kinematics Rigging
3D data provided from 3D inferred skeletal or multi-camera 3D triangulation can be further processed with an inverse kinematics rigging engine that constrains the model to a fixed bone length armature.
Biomechanics Library
A proprietary biomechanics engine extracts full-body kinematics of joints, segments, and objects. The library provides time series and summarizes discrete metrics in generic and sport specific modules.
Front-End Applications and Visualization Software
Intel® 3DAT offers licensable application code for capturing camera data, rendering real-time 3D data, and providing 3D sports-biomechanics reporting tools. Tools are available for web, Windows, and Linux applications.
What Will You Build with Intel® 3DAT?
Intel® 3DAT debuted at the 2020 U.S. Olympic Team Trials ‒ Track & Field and delivered unprecedented race insights and fan engagement at the Olympic Games Tokyo 2020. Intel® 3DAT is a tested, mature, stable product that is ready for sports brands, start-ups, and developers to take to market.
Intel® 3DAT Edge SDK – Build Applications for Training and Gameplay on the Field
Get a laptop, connect a camera, and get the 3DAT SDK Docker container. You can start experimenting with 3D markerless motion capture and biomechanics analysis in real time on your local machine. All computer vision, AI, and visualization workloads happen locally, so there’s no need to send data to the cloud.
- Build custom applications with real-time biomechanics analysis
- Run on Intel® Core™ i7 and i9 processors or Intel® Xeon® processors
- Operate on a laptop, desktop, or server
- Store all data locally
- Use for stand-alone motion capture applications
Intel® 3DAT Cloud SDK – Build, Serve, and Scale Markerless Motion Capture Applications with AWS
Work with the 3DAT SDK in an AWS environment running on Intel® Xeon® clusters. Provisioned instances provide cloud-based video processing and deep learning inference plus web- or container-based application serving. You can build out custom applications, serve up front-end experiences for customers, and scale markerless motion capture services on demand.
- Access 3DAT SDK plus video and inference processing as a service
- Build and serve custom applications to end customers
- Manage applications, perform inference, and store on AWS
- Run on cost-efficient Intel® Xeon® instances with Intel® Deep Learning Boost AI acceleration
- Use for consumer apps, resource-limited mobile deployments, and enterprise-scale deployments
- Build for scale with 3DAT on AWS
Ready to Build with Intel® 3DAT?
Contact the Intel® 3DAT team to arrange a demo and get started with the 3DAT SDK. We’re here to help you get to market, from initial discovery through launch.
The Intel® Technologies That Make Intel® 3DAT a Reality
Intel® 3DAT uses an array of proprietary Intel® technologies, including deep learning models for object recognition, tracking, and pose estimation plus kinematics engines and a growing biomechanics library.
All of these technologies use open Intel® AI development tools and run on standard Intel® hardware so you can build quickly and deploy motion capture applications practically anywhere.
At the Edge
Dive Deeper ‒ Intel® 3DAT News and Information
AiSCOUT Levels the Playing Field
AiSCOUT used 3DAT infrastructure to build a smartphone app that athletic hopefuls can use to record their skills and share detailed performance data with global scouting agents.
Intel® 3DAT Opens a New World in Athletic Performance
Two-time Olympic gold medalist Ashton Eaton explores how 3DAT will impact elite athletic training and performance.
How Intel Built a Smart Coaching SaaS
Explore how Intel and AWS brought 3DAT to the cloud.
How Intel® 3DAT Estimates 3D Models from 2D Video
Get a developer-level look at a software stack that infers 3D motion and telemetry from a single camera.
Help Us Bring Intel® 3DAT to the World
Whether you’re a major sports brand, a sports-medicine researcher, or a start-up working in human performance, we want to hear from you. We are interested in challenging applications that will push Intel® 3DAT into new use cases and entrepreneurial partners who want to use Intel® 3DAT in commercial ventures.