Platform features

All Factorial Biomechanics platform features explained below.
Visit our Tutorials to see it in action.

Calibration

Reference length
Calibrate the measurements captured to a real world known length, including the subject's height, distance run, or markers placed. Known measurement is entered numerically, unit is selected, and reference distance is drawn on the video. Applied calibrations are reflected in all the graphs as well as the raw data files.

Video speed selector
Select the slow-down rate of your video to properly calibrate time settings, when using slow motion or high-speed video. Default is 1x, can be set to 1/2x, 1/4x, 1/8x, 1/10x 1/20x. This factor will be used to present calibrated timestamps in the graphs and raw data, adjusting the "video time" to the real world clock.

Data sampling rate
Select how many of the available video frames you wish to analyze. To analyze every single recorded frame, make sure to select the same FPS setting here as in camera. Default is 30fps, the most common video setting for webcams and smartphones.

Visual options

33 keypoints
Keep track of your subject with 33 keypoints, including eyes, nose, ears, mouth, shoulders, elbows, wrists, hands, hips, knees, ankles, heels, and toes.

Skeleton lines
Lines connecting keypoints represent a simplified abstraction of the body.

Articulation angles
Angles for each joint are dynamically calculated as seen on the video, they’re dependent on the perspective of the camera as it regards the body in motion. These are the numbers you would find if you took a protractor to your screen.

3D angles (experimental)
Refer to the algorithmic estimation of real world angles for a certain joint, taking depth and camera perspective into consideration. These are still in experimental phase and provided as is without guarantees.

Center of mass
This reference point of the subject is dynamically calculated from the video, taking into consideration the subject's entire body and current position. Calculations following P de Leva’s "Adjustments to Zatsiorsky-Seluyanov’s segment inertia parameters" for males, female CoM calculation option coming soon. View reference.

Inertia vector
Visual representation of the direction in which the center of mass is moving, and its length is dependent on the speed of that motion. For inertia vector visualization, Center of mass must also be "on".

Anonymization
Provides the opportunity to capture and analyze motion from video without sharing the video itself. Removing visual information can allow for an unbiased analysis of motion, and for sharing a motion analysis without divulging the subject's identity.

Please note: Visualization for all the elements above can be toggled on/off on the video ⎯ data will be captured regardless.

Settings

Raw data export (json)
Select to include raw motion data in JSON format in download.

Chart image export (svg)
Select to include all chart views in download.

Analyzed video export (mp4)
Select to include entire analyzed video in download. In the free version you must choose between saving all materials to your computer or sharing publicly. Because our platform processes data locally, data will be lost when the browser window is closed.

Controls

Playback
Interaction with the video, play, pause, frame by frame step forward or backwards, and playback speed selection.

Record button
Trigger an automatic download of the video as played since pressing the record button until "stop" is clicked or video ends. Selected visual options apply.

Lock analysis
The lock analysis button allows you to toggle new inferences on or off. The model we use is non-deterministic, and new inferences may not allign perfectly with previous ones. By default, the model runs each time the video is played. Locking in an inference allows you to revisit different areas of the video without triggering a new inference, reducing jitter in the graphs.

Refresh analysis
By clicking on the refresh analysis button, you can generate a new inference only for that frame.

Video playback speed
Select the speed at which to view the video while performing the analysis. For computers without a GPU, we recommend 50% when viewing high resolution videos.

Snapshot
Automatically download a still image of the current video frame, with the selected settings, i.e. if anonymized you will download the skeleton only.

Picture in picture
Pop out the video so you can follow along as you scroll through the graphs.

Data graphs

Data is gathered locally as the video plays. Graphs are generated automatically when the video is paused or comes to an end.

By default the graph units are seconds and pixel position from the video, but they can be calibrated to the desired unit, including but not limited to: centimeters, inches, feet, yard, meters, football fields. Timing can also be adjusted to slow motion or high speed video.

Kinematic data (graph)
Shows keypoints positions as they change through the video, creating a three dimensional visualization of two dimensional movement through time.

Vertical displacement data (graph)
Plots each keypoint's position through the length of the video or selected area of the seek bar, perfect for tracking the height of a jump or identifying contact times in a sprint.

Horizontal displacement data (graph)
Tracks the keypoint's position through time, great for identifying symmetry issues and evaluating balance.

Angular data (graph)
Shows the angle of the selected joints and how they change through time, this graph also includes the Center of Mass position, to be used as a reference.



Calculations (graph)
Shows the speed and acceleration of the center of mass throughout the video. Smoothing takes into account previous frames.

Annotations on graphs
You can make notes on the charts to highlight specific events for a consult with your AI Biomechanics Assistant, export or further analysis.

3d pose estimation
Real-time 3d projection of the estimated position of each keypoint of the subject in the current video frame. You can orbit the frame to observe motion from different perspectives.

Interactive graph options

Click on a trace will trigger the video to that selected time.

Double click on a trace will generate an annotation.

Graphs can be zoomed in and out by "scrolling" .

Enter your own subtitle text to customize your graphs.

Download as png
Click to trigger an image download (PNG) of the graph's current view.

Zoom
Click and drag to select the area of the grpah to zoom into.

Pan
Click and drag chart image to reposition.

Zoom in
Each click on this button zooms into the center of the graph.

Zoom out
Each click on this button zooms out.

Autoscale
Click will zoom in or out to the point in which all data and annotations fit the graph space.

Reset axes
Click will present default view of the graph.

3d graph options

Turntable rotation
After selecting, click and drag on the 3d graph to view data from the desired angle, respecting the base of the graph.

Orbital rotation
After selecting, click and drag on the 3d graph to view data from the desired angle, freely.

Reset camera to default
Click will reset the graph to its original view.

Reset camera to last save
Click will zoom to the last saved view.

Biomechanics assistant

Chat box
Integrated gen-AI Biomechanics assistant to help navigate use from set-up to report generation, agregating data, and making calculations for a smoother experience. Powered by Google Cloud.