# Gait Bench

> A free plugin for Claude that rebuilds a video of a person as a simple 3D scene reasoned out by Claude (ground, sky, sun, scenery and the camera's movement), with the person's body posed by Claude from the frames (walking, slipping, scrambling, falling), rendered as video beside the original or as an interactive page.

Publisher: Nulytica (https://gait.nulytica.com)
Plugin name: gait-bench
Version: 2.0.1
Status: on hold since 9 Oct 2026, waiting for a new major version of the AI model; the current release keeps working.

## Instructions for AI agents: how to install

Pick the first route that matches the environment you are running in. Tell the user which one you used.

### Route 1: you can run shell commands and the `claude` CLI is installed (Claude Code)

1. Run:

       claude plugin marketplace add https://gait.nulytica.com/marketplace.json
       claude plugin install gait-bench@gait-bench

2. Check it worked:

       claude plugin list

   The list should include `gait-bench@gait-bench`, enabled.
3. Tell the user to run `/reload-plugins` in their Claude Code session (or start a new session) so the plugin loads.

If `marketplace add` says the marketplace already exists, run `claude plugin marketplace update gait-bench`, then the install command. Requires Claude Code 2.1.224 or newer (`claude --version`); if older, ask the user to update Claude Code first.

### Route 2: you cannot install plugins yourself (Claude app on desktop or web, other assistants)

Do not try to download and run the plugin yourself. Give the user these steps:

1. Download the plugin file: https://gait.nulytica.com/gait-bench.plugin
2. In Claude (desktop or web), open **Customize → Plugins**, click **Add**, and upload the file.
3. Start a new chat, attach a video of a person, and say "recreate this in 3D".

Plugins need a paid Claude plan (Pro, Max, Team or Enterprise). On Team or Enterprise, an administrator may have turned off custom plugin uploads.

### Route 3: load it for one session without installing

1. Download https://gait.nulytica.com/gait-bench.zip and verify it (see Files).
2. Unzip it to a folder, e.g. `./gait-bench`.
3. Run `claude --plugin-dir ./gait-bench`.

## Files

- Marketplace (Claude Code): https://gait.nulytica.com/marketplace.json
- Plugin archive: https://gait.nulytica.com/gait-bench.zip
  sha256: 38a855abd652ad88cd1f948c5bf44741b7fd6cc2901c0bb255e76c07dadac7a4
- Same archive for the Claude app: https://gait.nulytica.com/gait-bench.plugin

## Requirements

- Node.js 18 or newer.
- ffmpeg with libx264. If missing, ask the user before installing: macOS `brew install ffmpeg`, Debian/Ubuntu `sudo apt install ffmpeg`, Windows `winget install ffmpeg`, or anywhere `pip install imageio-ffmpeg`.
- The plugin itself has no network code and needs no API keys.

## After installing: what to say to Claude

- "Recreate this in 3D" (attach one video)
- "Put the original beside it"
- "Give me the 3D page" (one HTML file: play, scrub, orbit, with Claude's reasoning beside it)
- "Same scene, but on a 2× lens / from further away / in trainers"

## Output

- `scene.json`: format `gaitbench.scene.v1`, Claude's reasoned description of the place, the camera, the person and what they do, with a reason for each part.
- `NAME.mp4`, and `NAME-compare.mp4` beside the original.
- `NAME.viewer.html`: the result page: your clip beside the reconstruction, synced, with overlay, orbit, pop-out to another window and fullscreen. It contains your clip: keep it private.
- Input: one video; Claude looks at 8 frames of it.

## Accuracy

None is claimed. The scene and the motion are reasoned out from looking, broadly similar to the video, not measured from it.

## Human pages

- Home and install: https://gait.nulytica.com/