# Character replacement & motion-transfer video benchmark: pose lock, scale & effective $/s (v1)

Suite ID: `motion-swap-v1` (v1, frozen 2026-11-16; data as of 2026-11-16).

Standardized single-draw (n=1) 5-second character-replacement benchmark comparing Kling 3.0 Motion Control, Kling 2.6 Motion Control, ByteDance DreamActor V2, Wan 2.2 Animate 14B, Higgsfield Genjutsu Lite and each::labs Lockstep on 2D limb-vector correlation, compact mascot scale preservation and background SSIM stability.

- Max draws per case: Pass@1
- Automated pure-script grader: `scripts/benchmark-grade.py`

## Script pass gates & metrics

- **2D limb-angle correlation** (`pose_angle_corr`, ratio, higher is better) — pass gate: `pose_angle_corr gte 0.78`
- **Subject scale preservation** (`scale_ratio_accuracy`, ratio, higher is better) — pass gate: `scale_ratio_accuracy gte 0.75`
- **Background SSIM stability** (`bg_ssim`, ratio, higher is better) — pass gate: `bg_ssim gte 0.8`
- **Delivered duration ratio** (`duration_ratio`, ratio, higher is better) — pass gate: `duration_ratio gte 0.92`

## Frozen test cases

### Full-body fast arm-cross dance transfer (street dancer) (`human-dance-lock-5s`, 5s @ 480p)

- Prompt: "Replace the dancer in the video with the character in the black FOURTHFEED crewneck sweatshirt from the reference image, keeping the exact arm crosses, footwork, camera framing and studio background."
- Pass rule: pose_angle_corr >= 0.78, scale_ratio_accuracy >= 0.75, bg_ssim >= 0.80, duration_ratio >= 0.92
- Frozen image input: https://assets.fourthfeed.com/benchmarks/motion-swap-v1/ff-char-dancer-v2.png (sha256: `0433a98e0ef3321a260fa2cb3f4869d505838a094d00f3adfe68ec61ac10ce23`) — Proprietary full-body street dancer in FOURTHFEED pullover crewneck with both hands visible
- Frozen video input: https://assets.fourthfeed.com/benchmarks/motion-swap-v1/ff-driving-dance-5s-v1.mp4 (sha256: `a8014d1696be8a0060980dc87f2ab2c742d2bec6bb0693d822e0bd1b83304f21`) — 5s 480p 24fps proprietary full-body dance driving clip

### Cross-scale compact 3D pug mascot swap without adult-height stretching (`small-mascot-scale-5s`, 5s @ 480p)

- Prompt: "Replace the performer in the video with the compact 3D fawn pug mascot in the black FOURTHFEED crewneck sweatshirt from the reference image while preserving its compact ~0.65x pug proportions and keeping the studio background intact."
- Pass rule: pose_angle_corr >= 0.78, scale_ratio_accuracy >= 0.75, bg_ssim >= 0.80, duration_ratio >= 0.92
- Frozen image input: https://assets.fourthfeed.com/benchmarks/motion-swap-v1/ff-char-mascot-v2.png (sha256: `6dac5089a72539df560e8259e4d7535d00a25b922cebb5a3a24065ff44d6b996`) — Proprietary compact 3D pug mascot in FOURTHFEED crewneck; tests whether pipelines stretch small mascots to adult human height
- Frozen video input: https://assets.fourthfeed.com/benchmarks/motion-swap-v1/ff-driving-gesture-5s-v1.mp4 (sha256: `027b3edddb9cd5b76de11437f4c6fd3f0974bd8bc2d2b4bd095ed1d5940bde6d`) — 5s 480p 24fps proprietary full-body gesture driving clip

### Hand-across-face occlusion & rapid head-turn recovery (techwear courier) (`foreground-occlusion-5s`, 5s @ 480p)

- Prompt: "Replace the subject in the video with the courier in the amber FOURTHFEED pullover anorak from the reference image, maintaining clean face and chest identity when the hand passes across the face and during the 90-degree turn."
- Pass rule: pose_angle_corr >= 0.78, scale_ratio_accuracy >= 0.75, bg_ssim >= 0.80, duration_ratio >= 0.92
- Frozen image input: https://assets.fourthfeed.com/benchmarks/motion-swap-v1/ff-char-courier-v2.png (sha256: `2308d4cd327fdac3e03f3a9b04da5e1114116a706809e9fa09631479abadb351`) — Proprietary full-body courier in FOURTHFEED amber pullover anorak
- Frozen video input: https://assets.fourthfeed.com/benchmarks/motion-swap-v1/ff-driving-occlusion-5s-v1.mp4 (sha256: `eecf9d36bd8bff2fb29d37143e060df542ac0a74972e1215c475a94909696137`) — 5s 480p 24fps proprietary hand-across-face + head-turn driving clip

## Leaderboard (ranked by cases passed, then effective $/s)

| Subject | Cases passed | Pass rate | Effective $/s | Nominal $/s | Median time | 2D limb-angle correlation | Subject scale preservation | Background SSIM stability | Delivered duration ratio | Credits |
| --- | --- | --- | --- | --- | --- | --- | --- | --- | --- | --- |
| Kling Motion Control (2.6-motion-720p) | 3/3 | 100% (3/3) | $0.070/s | $0.070/s | 183.68s | 99.3% | 87.9% | 87.4% | 100.0% | Self-funded |
| Kling 3.0 Motion Control (3.0-motion-720p) | 3/3 | 100% (3/3) | $0.125/s | $0.126/s | 268.51s | 99.0% | 86.9% | 87.4% | 100.0% | Self-funded |
| Wan 2.2 Animate 14B Replace (Open-Weight) (2.2-14b-replace-480p-open) | 2/3 | 67% (2/3) | $0.059/s | $0.040/s | 65.42s | 90.3% | 70.7% | 97.8% | 100.0% | Self-funded |
| ByteDance DreamActor V2 (v2-motion-transfer) | 2/3 | 67% (2/3) | $0.062/s | $0.050/s | 143.1s | 86.0% | 79.7% | 87.8% | 100.0% | Self-funded |
| Higgsfield Genjutsu Lite Motion Transfer (lite-480p) | 2/3 | 67% (2/3) | $0.063/s | $0.050/s | 229.53s | 97.9% | 84.1% | 82.0% | 100.0% | Self-funded |
| each::labs Lockstep (lockstep-480p) | 2/3 | 67% (2/3) | $0.070/s | $0.047/s | 186.79s | 98.5% | 82.6% | 84.2% | 100.0% | Self-funded |

Want ready-made TikTok meme character-swap templates for your own photo or pet without tuning prompts? PugSoda: https://pugsoda.com (disclosure: we make PugSoda; it is not ranked in the benchmark table above).

Page: https://fourthfeed.com/benchmarks/motion-swap-v1
