Instructions to use CompVis/WhatMoves with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Wan2.2
How to use CompVis/WhatMoves with Wan2.2:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
WhatMoves checkpoints
Released checkpoints for WhatMoves, a promptable model for localized motion representations and transfer.
| File | Contents |
|---|---|
what_moves/gated_static_step600000.pt |
Compact inference checkpoint for the WhatMoves motion encoder |
wan/gated_static_step600000/adapter_step30500.pt |
Motion projector and LoRA deltas for Wan2.2 I2V-A14B |
wan/gated_static_step600000/metadata.json |
Architecture, provenance, and SHA-256 metadata |
The source repository provides the model definitions and Torch Hub entrypoints; these files are not intended to be loaded with a generic Diffusers pipeline.
Licensing
This repository contains mixed-license model artifacts:
- Original WhatMoves parameters are released under the MIT License.
- The WhatMoves checkpoint incorporates parameters initialized from DINOv2, licensed under Apache License 2.0.
- The motion-transfer adapter is designed to operate over Wan2.2 I2V-A14B, whose code and base weights are licensed under Apache License 2.0. The base Wan weights are not redistributed here.
The MIT license does not supersede the licenses or notices of the upstream
components. See the source repository's LICENSE, THIRD_PARTY_NOTICES.md,
and bundled Apache License 2.0 text for the complete notices.