| --- |
| pipeline_tag: text-to-video |
| --- |
| # Locomotion - Onnx DirectML Optimized |
|
|
| ## Amuse |
| https://www.amuse-ai.com/ |
|
|
| ## Samples |
| <div align="center"> |
| <table width="80%"> |
| <tr class="image-row"> |
| <td style="width: 50%; height: 50px; text-align: center;"> |
| <video controls> |
| <source src="https://huggingface.co/TensorStack/Locomotion-amuse/resolve/main/Sample.webm" type="video/webm"> |
| </video> |
| </td> |
| <td style="width: 50%; height: 50px; text-align: center;"> |
| <video controls> |
| <source src="https://huggingface.co/TensorStack/Locomotion-amuse/resolve/main/Sample2.webm" type="video/webm"> |
| </video> |
| </td> |
| </tr> |
| <tr class="text-row"> |
| <th>A cute happy Corgi playing in park.</th> |
| <th>A cute raccoon playing guitar in the beach.</th> |
| </tr> |
| <tr class="image-row"> |
| <td style="width: 50%; height: 50px; text-align: center;"> |
| <video controls> |
| <source src="https://huggingface.co/TensorStack/Locomotion-amuse/resolve/main/Sample3.webm" type="video/webm"> |
| </video> |
| </td> |
| <td style="width: 50%; height: 50px; text-align: center;"> |
| <video controls> |
| <source src="https://huggingface.co/TensorStack/Locomotion-amuse/resolve/main/Sample4.webm" type="video/webm"> |
| </video> |
| </td> |
| </tr> |
| <tr class="text-row"> |
| <th>A quiet beach at dawn and the waves gently lapping.</th> |
| <th>Black and white street photography of a rainy night in New York, reflections on wet pavement</th> |
| </tr> |
| </table> |
| </div> |
| |
|
|
| ### **Credits** |
| Thanks to the developers of the following repositories, their work was instrumental in getting TextToVideo working with ONNX |
| - [AnimateDiff](https://huggingface.co/guoyww/animatediff) |
| - [AnimateLCM](https://huggingface.co/wangfuyun/AnimateLCM) |
| - [Tune-A-Video](https://github.com/showlab/Tune-A-Video) |
| - [TemporalDiff](https://huggingface.co/CiaraRowles/TemporalDiff) |
| - [GIMM-VFI](https://github.com/GSeanCDAT/GIMM-VFI) |
| - [AnimateDiff-Evolved](https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved) |
| - [StoryDiffusion](https://github.com/HVision-NKU/StoryDiffusion) |
| - [ECCV2022-RIFE](https://github.com/hzwer/ECCV2022-RIFE) |
|
|