Instructions to use iFaz/eqm-pusht-seed3-half with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LeRobot
How to use iFaz/eqm-pusht-seed3-half with LeRobot:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Add auto-generated model card from override dicts
Browse files
README.md
CHANGED
|
@@ -1,62 +1,106 @@
|
|
| 1 |
---
|
| 2 |
-
datasets:
|
|
|
|
|
|
|
| 3 |
library_name: lerobot
|
| 4 |
license: apache-2.0
|
| 5 |
-
model_name: eqm
|
| 6 |
-
pipeline_tag: robotics
|
| 7 |
tags:
|
| 8 |
- robotics
|
|
|
|
| 9 |
- eqm
|
| 10 |
-
-
|
|
|
|
| 11 |
---
|
| 12 |
|
| 13 |
-
#
|
| 14 |
|
| 15 |
-
|
|
|
|
|
|
|
| 16 |
|
|
|
|
| 17 |
|
| 18 |
-
|
| 19 |
-
|
| 20 |
|
| 21 |
-
|
| 22 |
-
|
|
|
|
| 23 |
|
| 24 |
---
|
| 25 |
|
| 26 |
-
##
|
| 27 |
|
| 28 |
-
|
| 29 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 30 |
|
| 31 |
-
|
| 32 |
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
|
| 38 |
-
|
| 39 |
-
|
| 40 |
-
|
| 41 |
-
|
| 42 |
-
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 43 |
|
| 44 |
-
|
| 45 |
|
| 46 |
-
##
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 47 |
|
| 48 |
-
|
| 49 |
-
lerobot-record \
|
| 50 |
-
--robot.type=so100_follower \
|
| 51 |
-
--dataset.repo_id=<hf_user>/eval_<dataset> \
|
| 52 |
-
--policy.path=<hf_user>/<desired_policy_repo_id> \
|
| 53 |
-
--episodes=10
|
| 54 |
-
```
|
| 55 |
|
| 56 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 57 |
|
| 58 |
---
|
| 59 |
|
| 60 |
-
##
|
| 61 |
|
| 62 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
datasets:
|
| 3 |
+
- lerobot/pusht
|
| 4 |
+
language: en
|
| 5 |
library_name: lerobot
|
| 6 |
license: apache-2.0
|
|
|
|
|
|
|
| 7 |
tags:
|
| 8 |
- robotics
|
| 9 |
+
- imitation-learning
|
| 10 |
- eqm
|
| 11 |
+
- mujoco
|
| 12 |
+
- pytorch_model_hub_mixin
|
| 13 |
---
|
| 14 |
|
| 15 |
+
# EQM Policy โ eqm_pusht_seed3
|
| 16 |
|
| 17 |
+
Trained with [LeRobot](https://github.com/huggingface/lerobot).
|
| 18 |
+
Date: `2026-08-22 19:29`
|
| 19 |
+
Policy type: `eqm` | Device: `cuda`
|
| 20 |
|
| 21 |
+
---
|
| 22 |
|
| 23 |
+
## ๐ฆ Dataset
|
|
|
|
| 24 |
|
| 25 |
+
| Parameter | Value |
|
| 26 |
+
|---|---|
|
| 27 |
+
| `dataset.repo_id` | `lerobot/pusht` |
|
| 28 |
|
| 29 |
---
|
| 30 |
|
| 31 |
+
## ๐๏ธ Training Config
|
| 32 |
|
| 33 |
+
| Parameter | Value |
|
| 34 |
+
|---|---|
|
| 35 |
+
| `steps` | `20000` |
|
| 36 |
+
| `batch_size` | `8` |
|
| 37 |
+
| `eval_freq` | `0` |
|
| 38 |
+
| `save_freq` | `10000` |
|
| 39 |
+
| `num_workers` | `4` |
|
| 40 |
+
| `seed` | `3` |
|
| 41 |
+
| `eval.n_episodes` | `1` |
|
| 42 |
+
| `eval.batch_size` | `1` |
|
| 43 |
+
| `eval.use_async_envs` | `True` |
|
| 44 |
|
| 45 |
+
---
|
| 46 |
|
| 47 |
+
## ๐ Policy Architecture
|
| 48 |
+
|
| 49 |
+
| Parameter | Value |
|
| 50 |
+
|---|---|
|
| 51 |
+
| `use_context_aware_encoder` | `True` |
|
| 52 |
+
| `context_aware_encoder_name` | `facebook/dinov2-with-registers-small` |
|
| 53 |
+
| `context_aware_embodied_pooling` | `spatial_softmax` |
|
| 54 |
+
| `context_aware_num_register_tokens` | `4` |
|
| 55 |
+
| `context_aware_freeze_backbone` | `False` |
|
| 56 |
+
| `resize_shape` | `(224, 224)` |
|
| 57 |
+
| `spatial_softmax_num_keypoints` | `32` |
|
| 58 |
+
| `enable_world_model` | `True` |
|
| 59 |
+
| `jepa_encoder_name` | `facebook/vjepa2-vitl-fpc64-256` |
|
| 60 |
+
| `freeze_jepa_encoder` | `True` |
|
| 61 |
+
| `jepa_tubelet_size` | `2` |
|
| 62 |
+
| `num_video_frames` | `8` |
|
| 63 |
+
| `predictor_depth` | `12` |
|
| 64 |
+
| `predictor_num_heads` | `8` |
|
| 65 |
+
| `predictor_mlp_ratio` | `4.0` |
|
| 66 |
+
| `num_action_tokens_per_timestep` | `4` |
|
| 67 |
+
| `world_model_loss_weight` | `0.6` |
|
| 68 |
+
| `num_predictor_views` | `2` |
|
| 69 |
|
| 70 |
+
---
|
| 71 |
|
| 72 |
+
## ๐ฏ Eval Config
|
| 73 |
+
|
| 74 |
+
| Parameter | Value |
|
| 75 |
+
|---|---|
|
| 76 |
+
| `env.type` | `pusht` |
|
| 77 |
+
| `env.task` | `PushT-v0` |
|
| 78 |
+
| `eval.n_episodes` | `100` |
|
| 79 |
+
| `eval.batch_size` | `4` |
|
| 80 |
+
| `eval.use_async_envs` | `False` |
|
| 81 |
+
| `policy.path` | `/kaggle/working/outputs/train/pusht_seed3/checkpoints/last/pretrained_model` |
|
| 82 |
+
|
| 83 |
+
---
|
| 84 |
|
| 85 |
+
## ๐ Eval Results
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 86 |
|
| 87 |
+
| Metric | Value |
|
| 88 |
+
|---|---|
|
| 89 |
+
| Episodes | `100` |
|
| 90 |
+
| Success rate | `1.0%` |
|
| 91 |
+
| Avg sum reward | `50.40` |
|
| 92 |
+
| Avg max reward | `0.45` |
|
| 93 |
+
| Eval time (s) | `521.8` |
|
| 94 |
|
| 95 |
---
|
| 96 |
|
| 97 |
+
## Citation
|
| 98 |
|
| 99 |
+
```bibtex
|
| 100 |
+
@misc{cadene2024lerobot,
|
| 101 |
+
author = {Cadene, Remi and Alibert, Simon and others},
|
| 102 |
+
title = {LeRobot},
|
| 103 |
+
year = {2024},
|
| 104 |
+
url = {https://github.com/huggingface/lerobot}
|
| 105 |
+
}
|
| 106 |
+
```
|