AI & ML interests
None defined yet.
Recent Activity
View all activity
sergiopaniego
posted
an
update
about 9 hours ago
sergiopaniego
updated
a
dataset
about 16 hours ago
pcuenq
updated
a
dataset
3 days ago
sergiopaniego
posted
an
update
3 days ago
Post
1886
🎄 last talk of the year about open AI and HF today at Universidad Rey Juan Carlos for undergrad students
always a pleasure to be back at my alma mater
🎅 slides: https://github.com/sergiopaniego/talks
always a pleasure to be back at my alma mater
🎅 slides: https://github.com/sergiopaniego/talks
- 1 reply
akhaliq
submitted
a
paper
to Daily Papers
4 days ago
sergiopaniego
posted
an
update
4 days ago
Post
1541
TRL now includes agent training support for GRPO‼️
Train 🕵️ agents with 🔧 tools, enabling interaction with external functions and APIs.
And of course, a new notebook and scripts to get you up to speed
📘 notebook tutorial: https://github.com/huggingface/trl/blob/main/examples/notebooks/grpo_agent.ipynb
📂 script examples: https://github.com/huggingface/trl/blob/main/examples/scripts/grpo_agent.py
📦 TRL v0.26.0 release: https://github.com/huggingface/trl/releases/tag/v0.26.0
Train 🕵️ agents with 🔧 tools, enabling interaction with external functions and APIs.
And of course, a new notebook and scripts to get you up to speed
📘 notebook tutorial: https://github.com/huggingface/trl/blob/main/examples/notebooks/grpo_agent.ipynb
📂 script examples: https://github.com/huggingface/trl/blob/main/examples/scripts/grpo_agent.py
📦 TRL v0.26.0 release: https://github.com/huggingface/trl/releases/tag/v0.26.0
-
- 2 replies
sergiopaniego
posted
an
update
5 days ago
Post
2746
ICYMI, you can fine-tune open LLMs using Claude Code
just tell it:
“Fine-tune Qwen3-0.6B on open-r1/codeforces-cots”
and Claude submits a real training job on HF GPUs using TRL.
it handles everything:
> dataset validation
> GPU selection
> training + Trackio monitoring
> job submission + cost estimation
when it’s done, your model is on the Hub, ready to use
read more about the process: https://huggingface.co/blog/hf-skills-training
just tell it:
“Fine-tune Qwen3-0.6B on open-r1/codeforces-cots”
and Claude submits a real training job on HF GPUs using TRL.
it handles everything:
> dataset validation
> GPU selection
> training + Trackio monitoring
> job submission + cost estimation
when it’s done, your model is on the Hub, ready to use
read more about the process: https://huggingface.co/blog/hf-skills-training
sergiopaniego
posted
an
update
5 days ago
Post
2181
We just released TRL v0.26.0!
It comes packed with updates:
> Agent training with tools in GRPO
> New CISPO & SAPO losses + reasoning rewards
> vLLM quantization in colocate mode
> Dataset shuffling in SFT
> Lots of NEW examples
> Tons of fixes and documentation improvements
It comes packed with updates:
> Agent training with tools in GRPO
> New CISPO & SAPO losses + reasoning rewards
> vLLM quantization in colocate mode
> Dataset shuffling in SFT
> Lots of NEW examples
> Tons of fixes and documentation improvements
-
- 3 replies
akhaliq
submitted
a
paper
to Daily Papers
6 days ago
sergiopaniego
posted
an
update
6 days ago
Post
2856
NEW:
@EssentialAI
just released Rnj-1, their first 8B model.
You can easily fine-tune it with GRPO using TRL to add reasoning capabilities to a compact mode
Free Colab link: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/grpo_rnj_1_instruct.ipynb
More free TRL notebooks: https://huggingface.co/docs/trl/main/en/example_overview#notebooks
You can easily fine-tune it with GRPO using TRL to add reasoning capabilities to a compact mode
Free Colab link: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/grpo_rnj_1_instruct.ipynb
More free TRL notebooks: https://huggingface.co/docs/trl/main/en/example_overview#notebooks
sergiopaniego
posted
an
update
10 days ago
Post
2809
Want to get started with fine-tuning but don’t know where to begin? 🤓☝️
We’re expanding our collection of beginner-friendly free Colab notebooks so you can learn and fine-tune models using TRL at no cost
🔬 Check out the full list of free notebooks: https://huggingface.co/docs/trl/main/en/example_overview#notebooks
🔬 If you want more advanced content, we also have a lot to cover in the community tutorials: https://huggingface.co/docs/trl/community_tutorials
And now the obvious question: what would you like us to add next?
We’re expanding our collection of beginner-friendly free Colab notebooks so you can learn and fine-tune models using TRL at no cost
🔬 Check out the full list of free notebooks: https://huggingface.co/docs/trl/main/en/example_overview#notebooks
🔬 If you want more advanced content, we also have a lot to cover in the community tutorials: https://huggingface.co/docs/trl/community_tutorials
And now the obvious question: what would you like us to add next?
sergiopaniego
posted
an
update
12 days ago
Post
2342
NEW:
@mistralai
released a fantastic family of multimodal models, Ministral 3.
You can fine-tune them for free on Colab using TRL ⚡️, supporting both SFT and GRPO
Link to the notebooks:
- SFT: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/sft_ministral3_vl.ipynb
- GRPO: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/grpo_ministral3_vl.ipynb
- TRL and more examples: https://huggingface.co/docs/trl/index
You can fine-tune them for free on Colab using TRL ⚡️, supporting both SFT and GRPO
Link to the notebooks:
- SFT: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/sft_ministral3_vl.ipynb
- GRPO: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/grpo_ministral3_vl.ipynb
- TRL and more examples: https://huggingface.co/docs/trl/index
-
- 2 replies
sergiopaniego
posted
an
update
13 days ago
Post
2169
ICYMI, transformers v5 is out!
Grab a coffee ☕ and go read the announcement blog https://huggingface.co/blog/transformers-v5
Grab a coffee ☕ and go read the announcement blog https://huggingface.co/blog/transformers-v5
sergiopaniego
posted
an
update
14 days ago
Post
3098
want to use open models easily through an API?
Inference Providers might be exactly what you’re looking for sooo here’s a complete beginner-friendly walkthrough 🧐
https://www.youtube.com/watch?v=oxwsizy1Spw
Inference Providers might be exactly what you’re looking for sooo here’s a complete beginner-friendly walkthrough 🧐
https://www.youtube.com/watch?v=oxwsizy1Spw
-
- 2 replies
sergiopaniego
posted
an
update
18 days ago
Post
1746
nanochat is now in transformers!
The LLM by @karpathy is officially in the library, and we wrote a blog covering: how did we port the model, differences from the original, and how to run or train it.
go read it 🤓
nanochat-students/transformers
The LLM by @karpathy is officially in the library, and we wrote a blog covering: how did we port the model, differences from the original, and how to run or train it.
go read it 🤓
nanochat-students/transformers
sergiopaniego
posted
an
update
20 days ago
Post
3962
you gotta go fast and go read the latest blog by
@ror
et al. explaining Continuous Batching in depth
https://huggingface.co/blog/continuous_batching
https://huggingface.co/blog/continuous_batching
sergiopaniego
posted
an
update
21 days ago
Post
1720
Interested in RL training environments?
We just released a beginner-friendly walkthrough notebook!
Train a model to play Wordle using TRL + OpenEnv (TextArena) + GRPO + vLLM.
happy learning! 🌱
Notebook: https://github.com/huggingface/trl/blob/main/examples/notebooks/openenv_wordle_grpo.ipynb
OpenEnv guide in TRL: https://huggingface.co/docs/trl/main/en/openenv
We just released a beginner-friendly walkthrough notebook!
Train a model to play Wordle using TRL + OpenEnv (TextArena) + GRPO + vLLM.
happy learning! 🌱
Notebook: https://github.com/huggingface/trl/blob/main/examples/notebooks/openenv_wordle_grpo.ipynb
OpenEnv guide in TRL: https://huggingface.co/docs/trl/main/en/openenv
sergiopaniego
posted
an
update
25 days ago
Post
332
Ya está disponible el vídeo de la charla del otro día en
@nerdearla
sobre IA abierta, por si queréis verla! 🤠
https://www.youtube.com/watch?v=p-JLn4xAkMw
https://www.youtube.com/watch?v=p-JLn4xAkMw
- 1 reply
sergiopaniego
posted
an
update
26 days ago
Post
2586
we've just added several example scripts to TRL showing how to train models with GRPO using some of the new OpenEnv environments
train a model to interact with a browser (🎮 BrowserGym Env), play Wordle (🎮 Wordle Env) and moooore!
TRL (GRPO + vLLM) + OpenEnv! ⚡️
📝 go play with them: https://github.com/huggingface/trl/tree/main/examples/scripts/openenv
📝 examples list: https://huggingface.co/docs/trl/main/en/example_overview#scripts
train a model to interact with a browser (🎮 BrowserGym Env), play Wordle (🎮 Wordle Env) and moooore!
TRL (GRPO + vLLM) + OpenEnv! ⚡️
📝 go play with them: https://github.com/huggingface/trl/tree/main/examples/scripts/openenv
📝 examples list: https://huggingface.co/docs/trl/main/en/example_overview#scripts
sergiopaniego
posted
an
update
28 days ago
