HF-Party (Hugging Face Party @ PyTorch Conference)

posted an update 6 days ago

Post

513

Run Qwen-Image-2512, the new SOTA text-to-image model! 💜

It's the top performing open diffusion model and has more realistic + accurate images/text.

Run locally with 14GB RAM via our Dynamic GGUF: unsloth/Qwen-Image-2512-GGUF

Guide: https://unsloth.ai/docs/models/qwen-image-2512

2 replies

·

Johannes

authored a paper 12 days ago

INTELLECT-3: Technical Report

Paper • 2512.16144 • Published 19 days ago • 16

danielhanchen

posted an update 14 days ago

Post

3818

You can now run GLM-4.7, the new 355B parameter SOTA model on your local device (128GB RAM).✨

The model achieves SOTA performance on coding, agentic and chat benchmarks.

GGUF: unsloth/GLM-4.7-GGUF
Guide: https://docs.unsloth.ai/models/glm-4.7

3 replies

·

danielhanchen

posted an update 18 days ago

Post

2290

Google releases FunctionGemma, a new 270M parameter model that runs on just 0.5 GB RAM.✨

Built for tool-calling, run locally on your phone at 50+ tokens/s, or fine-tune with Unsloth & deploy to your phone.

GGUF: unsloth/functiongemma-270m-it-GGUF
Docs + Notebook: https://docs.unsloth.ai/models/functiongemma

2 replies

·

kenobi

authored 3 papers 21 days ago

On Invariance Penalties for Risk Minimization

Paper • 2106.09777 • Published Jun 17, 2021

Generating (Factual?) Narrative Summaries of RCTs: Experiments with Neural Multi-Document Summarization

Paper • 2008.11293 • Published Aug 25, 2020

Bayesian Deep Learning for Exoplanet Atmospheric Retrieval

Paper • 1811.03390 • Published Nov 8, 2018

danielhanchen

posted an update 22 days ago

Post

5331

NVIDIA releases Nemotron 3 Nano, a new 30B hybrid reasoning model! 🔥

Has 1M context window & best in class performance for SWE-Bench, reasoning & chat. Run the MoE model locally with 24GB RAM.

GGUF: unsloth/Nemotron-3-Nano-30B-A3B-GGUF
💚 Step-by-step Guide: https://docs.unsloth.ai/models/nemotron-3

1 reply

·

woojun-jung

authored a paper 25 days ago

Visual Funnel: Resolving Contextual Blindness in Multimodal Large Language Models

Paper • 2512.10362 • Published 26 days ago • 1

danielhanchen

posted an update 26 days ago

Post

2057

Mistral's new SOTA coding models Devstral 2 can now be Run locally! (25GB RAM) 🐱
We fixed the chat template, so performance should be much better now!
24B: unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF
123B: unsloth/Devstral-2-123B-Instruct-2512-GGUF

🧡Step-by-step Guide: https://docs.unsloth.ai/models/devstral-2

Aurelien-Morgan

posted an update 27 days ago

Post

319

Hey, I went to Hangzhou to talk about retrain-pipelines at the GOSIM Foundation's conference last september.
The recording just got released. Go check it out !
https://www.youtube.com/watch?v=nmrMachM5aM
Slides are there :
https://docs.google.com/presentation/d/1hnAzHJ0SbeAOtGJir-iH84RBtXT1OxVT/

2 replies

·

danielhanchen

posted an update about 1 month ago

Post

3709

Mistral's new Ministral 3 models can now be Run & Fine-tuned locally! (16GB RAM)
Ministral 3 have vision support and the best-in-class performance for their sizes.
14B Instruct GGUF: unsloth/Ministral-3-14B-Instruct-2512-GGUF
14B Reasoning GGUF: unsloth/Ministral-3-14B-Reasoning-2512-GGUF

🐱 Step-by-step Guide: https://docs.unsloth.ai/new/ministral-3
All GGUFs, BnB, FP8 etc. variants uploads: https://huggingface.co/collections/unsloth/ministral-3

3 replies

·

danielhanchen

posted an update about 1 month ago

Post

8485

Qwen3-Next can now be Run locally! (30GB RAM)
Instruct GGUF: unsloth/Qwen3-Next-80B-A3B-Instruct-GGUF

The models come in Thinking and Instruct versions and utilize a new architecture, allowing it to have ~10x faster inference than Qwen32B.
💜 Step-by-step Guide: https://docs.unsloth.ai/models/qwen3-next

Thinking GGUF: unsloth/Qwen3-Next-80B-A3B-Thinking-GGUF

JingzeShi

posted an update about 2 months ago

Post

245

Is it time to start developing sparse attention again?
https://github.com/SmallDoges/flash-sparse-attention

danielhanchen

posted an update about 2 months ago

Post

4388

You can now run Kimi K2 Thinking locally with our Dynamic 1-bit GGUFs: unsloth/Kimi-K2-Thinking-GGUF

We shrank the 1T model to 245GB (-62%) & retained ~85% of accuracy on Aider Polyglot. Run on >247GB RAM for fast inference.

We also collaborated with the Moonshot AI Kimi team on a system prompt fix! 🥰

Guide + fix details: https://docs.unsloth.ai/models/kimi-k2-thinking-how-to-run-locally

mbrack

authored a paper 3 months ago

UniFusion: Vision-Language Model as Unified Encoder in Image Generation

Paper • 2510.12789 • Published Oct 14, 2025 • 18

osanseviero

authored a paper 3 months ago

EmbeddingGemma: Powerful and Lightweight Text Representations

Paper • 2509.20354 • Published Sep 24, 2025 • 42

teknium

authored 2 papers 4 months ago

Hermes 3 Technical Report

Paper • 2408.11857 • Published Aug 15, 2024 • 56

Hermes 4 Technical Report

Paper • 2508.18255 • Published Aug 25, 2025 • 44

jeffboudier

posted an update 4 months ago

Post

3100

Quick 30s demo of the new Hub > Azure AI integration to deploy HF models in your own Azure account. Now with Py and CLI!

GG @alvarobartt @kramp @pagezyhf

AI & ML interests

Team members 193

HF-Party's activity