Foundation Text-Generation Models Below 360M Parameters
Great candidates for fine-tuning targeting Wllama and Transformers.js for mobile devices, ordered by number of parameters.
Text Generation • 0.4B • Updated • 116k • 143Note License: apache-2.0 Context Length: 8k
facebook/MobileLLM-R1-360M-base
Text Generation • 0.4B • Updated • 179 • 14Note License: fair-noncommercial-research Context Length: 4k
LiquidAI/LFM2.5-350M-Base
Text Generation • 0.4B • Updated • 6.1k • 37Note License: lfm1.0 Context Length: 32k
PleIAs/Pleias-350m-Preview
0.4B • Updated • 1.88k • 27Note License: apache-2.0 Context Length: 2k
OuteAI/Lite-Oute-1-300M
Text Generation • 0.3B • Updated • 14.2k • 9Note License: apache-2.0 Context Length: 4k
keeeeenw/MicroLlama
Text Generation • 0.3B • Updated • 1.08k • 53Note License: apache-2.0 Context Length: 2k
google/gemma-3-270m
Text Generation • 0.3B • Updated • 68.9k • 1.13kNote License: gemma Context Length: 32k
UUFO-Aigis/Pico-OpenLAiNN-250M
0.3B • Updated • 16 • 3Note License: apache-2.0 Context Length: 2k
upstage/TinySolar-248m-4k
Text Generation • 0.2B • Updated • 1.01k • 12Note License: apache-2.0 Context Length: 4k
M4-ai/TinyMistral-248M-v3
Text Generation • 0.2B • Updated • 136 • 8Note License: apache-2.0 Context Length: 2k
LiquidAI/LFM2.5-230M-Base
Text Generation • 0.2B • Updated • 188k • 25Note License: lfm1.0 Context Length: 32k
MiniLLM/MiniPLM-llama3.1-212M
Text Generation • 0.2B • Updated • 32 • 6Note License: apache-2.0 Context Length: 1k
MiniLLM/MiniPLM-Qwen-200M
Text Generation • 0.2B • Updated • 3.34k • 10Note License: apache-2.0 Context Length: 1k
xTimeCrystal/MiniModel-200M-Base
Text Generation • 0.2B • Updated • 98 • 30Note License: apache-2.0 Context Length: 2k
princeton-nlp/Sheared-Pythia-160m
Text Generation • Updated • 98 • 4Note License: apache-2.0 Context Length: 2k
JackFram/llama-160m
Text Generation • 0.2B • Updated • 41.8k • 37Note License: apache-2.0 Context Length: 2k
SmallDoge/Doge-160M
Text Generation • 0.2B • Updated • 133 • 7Note License: apache-2.0 Context Length: 2k
EleutherAI/pythia-160m
Text Generation • 0.2B • Updated • 3.4M • 66Note License: apache-2.0 Context Length: 2k
BananaMind/BananaMind-2-Pro-Preview
Text Generation • 0.2B • Updated • 167 • 23Note License: other (bananamind-community-license-1.0) Context Length: 3k
Harikrish2727/BetterGPT-150M
Text Generation • 0.2B • Updated • 127 • 2Note License: apache-2.0 Context Length: 2k
jhu-clsp/ettin-decoder-150m
Fill-Mask • Updated • 2.84k • 6Note License: mit Context Length: 8k
StentorLabs/Portimbria-150M
Text Generation • 0.2B • Updated • 67 • 11Note License: apache-2.0 Context Length: 4k
AuroraAI-Research/Aurora1.0-150M
Text Generation • 0.1B • Updated • 587 • 15Note License: apache-2.0 Context Length: 1k
facebook/MobileLLM-R1-140M-base
Text Generation • 0.1B • Updated • 86 • 23Note License: fair-noncommercial-research Context Length: 4k
joelhenwang/OdinNext-138M-Base
Text Generation • 0.1B • Updated • 102 • 3Note License: apache-2.0 Context Length: 2k
openai-community/gpt2
Text Generation • 0.1B • Updated • 24.8M • 3.9kNote License: mit Context Length: 1k
HuggingFaceTB/SmolLM2-135M
Text Generation • 0.1B • Updated • 2.35M • 264Note License: apache-2.0 Context Length: 8k
amd/AMD-Llama-135m
Text Generation • 0.1B • Updated • 8.54k • 120Note License: apache-2.0 Context Length: 2k
AxiomicLabs/GPT-X2.5-135M
Text Generation • 0.1B • Updated • 1.06k • 67Note License: apache-2.0 Context Length: 8k
MaliosDark/Nexus-Erebus-135M
Text Generation • 0.1B • Updated • 37 • 10Note License: other Context Length: 1k
MiniLLM/MiniPLM-Mamba-130M
Text Generation • 0.1B • Updated • 53 • 4Note License: apache-2.0 Context Length: 1k
Nikity/lille-130m-base
Text Generation • 0.1B • Updated • 104 • 18Note License: apache-2.0 Context Length: 0.5k
EleutherAI/gpt-neo-125m
Text Generation • 0.2B • Updated • 467k • 231Note License: mit Context Length: 2k
opencerebral/Boris-1.3-125M
Text Generation • 0.1B • Updated • 571 • 4Note License: apache-2.0 Context Length: 1k
TobiasLogic/Museko-125M
Text Generation • 0.1B • Updated • 59 • 9Note License: apache-2.0 Context Length: 2k
facebook/opt-125m
Text Generation • Updated • 4.8M • 333Note License: other (OPT-175B License Agreement, non-commercial research only) Context Length: 2k
BEE-spoke-data/smol_llama-101M-GQA
Text Generation • 0.1B • Updated • 1.02k • 33Note License: apache-2.0 Context Length: 1k
UUFO-Aigis/Pico-OpenLAiNN-100M
0.1B • Updated • 10 • 2Note License: apache-2.0 Context Length: 2k
SupraLabs/Supra2-100M-Base
Text Generation • 0.1B • Updated • 2.18k • 31Note License: apache-2.0 Context Length: 1k
raincandy-u/Rain-100M
Text Generation • 97.2M • Updated • 381 • 23Note License: apache-2.0 Context Length: 4k
FlameF0X/TinyMoE-100m-2x8-retrained
Text Generation • 99.8M • Updated • 617 • 3Note License: mit Context Length: 1k
Sandroeth/cali-0.1B
Text Generation • 0.1B • Updated • 78 • 5Note License: apache-2.0 Context Length: 1k
HuggingFaceTB/nanowhale-100m-base
Text Generation • 0.1B • Updated • 1.15k • 25Note License: apache-2.0 Context Length: 2k
Felladrin/Minueza-2-96M
Text Generation • 96M • Updated • 109 • 7Note License: apache-2.0 Context Length: 4k
Felladrin/Minueza-3-95M-Base
Text Generation • 94.7M • Updated • 103 • 3Note License: apache-2.0 Context Length: 8k
finnianx/Gros-Michel-90m-Base-v2
94.9M • Updated • 53 • 6Note License: not specified Context Length: 1k
appvoid/palmer-006
Text Generation • 91.1M • Updated • 523 • 10Note License: other (appvoid-noncommercial-model-license-1.0) Context Length: 256k
distilbert/distilgpt2
Text Generation • 88.2M • Updated • 1.54M • 665Note License: apache-2.0 Context Length: 1k
Quazim0t0/Escarda-86M-Base
Text Generation • 97.3M • Updated • 181 • 5Note License: apache-2.0 Context Length: 4k
Quazim0t0/Byrne-86M-Base
Text Generation • 96.9M • Updated • 153 • 4Note License: apache-2.0 Context Length: 4k
weiser/82M-0.4
Text Generation • 82.1M • Updated • 15Note License: apache-2.0 Context Length: 1k
BEE-spoke-data/smol_llama-81M-tied
Text Generation • 81.3M • Updated • 111 • 10Note License: apache-2.0 Context Length: 1k
opencerebral/Boris-1.3-75M
Text Generation • 77.4M • Updated • 722 • 1Note License: apache-2.0 Context Length: 1k
MinimaLabs/KeyLM-75M
Text Generation • 75.3M • Updated • 135 • 18Note License: apache-2.0 Context Length: 2k
GODELEV/Archaea-74M-V1.1
Text Generation • 74M • Updated • 41 • 4Note License: mit Context Length: 1k
EleutherAI/pythia-70m
95.6M • Updated • 238k • 87Note License: apache-2.0 Context Length: 2k
JackFram/llama-68m
Text Generation • Updated • 75.4k • 38Note License: apache-2.0 Context Length: 2k
jhu-clsp/ettin-decoder-68m
Fill-Mask • Updated • 616 • 2Note License: mit Context Length: 8k
OuteAI/Lite-Oute-1-65M
Text Generation • 65M • Updated • 29 • 12Note License: apache-2.0 Context Length: 2k
WhirlwindAI/MetaNova-1-60M
Text Generation • 62.7M • Updated • 158 • 8Note License: apache-2.0 Context Length: 3k
SmallDoge/Doge-60M
Text Generation • 54.6M • Updated • 109 • 5Note License: apache-2.0 Context Length: 2k
BananaMind/BananaMind-2-Medium
Text Generation • 55.9M • Updated • 330 • 17Note License: apache-2.0 Context Length: 3k
MaliosDark/Nexus-Erebus-50M
Text Generation • 54.1M • Updated • 61 • 8Note License: apache-2.0 Context Length: 1k
MaliosDark/Isabel-50M
Text Generation • 54.1M • Updated • 62 • 11Note License: apache-2.0 Context Length: 1k
SupraLabs/Supra-50M-Base
Text Generation • 51.8M • Updated • 818 • 47Note License: apache-2.0 Context Length: 1k
veyra-ai/Veyra2-Apricot-50M-Base
Text Generation • 49.3M • Updated • 743 • 17Note License: apache-2.0 Context Length: 2k
StentorLabs/Stentor3-50M
Text Generation • 49.4M • Updated • 114 • 7Note License: apache-2.0 Context Length: 4k
GODELEV/Rose-Mini
Text Generation • 49.4M • Updated • 189 • 16Note License: apache-2.0 Context Length: 1k
harrrshall/BarunLM-35M
Text Generation • 35.1M • Updated • 55Note License: apache-2.0 Context Length: 2k
sabari2005/cyberslm-33m-base
Text Generation • 33.5M • Updated • 27 • 1Note License: apache-2.0 Context Length: 4k
Felladrin/Minueza-32M-Base
Text Generation • 32.8M • Updated • 1.31k • 19Note License: apache-2.0 Context Length: 2k
GerbilLab/Gerbil-A-32m
Text Generation • Updated • 67 • 2Note License: apache-2.0 Context Length: 2k
jhu-clsp/ettin-decoder-32m
Text Generation • Updated • 825Note License: mit Context Length: 8k
fromziro/Er-Large-30M
31.9M • Updated • 72 • 4Note License: apache-2.0 Context Length: 1k
EleutherAI/pythia-31m-deduped
Text Generation • 55.7M • Updated • 1.92k • 5Note License: apache-2.0 Context Length: 2k
BananaMind/BananaMind-2-Mini
Text Generation • 28.3M • Updated • 152 • 14Note License: apache-2.0 Context Length: 4k
BananaMind/BananaMind-2-MoE
Text Generation • 26.1M • Updated • 312 • 10Note License: apache-2.0 Context Length: 4k
SmallDoge/Doge-20M
Text Generation • 13.1M • Updated • 1.18k • 13Note License: apache-2.0 Context Length: 2k
StentorLabs/Stentor3-20M
Text Generation • 20.3M • Updated • 56 • 6Note License: apache-2.0 Context Length: 4k
jhu-clsp/ettin-decoder-17m
Fill-Mask • Updated • 1.88k • 2Note License: mit Context Length: 8k
MultivexAI/Plyx-15M
Text Generation • 16.1M • Updated • 43 • 6Note License: apache-2.0 Context Length: 512
EleutherAI/pythia-14m-deduped
Text Generation • 39.2M • Updated • 7.45k • 32Note License: apache-2.0 Context Length: 2k
fromziro/Er-Medium-12.5M
12.5M • Updated • 106 • 11Note License: apache-2.0 Context Length: 384
BananaMind/BananaMind-2-Nano
Text Generation • 12.1M • Updated • 231 • 13Note License: apache-2.0 Context Length: 4k
liodon-ai/slm-10m
Text Generation • 12.1M • Updated • 109 • 13Note License: apache-2.0 Context Length: 1k
Dream-W/ObsidianSmall-Base
Text Generation • 9.77M • Updated • 30 • 4Note License: not specified Context Length: 1k
User01110/CMA-8M
Text Generation • 9.08M • Updated • 194 • 22Note License: apache-2.0 Context Length: 1k
DedeProGames/DynamicMind-Mini
8.88M • Updated • 134 • 5Note License: apache-2.0 Context Length: 1k
Harley-ml/Tenete-8M
Text Generation • 8.29M • Updated • 67 • 8Note License: mit Context Length: 1k
AtomixLabs/AtomixS2-5M-v1.0
Text Generation • 5.98M • Updated • 182 • 3Note License: apache-2.0 Context Length: 512
LH-Tech-AI/Spark-5M-Base-v4
Text Generation • 4.98M • Updated • 26 • 3Note License: not specified Context Length: 512
MaliosDark/Nexus-Erebus-3M
Text Generation • 3M • Updated • 31 • 3Note License: mit Context Length: 512
UniversalComputingResearch/Atom2.7m
Text Generation • 2.74M • Updated • 149 • 16Note License: apache-2.0 Context Length: 512
MihaiPopa-1/CinnabarLM-1.4M-Base
Text Generation • 1.51M • Updated • 33Note License: apache-2.0 Context Length: 2k
Harley-ml/Dillionv2-1.3M
Text Generation • 1.29M • Updated • 166 • 5Note License: mit Context Length: 384
fromziro/Er-Tiny-1.3M
1.33M • Updated • 57 • 7Note License: apache-2.0 Context Length: 384
56m/Dumb-1.2-RC1
Text Generation • 34.6M • Updated • 35Note License: apache-2.0 Context Length: 1k
AtomixLabs/Photon-2.0-1M
Text Generation • 1.05M • Updated • 35 • 8Note License: apache-2.0 Context Length: 512
Glint-Research/Glint-1.3
Updated • 86 • 13Note License: mit Context Length: 256