How do you create an EAGLE3 draft model for a chosen target model?

#2
by wimmmm - opened

Hi,

Bit of a general / generic question, but how do you train these models? I would like to experiment with creating some EAGLE3 drafters for other models.

Owner

not for the light hearted...this is an over simplified answer.. but read up on EAGLE-3 here: https://arxiv.org/abs/2503.01840, and here: https://docs.nvidia.com/nemo/rl/nightly/guides/eagle3-speculative-decoding.html,

Sign up or log in to comment