How do you create an EAGLE3 draft model for a chosen target model?
#2
by wimmmm - opened
Hi,
Bit of a general / generic question, but how do you train these models? I would like to experiment with creating some EAGLE3 drafters for other models.
not for the light hearted...this is an over simplified answer.. but read up on EAGLE-3 here: https://arxiv.org/abs/2503.01840, and here: https://docs.nvidia.com/nemo/rl/nightly/guides/eagle3-speculative-decoding.html,