Efficient Knowledge Distillation for LLMs: Offline Top-K Logits and a Fused Chunked KL Loss
Paper • 2608.03796 • Published • 14
AI & ML interests
None defined yet.
Recent Activity
View all activity
Iker
submitted a
paper to Daily Papers 8 days ago
Iker
authored 5
papers 12 days ago
Efficient Knowledge Distillation for LLMs: Offline Top-K Logits and a Fused Chunked KL Loss
Paper • 2608.03796 • Published • 14
Refusal Steering: Fine-grained Control over LLM Refusal Behaviour for Sensitive Topics
Paper • 2512.16602 • Published
Instructing Large Language Models for Low-Resource Languages: A Systematic Study for Basque
Paper • 2506.07597 • Published
GuideX: Guided Synthetic Data Generation for Zero-Shot Information Extraction
Paper • 2506.00649 • Published • 4
Cross-Lingual Transfer for Low-Resource Natural Language Processing
Paper • 2502.02722 • Published
Iker
authored a
paper about 2 years ago
Iker
updated a
model about 2 years ago
Iker
authored 3
papers over 2 years ago
Medical mT5: An Open-Source Multilingual Text-to-Text LLM for The Medical Domain
Paper • 2404.07613 • Published
NoticIA: A Clickbait Article Summarization Dataset in Spanish
Paper • 2404.07611 • Published
NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmark
Paper • 2310.18018 • Published • 1
Iker
authored 7
papers almost 3 years ago
This is not a Dataset: A Large Negation Benchmark to Challenge Large Language Models
Paper • 2310.15941 • Published • 6
A Common Semantic Space for Monolingual and Cross-Lingual Meta-Embeddings
Paper • 2001.06381 • Published
IXA/Cogcomp at SemEval-2023 Task 2: Context-enriched Multilingual Named Entity Recognition using Knowledge Bases
Paper • 2304.10637 • Published
HiTZ@Antidote: Argumentation-driven Explainable Artificial Intelligence for Digital Medicine
Paper • 2306.06029 • Published
T-Projection: High Quality Annotation Projection for Sequence Labeling Tasks
Paper • 2212.10548 • Published • 1
Model and Data Transfer for Cross-Lingual Sequence Labelling in Zero-Resource Settings
Paper • 2210.12623 • Published
GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extraction
Paper • 2310.03668 • Published • 1