SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?
Paper • 2410.03859 • Published • 3
SWE-bench
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?
SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
Add eval.yaml
4
#3 opened 6 days ago
by 
nielsr
john-b-yangÂ
authored 9
papers 2 months ago
OpenThoughts: Data Recipes for Reasoning Models
Paper • 2506.04178 • Published • 56
LongCodeBench: Evaluating Coding LLMs at 1M Context Windows
Paper • 2505.07897 • Published
EnIGMA: Interactive Tools Substantially Assist LM Agents in Finding Security Vulnerabilities
Paper • 2409.16165 • Published
Collaborative Gym: A Framework for Enabling and Evaluating Human-Agent Collaboration
Paper • 2412.15701 • Published
Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces
Paper • 2601.11868 • Published • 37
SWE-Protégé: Learning to Selectively Collaborate With an Expert Unlocks Small Language Models as Software Engineering Agents
Paper • 2602.22124 • Published • 2
SWE-chat: Coding Agent Interactions From Real Users in the Wild
Paper • 2604.20779 • Published • 18
ProgramBench: Can Language Models Rebuild Programs From Scratch?
Paper • 2605.03546 • Published • 4
arpandeepkÂ
published a
dataset 4 months ago
arpandeepkÂ
updated a
dataset 4 months ago
john-b-yangÂ
updated a
collection 5 months ago
john-b-yangÂ
updated a
dataset 5 months ago
john-b-yangÂ
published a
dataset 5 months ago
john-b-yangÂ
updated a
dataset 5 months ago
john-b-yangÂ
published a
dataset 5 months ago
Update eval.yaml
#4 opened 5 months ago
by 
SaylorTwift
Add eval.yaml
#2 opened 5 months ago
by nielsr