Blockwise Advantage Estimation for Multi-Objective RL with Verifiable Rewards
Paper
•
2602.10231
•
Published
•
7
Nebius
company
Verified
AI & ML interests
AI-centric cloud platform ready for intensive workloads Training-ready platform with NVIDIA® H100 Tensor Core GPUs. Competitive pricing. Dedicated support.
Recent Activity
View all activity
Papers
View all Papers
djalexj
authored
2
papers
about 9 hours ago
djalexj
submitted
a
paper
to Daily Papers
about 11 hours ago
ibragim-bad
updated
a
dataset
29 days ago
ibragim-bad
posted
an
update
about 2 months ago
Post
359
🎄 67,074 Qwen3-Coder OpenHands trajectories + 2 RFT checkpoints.
We release: 67,000+ trajectories from 3,800 resolved issues in 1,800+ Python repos.
About 3x more successful trajectories and 1.5x more repos than our previous dataset.
Trajectories are long: on average 64 turns, up to 100 turns and 131k context length.
> RFT on this data, SWE-bench Verified:
Qwen3-30B-Instruct: 25.7% → 50.3% Pass@1.
Qwen3-235B-Instruct: 46.2% → 61.7% Pass@1.
Also strong gains on SWE-rebench September.
> We also did massive evals.
We run OpenHands with 100 and 500 turns.
We compare models under both limits.
We run on SWE-bench Verified and several months of SWE-rebench.
!!! We also check tests written by the models.
We measure how often tests are correct.
We check how often the final patch passes its own tests.
This gives a pool of tests for verifiers and auto graders.
> Fully permissive licenses
Dataset and models: https://huggingface.co/collections/nebius/openhands-trajectories
Blog post: https://nebius.ai/blog/posts/openhands-trajectories-with-qwen3-instruct
We release: 67,000+ trajectories from 3,800 resolved issues in 1,800+ Python repos.
About 3x more successful trajectories and 1.5x more repos than our previous dataset.
Trajectories are long: on average 64 turns, up to 100 turns and 131k context length.
> RFT on this data, SWE-bench Verified:
Qwen3-30B-Instruct: 25.7% → 50.3% Pass@1.
Qwen3-235B-Instruct: 46.2% → 61.7% Pass@1.
Also strong gains on SWE-rebench September.
> We also did massive evals.
We run OpenHands with 100 and 500 turns.
We compare models under both limits.
We run on SWE-bench Verified and several months of SWE-rebench.
!!! We also check tests written by the models.
We measure how often tests are correct.
We check how often the final patch passes its own tests.
This gives a pool of tests for verifiers and auto graders.
> Fully permissive licenses
Dataset and models: https://huggingface.co/collections/nebius/openhands-trajectories
Blog post: https://nebius.ai/blog/posts/openhands-trajectories-with-qwen3-instruct
- 2 replies
mrshevan
authored
a
paper
6 months ago
ibragim-bad
posted
an
update
6 months ago
Post
362
We tested Qwen3-Coder, GPT-5 and other 30+ models on new SWE-Bench like tasks from July 2025!
Hi all, I’m Ibragim from Nebius.
We ran a benchmark on 34 fresh GitHub PR tasks from July 2025 using the SWE-rebench leaderboard https://swe-rebench.com/leaderboard . These are real, recent problems — no training-set contamination — and include both proprietary and open-source models.
Quick takeaways:
> GPT-5-Medium leads overall (29.4% resolved rate, 38.2% pass@5).
> Qwen3-Coder is the best open-source performer, matching GPT-5-High in pass@5 (32.4%) despite a lower resolved rate.
> Claude Sonnet 4.0 lags behind in pass@5 at 23.5%.
All tasks come from the continuously updated, decontaminated nebius/SWE-rebench-leaderboard for real-world SWE tasks.
Hi all, I’m Ibragim from Nebius.
We ran a benchmark on 34 fresh GitHub PR tasks from July 2025 using the SWE-rebench leaderboard https://swe-rebench.com/leaderboard . These are real, recent problems — no training-set contamination — and include both proprietary and open-source models.
Quick takeaways:
> GPT-5-Medium leads overall (29.4% resolved rate, 38.2% pass@5).
> Qwen3-Coder is the best open-source performer, matching GPT-5-High in pass@5 (32.4%) despite a lower resolved rate.
> Claude Sonnet 4.0 lags behind in pass@5 at 23.5%.
All tasks come from the continuously updated, decontaminated nebius/SWE-rebench-leaderboard for real-world SWE tasks.
-
- 2 replies
ibragim-bad
authored
a
paper
6 months ago
djalexj
authored
a
paper
6 months ago
hr0nix
authored
a
paper
9 months ago
mrshevan
authored
a
paper
9 months ago
ibragim-bad
authored
a
paper
9 months ago
djalexj
authored
a
paper
9 months ago
ibragim-bad
updated
2
datasets
9 months ago
Could you provide the Docker images?
9
#2 opened 9 months ago
by
lycfight
ibragim-bad
published
a
dataset
9 months ago
Do you have the swe-bench harness code?
15
#2 opened about 1 year ago
by
aidando73
ibragim-bad
updated
2
datasets
about 1 year ago