Safetensors
English
qwen2
code
rl
competitive-programming
21223wj commited on
Commit
cb41c6b
·
verified ·
1 Parent(s): 78a31dd

Upload folder using huggingface_hub

Browse files
Files changed (3) hide show
  1. .gitattributes +1 -0
  2. README.md +83 -1
  3. results.png +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ results.png filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,3 +1,85 @@
1
  ---
2
- license: mit
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: apache-2.0
3
+ base_model:
4
+ - IIGroup/X-Coder-SFT-Qwen2.5-Coder-7B-Instruct
5
+ datasets:
6
+ - IIGroup/X-Coder-RL-40k
7
+ language:
8
+ - en
9
+ tags:
10
+ - code
11
+ - rl
12
+ - competitive-programming
13
  ---
14
+
15
+ # X-Coder-RL-Qwen2.5-7B
16
+
17
+ X-Coder-RL-Qwen2.5-7B is a strong code reasoning foundation model trained with RLVR on fully synthetic rl data, achieving state-of-the-art performance on competitive programming.
18
+
19
+ ## Model Description
20
+
21
+ - **Base Model**: [IIGroup/X-Coder-SFT-Qwen2.5-Coder-7B-Instruct](https://huggingface.co/IIGroup/X-Coder-SFT-Qwen2.5-Coder-7B-Instruct)
22
+ - **Training Method**: GRPO
23
+ - **Training Data**: [IIGroup/X-Coder-RL-40k](https://huggingface.co/datasets/IIGroup/X-Coder-RL-40k)
24
+ - **Parameters**: 7B
25
+
26
+ ## Training
27
+
28
+ This model was trained using the X-Coder RLVR framework. For training details and code, please refer to the [X-Coder GitHub repository](https://github.com/JieWu02/X-Coder).
29
+
30
+ ## Performance
31
+
32
+ **LiveCodeBench Average Performance: 62.9**
33
+
34
+ ![Results](results.png)
35
+
36
+ **Performance on LiveCodeBench v5.**
37
+
38
+ ## Recommended Inference Parameters
39
+
40
+ | Parameter | Value |
41
+ |-----------|-------|
42
+ | temperature | 0.6 |
43
+ | top_p | 0.95 |
44
+ | top_k | 20 (or -1 to disable) |
45
+ | max_new_tokens | 32768 |
46
+
47
+ ## Usage
48
+
49
+ ```python
50
+ from transformers import AutoModelForCausalLM, AutoTokenizer
51
+
52
+ model_name = "IIGroup/X-Coder-RL-Qwen2.5-7B"
53
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
54
+ model = AutoModelForCausalLM.from_pretrained(model_name, device_map="auto")
55
+
56
+ prompt = "Write a Python function to solve the two sum problem."
57
+ inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
58
+ outputs = model.generate(
59
+ **inputs,
60
+ max_new_tokens=32768,
61
+ temperature=0.6,
62
+ top_p=0.95,
63
+ top_k=20,
64
+ do_sample=True
65
+ )
66
+ print(tokenizer.decode(outputs[0], skip_special_tokens=True))
67
+ ```
68
+
69
+ ## Citation
70
+
71
+ ```bibtex
72
+ @inproceedings{
73
+ anonymous2025xcoder,
74
+ title={X-Coder: Advancing Competitive Programming with Fully Synthetic Tasks, Solutions, and Tests},
75
+ author={Anonymous},
76
+ booktitle={Submitted to The Fourteenth International Conference on Learning Representations},
77
+ year={2025},
78
+ url={https://openreview.net/forum?id=jp4dzBilqH},
79
+ note={under review}
80
+ }
81
+ ```
82
+
83
+ ## License
84
+
85
+ This project is licensed under the Apache License 2.0.
results.png ADDED

Git LFS Details

  • SHA256: 1a65e6a94d2e445ded612e3b2f401e9cbd64766893462f545dcb4baefd18c60c
  • Pointer size: 131 Bytes
  • Size of remote file: 445 kB