Skip to content

feat(rl): Add SFTTrainer for supervised fine-tuning #935

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
gspeter-max wants to merge 6 commits into
base: main
Choose a base branch
from

fix: resolve gradient accumulation, pad tokens, and asyncio bugs

2475bf7
Select commit
Loading
Failed to load commit list.
Open

feat(rl): Add SFTTrainer for supervised fine-tuning #935

fix: resolve gradient accumulation, pad tokens, and asyncio bugs
2475bf7
Select commit
Loading
Failed to load commit list.
Cursor / Cursor Bugbot completed Feb 19, 2026 in 13m 4s

Bugbot Review

Bugbot Analysis Progress (13m 6s elapsed)

✅ Gathered PR context (2s)
✅ Completed bug detection (12m 1s)
✅ Posted analysis results (1m 3s)

Final Result: Bugbot completed review and found 2 potential issues.

Request ID: serverGenReqId_5d8c428c-37f0-428e-b8eb-6b0902a7f63a

Details

Cursor Bugbot has reviewed your changes and found 2 potential issues.

Bugbot Autofix is OFF. To automatically fix reported issues with Cloud Agents, enable Autofix in the Cursor dashboard.

View more details on Cursor