Author: nhkhang
Channel: #shelley
Link: https://discord.com/channels/1405685085923049482/1450334528210993295/1507291403955474562
Issue
When monthly credits are exhausted, the slug model appears to be falling back to GPT-4.5, which includes thinking tokens. This may be causing unexpected behavior or performance degradation.
Context
User reported running out of Shelley monthly credit and suspects this is related to slug model behavior.
Discussion
- Initial suspicion: slug model problem
- Follow-up analysis: user confirmed using GPT-4.5 for custom model; when custom model credit runs out, slug model falls back to GPT-4.5 (which has thinking enabled)
- This could be a parsing issue not properly dropping thinking tokens from the fallback model
Next Steps
- Verify fallback behavior when primary model credits are exhausted
- Ensure thinking tokens are properly handled/dropped when using fallback models
- Consider whether fallback logic or model selection needs adjustment
Attachments
Author: nhkhang
Channel: #shelley
Link: https://discord.com/channels/1405685085923049482/1450334528210993295/1507291403955474562
Issue
When monthly credits are exhausted, the slug model appears to be falling back to GPT-4.5, which includes thinking tokens. This may be causing unexpected behavior or performance degradation.
Context
User reported running out of Shelley monthly credit and suspects this is related to slug model behavior.
Discussion
Next Steps
Attachments