Skip to content

Investigate slug model fallback behavior when credits exhausted #214

@exedev-shelley

Description

@exedev-shelley

Author: nhkhang
Channel: #shelley
Link: https://discord.com/channels/1405685085923049482/1450334528210993295/1507291403955474562


Issue

When monthly credits are exhausted, the slug model appears to be falling back to GPT-4.5, which includes thinking tokens. This may be causing unexpected behavior or performance degradation.

Context

User reported running out of Shelley monthly credit and suspects this is related to slug model behavior.

Discussion

  • Initial suspicion: slug model problem
  • Follow-up analysis: user confirmed using GPT-4.5 for custom model; when custom model credit runs out, slug model falls back to GPT-4.5 (which has thinking enabled)
  • This could be a parsing issue not properly dropping thinking tokens from the fallback model

Next Steps

  • Verify fallback behavior when primary model credits are exhausted
  • Ensure thinking tokens are properly handled/dropped when using fallback models
  • Consider whether fallback logic or model selection needs adjustment

Attachments

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions