Skip to content

Improve parallelism in agentics when batch size is above 30 - 50 #138

@gliozzo

Description

@gliozzo
  • gemini 200 batch size works

Here is Alfio's configuration
WATSONX_URL=https://us-south.ml.cloud.ibm.com
MODEL_ID=watsonx/openai/gpt-oss-120b

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions