Skip to content

CB Bug fix for Qwen3VL Dense and basic cleaning of example script and Model File#927

Merged
quic-rishinr merged 2 commits into
release/v1.21.6from
cb_bug_fix_release
Apr 21, 2026
Merged

CB Bug fix for Qwen3VL Dense and basic cleaning of example script and Model File#927
quic-rishinr merged 2 commits into
release/v1.21.6from
cb_bug_fix_release

Conversation

@qcdipankar
Copy link
Copy Markdown
Contributor

Issue: When running CB with single image multiple time with different prompts it was working whereas with multiple images and prompts it was failing.

Resolution: The hidden states calculation was done with index [0] every time as a result when the broadcasting was happening with batch size 4 it was taking the first image only and we were getting wrong output in CB. Taking full hidden_states ensures the error does not occur.

@quic-rishinr
Copy link
Copy Markdown
Contributor

@qcdipankar please include the test for full_batch_size ≥ 2 with multiple images

… Model File

Signed-off-by: Dipankar Sarkar <dipankar@qti.qualcomm.com>
…nging hidden state code aligned to hf for qwen3vlmoe

Signed-off-by: Dipankar Sarkar <dipankar@qti.qualcomm.com>
@quic-rishinr quic-rishinr merged commit c0da20b into release/v1.21.6 Apr 21, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants