vision food reasoning eval (#331) #1495
benjibcci.yml
on: push
Annotations
20 errors and 3 warnings
|
Lint & Type Check:
eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1423
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"
Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
"List[ChatCompletionContentPartParam]" is not assignable to "str"
"List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"
Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"
Consider switching from "list" to "Sequence" which is covariant
"List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1352
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"
Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
"List[ChatCompletionContentPartParam]" is not assignable to "str"
"List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"
Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"
Consider switching from "list" to "Sequence" which is covariant
"List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1270
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"
Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
"List[ChatCompletionContentPartParam]" is not assignable to "str"
"List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"
Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"
Consider switching from "list" to "Sequence" which is covariant
"List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1196
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"
Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
"List[ChatCompletionContentPartParam]" is not assignable to "str"
"List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"
Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"
Consider switching from "list" to "Sequence" which is covariant
"List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1124
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"
Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
"List[ChatCompletionContentPartParam]" is not assignable to "str"
"List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"
Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"
Consider switching from "list" to "Sequence" which is covariant
"List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_glm_streaming_compliance.py#L1006
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"
Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
"List[ChatCompletionContentPartParam]" is not assignable to "str"
"List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"
Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"
Consider switching from "list" to "Sequence" which is covariant
"List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_glm_streaming_compliance.py#L914
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"
Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
"List[ChatCompletionContentPartParam]" is not assignable to "str"
"List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"
Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"
Consider switching from "list" to "Sequence" which is covariant
"List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_glm_streaming_compliance.py#L837
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"
Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
"List[ChatCompletionContentPartParam]" is not assignable to "str"
"List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"
Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"
Consider switching from "list" to "Sequence" which is covariant
"List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_glm_streaming_compliance.py#L738
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"
Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
"List[ChatCompletionContentPartParam]" is not assignable to "str"
"List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"
Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"
Consider switching from "list" to "Sequence" which is covariant
"List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
|
|
Lint & Type Check:
eval_protocol/benchmarks/test_glm_streaming_compliance.py#L682
Argument of type "str | List[ChatCompletionContentPartParam] | None" cannot be assigned to parameter "content" of type "str | list[ChatCompletionContentPartTextParam] | None" in function "_coerce_content_to_str"
Type "str | List[ChatCompletionContentPartParam] | None" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
Type "List[ChatCompletionContentPartParam]" is not assignable to type "str | list[ChatCompletionContentPartTextParam] | None"
"List[ChatCompletionContentPartParam]" is not assignable to "str"
"List[ChatCompletionContentPartParam]" is not assignable to "list[ChatCompletionContentPartTextParam]"
Type parameter "_T@list" is invariant, but "ChatCompletionContentPartParam" is not the same as "ChatCompletionContentPartTextParam"
Consider switching from "list" to "Sequence" which is covariant
"List[ChatCompletionContentPartParam]" is not assignable to "None" (reportArgumentType)
|
|
Core Tests (Python 3.10)
Event loop is closed
|
|
Core Tests (Python 3.10)
Event loop is closed
|
|
Core Tests (Python 3.10)
Event loop is closed
|
|
Core Tests (Python 3.10)
Event loop is closed
|
|
Core Tests (Python 3.10)
Event loop is closed
|
|
Core Tests (Python 3.10)
Event loop is closed
|
|
Core Tests (Python 3.10)
Event loop is closed
|
|
Core Tests (Python 3.10)
Event loop is closed
|
|
Core Tests (Python 3.10)
Event loop is closed
|
|
Core Tests (Python 3.10)
Event loop is closed
|
|
Lint & Type Check:
eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
|
|
Lint & Type Check:
eval_protocol/mcp/__init__.py#L49
Operation on "__all__" is not supported, so exported symbol list may be incorrect (reportUnsupportedDunderAll)
|
|
MCP End-to-End Tests
No files were found with the provided path: coverage.xml. No artifacts will be uploaded.
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
coverage-batch-eval
Expired
|
48.6 KB |
sha256:dd52176f372e8e44b15cf4a1d0b9dae39b73cc121b35a7f45ce21b496656d982
|
|
|
coverage-core-3.10
Expired
|
62.7 KB |
sha256:94eb5fefad0a9d7b6fde230157c8da7771ba1d3e7da8f9d978aabec3c92a0ca4
|
|
|
coverage-core-3.11
Expired
|
62.7 KB |
sha256:680b7b94d9ab4b0b0881566f00079515bad4b3e48dbd69d6742d6ca7cac58e7b
|
|
|
coverage-core-3.12
Expired
|
62.7 KB |
sha256:9a752600dc15c34c0a4ebe3c577f034e025becc682ed747f85f13d620c722bf6
|
|