Skip to content

Issue with Eval Sets/Cases #895

@TooGoodDT

Description

@TooGoodDT

I created a few different eval sets/cases through the adk web dev ui. However, when I try to run these said eval sets that have been created through the server I get the following error:

Traceback (most recent call last):
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/uvicorn/protocols/http/h11_impl.py", line 403, in run_asgi
result = await app( # type: ignore[func-returns-value]
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in call
return await self.app(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/fastapi/applications.py", line 1054, in call
await super().call(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/applications.py", line 112, in call
await self.middleware_stack(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/middleware/errors.py", line 187, in call
raise exc
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/middleware/errors.py", line 165, in call
await self.app(scope, receive, _send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/middleware/exceptions.py", line 62, in call
await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
raise exc
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
await app(scope, receive, sender)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/routing.py", line 714, in call
await self.middleware_stack(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/routing.py", line 734, in app
await route.handle(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/routing.py", line 288, in handle
await self.app(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/routing.py", line 76, in app
await wrap_app_handling_exceptions(app, request)(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
raise exc
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
await app(scope, receive, sender)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/routing.py", line 73, in app
response = await f(request)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/fastapi/routing.py", line 301, in app
raw_response = await run_endpoint_function(
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/fastapi/routing.py", line 212, in run_endpoint_function
return await dependant.call(**values)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/google/adk/cli/fast_api.py", line 470, in run_eval
await run_evals(
TypeError: object async_generator can't be used in 'await' expression

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions