-
Notifications
You must be signed in to change notification settings - Fork 3.2k
Description
Description
When using azure-ai-evaluation's evaluate() function with an azure_ai_project parameter, the studio_url in the result dictionary points to the old Azure AI Foundry (AI Studio) experience. This URL does not work for users who have the new Foundry experience toggled on.
Current behavior
The SDK generates URLs in this format (returned in AiStudioEvaluationUri from upload API):
https://ai.azure.com/resource/build/evaluation/{evaluation_id}?wsid=/subscriptions/{subscription_id}/resourceGroups/{resource_group}/providers/Microsoft.CognitiveServices/accounts/{account}/projects/{project}&tid={tenant_id}
Expected behavior
For users who have the new Foundry experience enabled, the URL should be different, something like?
https://ai.azure.com/nextgen/r/{encoded_project_id}/Build/evaluations/list
Or ideally, the URL should redirect to the correct experience automatically regardless of which Foundry UX the user has enabled.
Steps to reproduce
- Run
evaluate()fromazure-ai-evaluationwithazure_ai_projectconfigured - Check the
studio_urlin the returned result - Open the URL in a browser with the new Foundry experience toggled on. See that the URL just redirects back to Foundry home. Navigate to Evaluations tab and see NO evaluation runs.
- Toggle off New Foundry, navigate to URL, and successfully see evaluations:
So there are two issues - one that the new foundry doesnt show evaluations, but second issue that the studio_url should direct users to the right place in new foundry if they're using it.
Package version
azure-ai-evaluation 1.15.0