Skip to content

[azure-ai-evaluation] studio_url returned by evaluate() only works for old Foundry experience, not new Foundry #45234

@pamelafox

Description

@pamelafox

Description

When using azure-ai-evaluation's evaluate() function with an azure_ai_project parameter, the studio_url in the result dictionary points to the old Azure AI Foundry (AI Studio) experience. This URL does not work for users who have the new Foundry experience toggled on.

Current behavior

The SDK generates URLs in this format (returned in AiStudioEvaluationUri from upload API):

https://ai.azure.com/resource/build/evaluation/{evaluation_id}?wsid=/subscriptions/{subscription_id}/resourceGroups/{resource_group}/providers/Microsoft.CognitiveServices/accounts/{account}/projects/{project}&tid={tenant_id}

Expected behavior

For users who have the new Foundry experience enabled, the URL should be different, something like?

https://ai.azure.com/nextgen/r/{encoded_project_id}/Build/evaluations/list

Or ideally, the URL should redirect to the correct experience automatically regardless of which Foundry UX the user has enabled.

Steps to reproduce

  1. Run evaluate() from azure-ai-evaluation with azure_ai_project configured
  2. Check the studio_url in the returned result
  3. Open the URL in a browser with the new Foundry experience toggled on. See that the URL just redirects back to Foundry home. Navigate to Evaluations tab and see NO evaluation runs.
Image
  1. Toggle off New Foundry, navigate to URL, and successfully see evaluations:
Image

So there are two issues - one that the new foundry doesnt show evaluations, but second issue that the studio_url should direct users to the right place in new foundry if they're using it.

Package version

azure-ai-evaluation 1.15.0

Metadata

Metadata

Assignees

No one assigned

    Labels

    needs-triageWorkflow: This is a new issue that needs to be triaged to the appropriate team.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions