Skip to content

azure-ai-evaluation: pyrit version and feature mismatch #45235

@eavanvalkenburg

Description

@eavanvalkenburg
  • Package Name:
    azure-ai-evaluation
  • Package Version:
    1.15.0
  • Operating System:
  • Python Version:
    both 3.11 and 3.13

Describe the bug
A clear and concise description of what the bug is.

Actually three bugs:

  1. the redteam extra cannot be found when installing with uv.
  2. with the redteam extra (which I did see in the code) pyrit is pinned to 0.11.0, which breaks because 0.10.0 removed the from pyrit.common import initailize_pyrit.
  3. This then causes a error message stating I should install pyrit, which is also wrong, pyrit is installed but there was a error in the code, so that should be improved as well.

To Reproduce
Steps to reproduce the behavior:
1.

Expected behavior
A clear and concise description of what you expected to happen.

Screenshots
If applicable, add screenshots to help explain your problem.

Additional context
Add any other context about the problem here.

Metadata

Metadata

Assignees

No one assigned

    Labels

    customer-reportedIssues that are reported by GitHub users external to the Azure organization.needs-triageWorkflow: This is a new issue that needs to be triaged to the appropriate team.questionThe issue doesn't require a change to the product in order to be resolved. Most issues start as that

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions