Skip to content

Map trajectory records to OpenAI Evals or LangSmith-style traces #39

@weich97

Description

@weich97

Scope

Design a conversion layer from TradeArena trajectory records into an eval/trace schema used by adjacent agent tooling.

Discussion points

  • How to represent risk reports as guardrail or grader events.
  • How to represent simulated fills as tool results.
  • What raw provider text remains redacted by default.

Acceptance criteria

  • A schema example is added.
  • A fixture conversion test is added.
  • Docs explain compatibility limits.

Validation

python -m pytest tests/test_trace_schema_export.py -q

Metadata

Metadata

Assignees

No one assigned

    Labels

    discussionNeeds design discussion before implementationenhancementNew feature or requesthelp wantedExtra attention is needed

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions