[Python] Add agent-framework-azure-ai-contentunderstanding package - #4829

Merged

Tao Chen (TaoChenOSU) merged 95 commits into

microsoft:mainfrom

yungshinlintw:yslin/contentunderstanding-context-provider

Apr 28, 2026

Commits on Apr 3, 2026

feat: add agent-framework-azure-contentunderstanding package

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
64f8472
fix: update CU fixtures with real API data, fix test assertions

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
1058963
chore: add connector .gitignore, update uv.lock

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
ac552d2
refactor: rename to azure-ai-contentunderstanding, fix CI issues

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
e654aad
feat: add samples (document_qa, invoice_processing, multimodal_chat)

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
eed2fce
feat: add remaining samples (devui_multimodal_agent, large_doc_file_search)

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
d94f08a
feat: add file_search integration for large document RAG

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
bb53a0f
fix: add key-based auth support to all samples

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
e5e4137
FEATURE(python): add analyzer auto-detection, file_search RAG, and lazy init
yungshinlin
committed
ee86b61
feat(cu): MIME sniffing, media-aware formatting, unified timeout, vector store expiration
yungshinlin
committed
34c1939
fix: merge all CU content segments for video/audio analysis
yungshinlin
committed
ba4bfa3
refactor: improve CU context provider docs and remove ContentLimits

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
e276f76
feat: support user-provided vector store in FileSearchConfig

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
90ace98
fix: remove ContentLimits from README code block

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
38b3aba
refactor: create CU client in __init__ instead of __aenter__

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
c2b9b32
docs: add file_search param to class docstring

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
2e6f1b4
feat: introduce FileSearchBackend abstraction for cross-client support

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
1e4b889
refactor: FileSearchBackend abstraction + caller-owned vector store

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
7c39752
fix: file_search reliability and sample improvements

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
7fce742
perf: set max_num_results=10 for file_search to reduce token usage

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
8ea7e13
fix: move import to top of file (E402 lint)

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
41a070c
chore: remove unused imports

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
44cfcbc
fix: align azure-ai-contentunderstanding with MAF coding conventions
yungshinlin
committed
628ad1c
refactor: improve CU context provider API surface and fix CI
yungshinlin
committed
6076cb2
fix: improve file_search samples and move tool guidelines to context provider
yungshinlin
committed
5cff2f7
feat: improve source_id, integration tests, and content assertions
yungshinlin
committed
3607c85
feat: reject duplicate filenames, add integration tests and sample comments
yungshinlin
committed
aaf97c2
chore: improve doc key derivation, comments, and README
yungshinlin
committed
0437e43
test: strengthen _format_result assertions with exact expected strings
yungshinlin
committed
2081ed5
refactor: move invoice.pdf to shared sample_assets directory
yungshinlin
committed
f377b2c
refactor: reorganize samples into numbered dirs and simplify auth
yungshinlin
committed
5e1c2e9
fix: resolve CI lint errors (D205, RUF001, E501)
yungshinlin
committed
2cde5fc
refactor: overhaul samples — FoundryChatClient, sessions, remove get_analyzed_document
yungshinlin
committed
4981b35
feat: add 05_background_analysis sample and fix 04 session/max_wait
yungshinlin
committed
f2cbc45
docs: update README and fix sample 06
yungshinlin
committed
9eb35c2
docs: rewrite README — concise format, prerequisites, CU link
yungshinlin
committed
c1eb370
fix: resolve pyright errors in _format_result segment cast
yungshinlin
committed
7e8e62a
docs: add numbered section comments and fresh sample output to all samples
yungshinlin
committed
9fc9e4e
feat: add load_settings support for env var configuration
yungshinlin
committed
4097328
docs: polish README — fix duplicate env var, add Next steps, service limits link
yungshinlin
committed
2682bfc
chore: trim invoice fixture from 199K to 33 lines
yungshinlin
committed
39b79c3
feat: per-file analyzer_id override via additional_properties
yungshinlin
committed
bdb4617
Trim PDF test fixture and clarify unique filename requirement
yungshinlin
committed
4a9196d
Update python/packages/azure-ai-contentunderstanding/agent_framework_azure_ai_contentunderstanding/_context_provider.py

authored and
yungshinlin
committed
beed5cc
Update python/packages/azure-ai-contentunderstanding/agent_framework_azure_ai_contentunderstanding/_context_provider.py

authored and
yungshinlin
committed
759d29c
Update python/packages/azure-ai-contentunderstanding/samples/02-devui/02-file_search_agent/azure_openai_backend/agent.py

authored and
yungshinlin
committed
dc01991
Update python/packages/azure-ai-contentunderstanding/samples/02-devui/01-multimodal_agent/agent.py

authored and
yungshinlin
committed
7222b6c
Update python/packages/azure-ai-contentunderstanding/samples/01-get-started/06_large_doc_file_search.py

authored and
yungshinlin
committed
53ab967
Fix AGENTS.md to match implementation; remove unused variable in test helper
yungshinlin
committed
d5bb27d
Fix premature file_search instruction for background-completed docs
yungshinlin
committed
618e4fe
fix: wrap long line in devui agent instructions (E501)
yungshinlin
committed
ad08891
Fix Copilot review: unused logger, stray code in README, await cancelled tasks
yungshinlin
committed
51a3be5
Sanitize doc keys and fix duplicate filename re-injection
yungshinlin
committed
8c9777c
fix: add type annotation to tasks_to_cancel for pyright
yungshinlin
committed
a169efd
Move per-session mutable state to state dict for session isolation
yungshinlin
committed
5c06dfa
Remove unused AnalysisSection enum values
yungshinlin
committed
2895202
Recursively flatten object/array field values for cleaner LLM output
yungshinlin
committed
958568b
Preserve sub-field confidence; compare full expected JSON in tests
yungshinlin
committed
f483b81
Remove incorrect MIME aliases (audio/mp4, video/x-matroska)
yungshinlin
committed
2e1dd6a
feat: add AnalysisInput, content_range, warnings, and category support
yungshinlin
committed
3ae3e66
fix: falsy-0 bug in duration calc; improve test coverage
yungshinlin
committed
b09f39c
refactor: split _context_provider.py into focused modules
yungshinlin
committed
c2e9cb4
docs: update AGENTS.md with DocumentStatus, FileSearchBackend, and _file_search.py
yungshinlin
committed
5698d66
refactor: replace AnalysisSection enum with Literal type for simpler DX
yungshinlin
committed
0cc0cde
refactor: replace asyncio.Task with continuation tokens for serializable state
yungshinlin
committed
e3f684c
fix: resolve CI lint (RUF052) and mypy (call-overload) errors
yungshinlin
committed
06d46b4
feat: add structured output (Pydantic model) to invoice processing sample
yungshinlin
committed
d1b858c
fix: use FOUNDRY_PROJECT_ENDPOINT and FOUNDRY_MODEL env vars in all samples
yungshinlin
committed
a39a0e6
refactor: remove background_analysis sample, use FoundryChatClient in DevUI
yungshinlin
committed
331b3c1
fix: vector_stores API moved from beta namespace in OpenAI SDK
yungshinlin
committed
c57c814
docs: add comments about multi-file support and CU service limits in file_search sample
yungshinlin
committed
493583d
fix: broken markdown links after sample removal and renumbering
yungshinlin
committed
0b830ba
fix: migrate BaseContextProvider to ContextProvider (non-deprecated)

Yung-Shin Lin (yungshinlintw)
authored and
yungshinlin
committed
2c79c7a
fix: Message(text=) -> Message(contents=[]) for API compatibility
yungshinlin
committed
0c3db4d
Merge branch 'main' into yslin/contentunderstanding-context-provider
Yung-Shin Lin (yungshinlintw)
authored
2c22cae

Commits on Apr 12, 2026

Commits on Apr 14, 2026

Address review feedback: keyword-only args, accept pre-built client, remove wrappers
yungshinlin
committed
fd26f10

Commits on Apr 20, 2026

Merge branch 'main' into yslin/contentunderstanding-context-provider
Yung-Shin Lin (yungshinlintw)
authored
d6efb61

Commits on Apr 21, 2026

Commits on Apr 23, 2026

Commits on Apr 28, 2026