Skip to content

feat(analysis): add shot content understanding - #2

Merged
TristinWen merged 1 commit into
mainfrom
agent/shot-content-analysis
Aug 9, 2026
Merged

feat(analysis): add shot content understanding#2
TristinWen merged 1 commit into
mainfrom
agent/shot-content-analysis

Conversation

@TristinWen

Copy link
Copy Markdown
Contributor

Summary

  • generate one editing-oriented .semantic.json containing required media facts, contiguous shots, representative timestamps, and structured scene descriptions
  • detect cuts and extract representative frames with FFmpeg while keeping model providers replaceable
  • add OpenAI structured vision and reviewed JSON import providers
  • make technical details, embedded metadata, SHA-256, and raw FFprobe data opt-in through repeatable --include
  • expand scene semantics, JSON Schema, CLI documentation, roadmap, and changelog

Validation

  • uv run ruff check .
  • uv run mypy src tests
  • uv run pytest -q --basetemp <writable-directory> — 76 passed, 96.91% coverage
  • processed D:\BaiduNetdiskDownload\20240610-3.MP4 end to end into a schema-valid 3-shot semantic manifest

Privacy

  • the source video, extracted representative frames, and its reviewed descriptions are not included in this pull request

- Generate one editing-oriented semantic JSON with required media, shots, representative times, and scene descriptions.
- Add FFmpeg shot detection plus OpenAI and reviewed JSON description providers.
- Make technical metadata, embedded tags, checksum, and raw probe data opt-in through --include.
- Document the workflow and cover it with schema, CLI, provider, and pipeline tests.
@TristinWen
TristinWen marked this pull request as ready for review August 9, 2026 13:50
@TristinWen
TristinWen merged commit 864abfe into main Aug 9, 2026
1 check passed
@TristinWen
TristinWen deleted the agent/shot-content-analysis branch August 9, 2026 13:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant