Skip to content

VBVR-DataFactory-Staging/zip_pilot_G39_attention_shift

Repository files navigation

zip_pilot_G39_attention_shift

VBVR G-39 (attention shift, different objects) — zip vendor pilot v1.
Deliver a vbvr-meta v0 generator under 04_NEW_GENERATOR_WORK/: metadata-first by default, optional --render for media; aligned with Evalkit AttentionShiftEvaluator. Includes read-only evaluator notes, a legacy tree for diffing, and a local Evalkit smoke harness.

TASK_EVALUATOR_MAP key (must match metadata.generator exactly):

G-39_attention_shift_different_data-generator


Layout

Path Purpose
00_AGENT_README.md Agent / human: read-only vs writable areas, reading order, deliverables
01_TEMPLATE_SPEC.md Shared vbvr-meta v0 contract (includes generic_declarative_render §2.1)
02_EVALUATOR_REFERENCE/ EVAL_ALIGNMENT.md + evaluator snapshot (read-only; runtime truth is Evalkit source)
03_LEGACY_GENERATOR/ Original DataFactory G-39 tree (no .git), for migration comparison
04_NEW_GENERATOR_WORK/ Only code area to edit: new generator, CLI, declarative spec
05_QA_CHECKLIST.md Return QA checklist (G-39 instance; see header when cloning for other tasks)
eval/ Self-check GT vs Evalkit AttentionShiftEvaluator (see eval/EVAL.md)
MANIFEST.txt Path index + reminder not to ship eval/.cache/ inside vendor zips

Quick start (generation)

cd "04_NEW_GENERATOR_WORK"
pip install -r requirements.txt

# Default: metadata.json only (meta-first)
python3 examples/generate.py --num-samples 3 --seed 42 --output-dir ./out_meta

# Optional: also write prompt.txt, PNGs, ground_truth.mp4
python3 examples/generate.py --num-samples 2 --seed 42 --output-dir ./out_full --render

Details: 04_NEW_GENERATOR_WORK/README.md.


Optional: Evalkit smoke

Requires a checkout of VBVR-Evalkit on disk. By default the script looks for a sibling folder VBVR-Evalkit-Interleave next to the parent of this zip; override with VBVR_EVALKIT_ROOT.

cd "eval"
python3 verify_gt_self_score.py

Pass criteria and notes (including box_fidelity heuristics): eval/EVAL.md.


Return / QA

  1. Self-check against 05_QA_CHECKLIST.md.
  2. Record results and command snippets in 04_NEW_GENERATOR_WORK/docs/QA_REPORT.md.

Related repos

  • Single-task Git template (vbvr-meta)
    VBVR-DataFactory-Staging/vbvr-meta-generator-template

  • Metadata-only replay demo (separate folder in the same workspace, not inside this zip)
    G39_metadata_only_replay/: replay metadata.json to media without running the generator (useful cross-check).


Git / packaging

  • Root .gitignore excludes eval/.cache/, 04/.../out_meta, out_full, etc. Do not ship smoke caches in vendor zips.
  • Before cutting a zip, re-read the last line of MANIFEST.txt.

License

Follow 03_LEGACY_GENERATOR/LICENSE and your org policy; pilot docs and 04 deltas are subject to project-side agreement.

About

G-39 attention_shift zip pilot: meta-first generator, 02 eval ref, eval/ Evalkit smoke

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages