VBVR G-39 (attention shift, different objects) — zip vendor pilot v1.
Deliver a vbvr-meta v0 generator under 04_NEW_GENERATOR_WORK/: metadata-first by default, optional --render for media; aligned with Evalkit AttentionShiftEvaluator. Includes read-only evaluator notes, a legacy tree for diffing, and a local Evalkit smoke harness.
TASK_EVALUATOR_MAP key (must match metadata.generator exactly):
G-39_attention_shift_different_data-generator
| Path | Purpose |
|---|---|
00_AGENT_README.md |
Agent / human: read-only vs writable areas, reading order, deliverables |
01_TEMPLATE_SPEC.md |
Shared vbvr-meta v0 contract (includes generic_declarative_render §2.1) |
02_EVALUATOR_REFERENCE/ |
EVAL_ALIGNMENT.md + evaluator snapshot (read-only; runtime truth is Evalkit source) |
03_LEGACY_GENERATOR/ |
Original DataFactory G-39 tree (no .git), for migration comparison |
04_NEW_GENERATOR_WORK/ |
Only code area to edit: new generator, CLI, declarative spec |
05_QA_CHECKLIST.md |
Return QA checklist (G-39 instance; see header when cloning for other tasks) |
eval/ |
Self-check GT vs Evalkit AttentionShiftEvaluator (see eval/EVAL.md) |
MANIFEST.txt |
Path index + reminder not to ship eval/.cache/ inside vendor zips |
cd "04_NEW_GENERATOR_WORK"
pip install -r requirements.txt
# Default: metadata.json only (meta-first)
python3 examples/generate.py --num-samples 3 --seed 42 --output-dir ./out_meta
# Optional: also write prompt.txt, PNGs, ground_truth.mp4
python3 examples/generate.py --num-samples 2 --seed 42 --output-dir ./out_full --renderDetails: 04_NEW_GENERATOR_WORK/README.md.
Requires a checkout of VBVR-Evalkit on disk. By default the script looks for a sibling folder VBVR-Evalkit-Interleave next to the parent of this zip; override with VBVR_EVALKIT_ROOT.
cd "eval"
python3 verify_gt_self_score.pyPass criteria and notes (including box_fidelity heuristics): eval/EVAL.md.
- Self-check against
05_QA_CHECKLIST.md. - Record results and command snippets in
04_NEW_GENERATOR_WORK/docs/QA_REPORT.md.
-
Single-task Git template (vbvr-meta)
VBVR-DataFactory-Staging/vbvr-meta-generator-template -
Metadata-only replay demo (separate folder in the same workspace, not inside this zip)
G39_metadata_only_replay/: replaymetadata.jsonto media without running the generator (useful cross-check).
- Root
.gitignoreexcludeseval/.cache/,04/.../out_meta,out_full, etc. Do not ship smoke caches in vendor zips. - Before cutting a zip, re-read the last line of
MANIFEST.txt.
Follow 03_LEGACY_GENERATOR/LICENSE and your org policy; pilot docs and 04 deltas are subject to project-side agreement.