Skip to content

Strengthen autograder: schema placement check, README findings, deeper AI log#3

Merged
lassebenni merged 1 commit into
mainfrom
fix/grader-schema-readme-aiassist
Jun 29, 2026
Merged

Strengthen autograder: schema placement check, README findings, deeper AI log#3
lassebenni merged 1 commit into
mainfrom
fix/grader-schema-readme-aiassist

Conversation

@lassebenni

Copy link
Copy Markdown
Collaborator

Summary

Three targeted fixes based on a comparison with the Week 6 assignment grader and a review of the Week 9 teacher rubric.

  • Schema placement check (L3): zeros the entire star-schema level if a student creates views in public or nyc_taxi instead of their own schema. This is the Fill Week 9 SQL-for-Analytics assignment scaffold #1 failure mode listed in the teacher rubric but was previously invisible to the autograder.
  • README findings requirement (L8, 5 pts new): requires a ## Findings section summarising the Task 1 audit results with real numbers. Replaces the screenshot as the documentation deliverable — screenshot (L6) is still required but is now 0 pts since it's binary evidence that adds little on its own.
  • AI_ASSIST char floor raised from 1200 → 1800 (L7): matches the Week 6 threshold and forces the Reflection section to contain real analysis, not a one-sentence restatement.

Total remains 100 pts, passing 60.

Test plan

  • A submission with public.vw_fact_trips in schema_setup.sql gets 0 pts for L3
  • A submission without ## Findings in README.md fails L8
  • A submission with AI_ASSIST.md between 1200–1799 chars now fails L7 with the updated message
  • A complete correct submission still scores ≥60

🤖 Generated with Claude Code

Three targeted fixes based on comparison with the Week 6 grader:

1. L3 schema placement check: zero the whole level if views are created
   in public or nyc_taxi instead of the student's own schema (the most
   common failure mode per the teacher rubric, previously undetected).

2. L8 README findings (5 pts, new): require a ## Findings section
   summarising Task 1 audit results with real numbers. Moves the 5 pts
   from the screenshot (L6, now 0 pts, still required) into this richer
   documentation deliverable.

3. L7 AI_ASSIST char floor raised from 1200 to 1800: matches Week 6
   and forces the Reflection section to contain real analysis rather
   than a one-sentence restatement.

Total remains 100 pts, passing 60.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@lassebenni lassebenni merged commit b1ff532 into main Jun 29, 2026
@lassebenni lassebenni deleted the fix/grader-schema-readme-aiassist branch June 29, 2026 20:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant