Skip to content

Fix roofz parser for new JSON API#131

Merged
wtfloris merged 1 commit intomasterfrom
fix/roofz-parser
Mar 13, 2026
Merged

Fix roofz parser for new JSON API#131
wtfloris merged 1 commit intomasterfrom
fix/roofz-parser

Conversation

@wtfloris
Copy link
Owner

Summary

  • Roofz migrated from Nuxt SSR (/availability) to a Marketsuite JSON API (/api/ms/listing/properties)
  • Rewrote parser to consume the new paginated JSON API instead of scraping __NUXT__ inline data
  • Now extracts living_area (sqm) from the API response
  • Updated listing URLs from /availability/{slug} to /huur/woningen/{slug}
  • Removed _substitute_nuxt_vars helper (no longer needed)

Test plan

  • All 92 parser tests pass
  • Verified live API returns data and parser produces correct results
  • Verified at least 3 parsed listing URLs return HTTP 200
  • End-to-end test in Docker: scraper inserts listings with correct address, city, price, and sqm

🤖 Generated with Claude Code

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@wtfloris wtfloris merged commit 3a14c9f into master Mar 13, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant