Add throttling safeguards to Stepstone scraping utilities#21

Open

kdkiss wants to merge 1 commit intomainfrom

codex/update-security-practices-or-implement-throttling

Owner

kdkiss commented Sep 27, 2025

Summary

add user-agent rotation plus throttling and retry/backoff logic to the Stepstone job scraper and detail parser
enhance tool messaging to cover search-term guidance and accept the historical job_query alias
add regression tests that exercise the new delay/backoff behaviour for both components

Testing

pytest

https://chatgpt.com/codex/tasks/task_e_68d79d6e23e08332ae0b60d3bdf390f8


          Add throttle and retry safeguards for Stepstone scraping

227f42b

kdkiss added the codex label

— with

ChatGPT Codex Connector

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels