Skip to content

chore(deps): bump scrapling from 0.4.11 to 0.4.12 - #84

Merged
Sam-Aitech merged 1 commit into
mainfrom
dependabot/uv/scrapling-0.4.12
Aug 5, 2026
Merged

chore(deps): bump scrapling from 0.4.11 to 0.4.12#84
Sam-Aitech merged 1 commit into
mainfrom
dependabot/uv/scrapling-0.4.12

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Aug 2, 2026

Copy link
Copy Markdown
Contributor

Bumps scrapling from 0.4.11 to 0.4.12.

Release notes

Sourced from scrapling's releases.

Release v0.4.12

A release focused on making your spiders smarter about the websites they crawl

[!NOTE] Follow us on X for daily tips and tricks

🚀 New Stuff and quality of life changes

  • Spiders can now tune their own speed with AutoThrottle. Instead of guessing a download_delay that's either too slow or gets you banned, the spider measures how fast each website answers and adjusts the delay of every domain on its own. When a website starts blocking or rate-limiting you, it doubles the delay (or waits exactly what the Retry-After header asks for) until that stops, then speeds back up. Your download_delay and any robots.txt Crawl-delay are still respected as the minimum. (Check the docs)

    class MySpider(Spider):
        name = "adaptive"
        start_urls = ["https://example.com"]
        autothrottle_enabled = True
        autothrottle_start_delay = 2.0
        autothrottle_max_delay = 30.0
        autothrottle_block_backoff = True
  • Export your results to CSV and XML, next to the JSON/JSONL exporters you already had. Items that don't all share the same keys are still exported without losing anything, and nested values are written as JSON. (Check the docs)

    result = MySpider().start()
    result.items.to_csv("products.csv")
    result.items.to_xml("products.xml")
  • The MCP server can now require authentication, so you can safely expose it instead of keeping it on your own machine. Any request without the token is rejected, and you can also restrict which hostnames the server answers to. (Check the docs)

    scrapling mcp --http --auth-token "$(openssl rand -hex 32)"
  • Browsers now accept CDP URLs over HTTP, not just WebSocket ones. So next to the wss:// endpoints managed browser providers hand out, you can now point any browser fetcher or MCP session at a Chrome you started yourself with --remote-debugging-port=9222.

  • Published Docker images are now tagged with their release version instead of only latest, so you can pin the exact version you want, by @​JanRK in #384.

🐛 Bug Fixes

  • Fixed cached responses losing all their cookies when the response came from a browser engine, which silently broke any session or auth logic relying on them while using the spiders' development mode, by @​amitvijapur in #379. (Fixes #376)

  • Fixed StealthyFetcher forcing the en-US locale on every browser instead of following your system's, which made websites see a mismatch between your locale and your IP address and treat you as suspicious, like Google answering with 429s. (Fixes #381)

  • Fixed a misleading error message in the storage system and removed a dead call left after inserts, by @​fix2015 in #377.

Performance

  • get_all_text() is now O(nodes) instead of walking up the ancestors of every single text node, which makes it around 5-6x faster on deeply nested pages, by @​yetval in #378.

🙏 Special thanks to the community for all the continuous testing and feedback


... (truncated)

Commits
  • fc96fcc v0.4.12 (#388)
  • 1166ce3 ci: lock workflows to be triggered by the repo owner alone
  • 0a7fec8 feat(spiders): Add exporters to CSV/XML
  • 347db4c docs: add the auto throttle option
  • ca51962 feat(spiders): Auto throttle based on website speed/protection
  • 9526bac agent: update the skill with the latest updates
  • 563b134 feat(mcp): Add auth to the mcp server and the option to set allowed host
  • 0ca4aea docs: Update main pages with the recently added features
  • 9ecffdb fix(cdp): Make browsers accept CDP urls with http protocol
  • f293d83 ci(docker): tag images with the release version on merge (#384)
  • Additional commits viewable in compare view

@dependabot dependabot Bot added dependencies Pull requests that update a dependency file python:uv Pull requests that update python:uv code labels Aug 2, 2026
@dependabot
dependabot Bot requested a review from Sam-Aitech as a code owner August 2, 2026 03:15
@dependabot dependabot Bot added dependencies Pull requests that update a dependency file python:uv Pull requests that update python:uv code labels Aug 2, 2026
@socket-security

socket-security Bot commented Aug 2, 2026

Copy link
Copy Markdown

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

Diff Package Supply Chain
Security
Vulnerability Quality Maintenance License
Updatedpypi/​scrapling@​0.4.11 ⏵ 0.4.1299 +1100100100100

View full report

@dependabot
dependabot Bot force-pushed the dependabot/uv/scrapling-0.4.12 branch from ad2e0bb to 66eebd4 Compare August 5, 2026 12:25
@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown

@dependabot
dependabot Bot force-pushed the dependabot/uv/scrapling-0.4.12 branch from 66eebd4 to e961609 Compare August 5, 2026 12:33
@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown

@Sam-Aitech

Copy link
Copy Markdown
Owner

@dependabot rebase

Bumps [scrapling](https://github.com/D4Vinci/Scrapling) from 0.4.11 to 0.4.12.
- [Release notes](https://github.com/D4Vinci/Scrapling/releases)
- [Commits](D4Vinci/Scrapling@v0.4.11...v0.4.12)

---
updated-dependencies:
- dependency-name: scrapling
  dependency-version: 0.4.12
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot
dependabot Bot force-pushed the dependabot/uv/scrapling-0.4.12 branch from e961609 to c353cee Compare August 5, 2026 15:36
@sonarqubecloud

sonarqubecloud Bot commented Aug 5, 2026

Copy link
Copy Markdown

@Sam-Aitech
Sam-Aitech merged commit f47140d into main Aug 5, 2026
13 checks passed
@dependabot
dependabot Bot deleted the dependabot/uv/scrapling-0.4.12 branch August 5, 2026 15:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file python:uv Pull requests that update python:uv code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant