Releases: Crawlith/crawlith
Releases · Crawlith/crawlith
v0.1.2
What's Changed
- Implement Single Page View Diagnostic Panel by @saurabhsharma2u in #60
- Migrate to packages/* publishing roots, wire CLI to packages/cli, and add plugin system + use-cases by @saurabhsharma2u in #65
- Rework heading-health plugin into structural heading map engine by @saurabhsharma2u in #66
- Feature/plugin dual writers by @saurabhsharma2u in #68
- feat(cli): implement dynamic registry-driven shell autocompletion by @saurabhsharma2u in #69
- ci status by @saurabhsharma2u in #70
- 🧪 [testing improvement] Add tests for renderAuditOutput in auditFormatter by @saurabhsharma2u in #71
- 🧪 Add missing tests for runAnalysisExports in exportRunner by @saurabhsharma2u in #72
- 🧪 test(cli): add single-page branch test to analyzeFormatter by @saurabhsharma2u in #78
- ⚡ perf: Optimize heading health map initialization by @saurabhsharma2u in #76
- ⚡ Perf: Optimize broken link calculation in metrics by @saurabhsharma2u in #79
- ⚡ Optimize Array Conversion Overhead in Cluster Detection by @saurabhsharma2u in #80
- ⚡ Optimize sitemap parsing with concurrent fetching by @saurabhsharma2u in #77
- Add @crawlith/plugin-signals: structured signals extraction, storage and analysis by @saurabhsharma2u in #74
- Add PageSpeed plugin and secure config utility by @saurabhsharma2u in #82
- Redesign heading-health plugin to match Crawlith plugin standards by @saurabhsharma2u in #83
- Codex/redesign heading health plugin by @saurabhsharma2u in #87
- refactor(signals): redesign plugin to use scoped storage and modular hooks by @saurabhsharma2u in #86
- Redesign snapshot-diff plugin to compare persisted snapshots by @saurabhsharma2u in #88
- Add MCP server and plugin MCP discovery support by @saurabhsharma2u in #89
- Plugin migration by @saurabhsharma2u in #91
- feat(graph): add scalable snapshot structure graph explorer (web + server) by @saurabhsharma2u in #90
- UI/UX refinements for Crawlith web dashboard by @saurabhsharma2u in #84
- ⚡ Bolt: [performance improvement] Use TypedArrays and index mapping for O(1) PageRank calculation by @saurabhsharma2u in #93
Full Changelog: v0.1.1...v0.1.2
v0.1.1
What's Changed
- 🔒 fix: bind Crawlith UI Server to 127.0.0.1 by default by @saurabhsharma2u in #3
- 🧪 Add test for analyzeImageAlts with no images by @saurabhsharma2u in #4
- test(core): add coverage for normalizeUrl error path by @saurabhsharma2u in #5
- Add tests for renderAnalysisMarkdown by @saurabhsharma2u in #6
- Refactor Graph edge key storage to use JSON serialization by @saurabhsharma2u in #7
- 🧪 Add test for DomainFilter invalid hostname fallback by @saurabhsharma2u in #8
- 🧪 Test analyzeLinks with no links by @saurabhsharma2u in #9
- test: Add unit tests for renderAnalysisCsv by @saurabhsharma2u in #10
- Refactor: Remove redundant p-limit concurrency control by @saurabhsharma2u in #11
- Refactor duplicated graph visualization code in html report by @saurabhsharma2u in #12
- 🔒 Fix SSRF DNS Rebinding Vulnerability by @saurabhsharma2u in #13
- Fix SSRF Bypass via IPv4-mapped IPv6 Address by @saurabhsharma2u in #14
- ⚡ Optimize crawler database insertions (N+1 fix) by @saurabhsharma2u in #23
- Refactor duplicate detection logic for better maintainability by @saurabhsharma2u in #24
- ⚡ Optimize analysis data loading with iterators by @saurabhsharma2u in #25
- Remove unused file-based data loading logic from analysis module by @saurabhsharma2u in #26
- feat(core): Optimize HITS algorithm and metrics persistence by @saurabhsharma2u in #27
- ⚡ Optimize Duplicate Detection with Union-Find by @saurabhsharma2u in #22
- Refactor duplicated SimHash banding logic by @saurabhsharma2u in #21
- 🧹 Improve cluster risk heuristic with content analysis by @saurabhsharma2u in #15
- refactor(core): improve type safety for robots parser by @saurabhsharma2u in #16
- test: add error handling test for extractLinks by @saurabhsharma2u in #18
- Refactor html report to use robust sitegraph template by @saurabhsharma2u in #20
- Refactor Sitegraph Template to Separate File by @saurabhsharma2u in #17
- Refactor crawl function to Crawler class by @saurabhsharma2u in #19
- 🧹 Refactor CLI to use shared generateHtml for visualization by @saurabhsharma2u in #37
- Refactor Crawler.processPage for better maintainability by @saurabhsharma2u in #41
- test(core): improve extractLinks error handling coverage by @saurabhsharma2u in #36
- ⚡ Improve performance by using iterators in graph loading by @saurabhsharma2u in #39
- ⚡ Optimize Post-Crawl Metrics with Batch Pre-fetching by @saurabhsharma2u in #28
- 🧹 Refactor HTML report templates into separate files by @saurabhsharma2u in #29
- 🧹 Remove unused html option and clarify data loading support by @saurabhsharma2u in #38
- Refactor detectDuplicates for improved maintainability by @saurabhsharma2u in #43
- 🧪 Improve extractLinks test coverage by @saurabhsharma2u in #30
- ⚡ Optimize duplicate detection with IntUnionFind and remove Set overhead by @saurabhsharma2u in #32
- 🔒 Fix SSRF TOCTOU vulnerability in Fetcher by @saurabhsharma2u in #42
- Refactor CLI/Core output architecture by @saurabhsharma2u in #49
- Improve test coverage for core modules by @saurabhsharma2u in #48
- Redesign cli output by @saurabhsharma2u in #52
- feat: add
sitescommand to CLI by @saurabhsharma2u in #55 - Add update-notifier to CLI by @saurabhsharma2u in #54
- Redesign Crawlith Dashboard UI by @saurabhsharma2u in #56
- docs: add CLI command documentation by @saurabhsharma2u in #58
- Replace dummy dashboard data with real SQLite data by @saurabhsharma2u in #57
- feat: Crawl History & Snapshot Comparison View by @saurabhsharma2u in #59
New Contributors
- @saurabhsharma2u made their first contribution in #3
Full Changelog: v0.1.0...v0.1.1
v0.1.0
Full Changelog: https://github.com/Crawlith/crawlith/commits/v0.1.0