Skip to content
This repository was archived by the owner on Oct 24, 2025. It is now read-only.
This repository was archived by the owner on Oct 24, 2025. It is now read-only.

Calling certain parse methods with URLs is redundant #3

Description

@jajajasalu2

In DefaultSpider, the parse methods for the parser classes are called by URLs, for example the parse_debian method is called if a debian security tracker URL is found. This is wrong.

Either these parsers should be called before crawling the entrypoint URLs, or a sophisticated way to call these parse methods without a URL is required.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions