Contracts Scraper

Fetch every contract from portal and export the data—including Valor total—to contratos.csv.

---

Run

  python -m transparencia.main 

Or

  pytest tests/integrations/test_main.py::test_scrape_integration 

Requirements

• Python ≥ 3.10
• Chromium (downloaded automatically by Playwright)

Installation

  pipx install uv 

inside the project root:

  uv venv .venv
  source .venv/bin/activate

Install runtime deps

//double check this

  uv pip install beautifulsoup4 playwright pytest
  playwright install

  uv pip install -r requirements.txt

Minimal project layout

scraper/
│
├─ transparencia/
│   └─ main.py
│
└─ tests/
    ├─ integration/
    │   └─ transparencia/
    │       └─ test_main.py