Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 

Repository files navigation

Google News Scraper

Google News Scraper by cloro

cloro

The Google News scraper by cloro returns Google News results as structured JSON: article titles, snippets, sources, publication dates and thumbnails.

How do you scrape Google News?

  1. Get an API key at cloro.dev.
  2. POST a query to https://api.cloro.dev/v1/monitor/google/news.
  3. Read the parsed fields from the JSON response.

News is the surface where freshness beats everything else, so the endpoint is built for repeated polling of the same query rather than deep one-off pulls. Use pages to widen coverage and country to change the edition.

Request sample (Python)

import requests

payload = {
    'query': 'AI search regulation',
    'country': 'US',
    'pages': 1,
}

response = requests.post(
    'https://api.cloro.dev/v1/monitor/google/news',
    headers={'Authorization': 'Bearer YOUR_API_KEY'},
    json=payload,
)

print(response.json())

Request sample (cURL)

curl -X POST https://api.cloro.dev/v1/monitor/google/news \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"query": "AI search regulation", "country": "US"}'

Node.js and async/webhook examples are in the endpoint documentation.

Request parameters

Parameter Description Default
query* The news search query
country Country code, which selects the Google News edition US
device desktop or mobile desktop
pages Number of result pages to return 1
include.html Return a URL to the full HTML (expires after 24h) false

* Required

What data does the Google News scraper return?

{
  "success": true,
  "result": {
    "newsResults": [
      {
        "position": 1,
        "title": "Regulators open inquiry into AI search results",
        "url": "https://example.com/news/ai-search-inquiry",
        "source": "Example Times",
        "date": "2 hours ago",
        "snippet": "The inquiry will examine how AI answers attribute sources...",
        "thumbnail": "https://example.com/thumb.jpg"
      }
    ]
  }
}
  1. newsResults — position, title, URL, source, date, snippet and thumbnail per article.
  2. html — a URL to the full rendered page when include.html is set, expiring after 24 hours.

The structure is deliberately flat. News has no AI Overview, no shopping block and no local pack, so there is nothing else to parse.

Full field-level schemas are in the endpoint reference.

Use cases

  • Media monitoring — track coverage of a brand, product or competitor by query.
  • Crisis detection — poll a branded query on a short interval and alert on new sources.
  • Source-mix analysis — which publications Google News surfaces for a topic, and how that changes.
  • Content research — what has already been written before you commission a piece.

FAQ

How fresh are the results?

As fresh as Google News itself. The date field is returned as Google renders it, usually relative for recent items.

Can I get a specific country edition?

Yes, via country. Editions differ in both source mix and ordering, so a US and a GB pull on the same query are genuinely different result sets.

Is there a date filter?

Not on this endpoint. Filter on the returned date field, or narrow the query.

Is scraping Google News allowed?

cloro returns publicly visible results. Article text itself stays with the publisher; use the snippets and links rather than reproducing full articles.

Learn more

Other cloro scrapers

AI Mode · AI Overview · ChatGPT · Copilot · Gemini · Google Search · Grok · Perplexity

Contact us

Questions or support: r/cloroapi.

About

Returns Google News results as structured JSON: article titles, snippets, sources, publication dates and thumbnails.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors