Google News RSS Scraper API for Headlines and Bylines
Google News RSS feeds are a compact way to follow headlines by topic, brand, or beat.
Fetching them at scale, though, runs into proxy blocks, JavaScript-rendered pages, and inconsistent markup. This page describes an API that takes a Google News URL and returns headline, source publication, byline, publish timestamp, section tag, and snippet as structured JSON, so your pipeline can skip the browser and proxy layer.
What the API returns
You hand the API a Google News URL. Behind the scenes it rotates proxies, spoofs browser fingerprints, and renders JavaScript where needed. The response is parsed for you: headline, source publication, byline, publish timestamp, section tag, and a snippet or dek summary. No HTML parsing on your side. The same call works for topic feeds, brand-mention feeds, and section feeds, so a single integration can cover several monitoring jobs.
How to call it
The flow is four steps. First, create an account to get an API key and 1,000 free credits. Second, install the SDK for your stack (Python, Node, Go, PHP, Ruby, or Java), or use plain cURL. Third, send one HTTP call with your API key and a Google News URL. Fourth, add advanced parameters only when the page needs them: render_js for JavaScript, stealth_proxy for CAPTCHAs, country_code for geo-targeting, and ai_extract_rules for natural-language extraction. The dashboard request builder can generate a working snippet per language before you drop it into your codebase.
extract_rules vs ai_extract_rules
Two extraction paths exist and they solve different problems. extract_rules maps CSS selectors to field names, so you get deterministic JSON when the page structure is stable. ai_extract_rules takes a natural-language spec and returns parsed JSON, which is useful when the markup shifts or you want a field that isn't a clean selector target. Both return parsed JSON. Pick extract_rules when you need reproducibility; pick ai_extract_rules when you need flexibility and can tolerate model-driven output.
Credit cost per request
Base requests start at 1 credit. Options add cost. The table below shows the captured per-request credit costs for the main options. Credits are valid for one month and do not roll over, so size your plan against your monthly volume rather than a peak month.
Plan tiers and what they include
Paid plans start at $19/month. Every tier includes JavaScript rendering, rotating and premium proxies, geotargeting, and screenshots/extraction rules. Priority email support, a dedicated account manager, and team management appear only on Business and above. Concurrency scales from 25 concurrent requests on Hobby up to 900 on Enterprise 120. All prices are exclusive of VAT. The full plan table with credits and concurrency per tier is shown below.
Three workflows this fits
Political headline tracking: collect headlines for competitor analysis and strategic positioning as the political landscape shifts. Trending topic gathering: pull recent headlines for timely business decisions. Industry hiring monitoring: watch job-opening headlines to analyze hiring trends and plan talent acquisition. Each workflow uses the same call shape; only the feed URL and extraction rules change.
Decision checklist before you commit
Use this checklist to decide whether the API fits your job:
- Do you need headlines from more than one topic or brand feed? The same call shape covers all of them.
- Do you need structured fields (headline, source, byline, timestamp, section tag, snippet) rather than raw XML? The API returns parsed JSON.
- Will your volume exceed 1,000 free credits in the first month? Check the plan table for the credit tier that matches.
- Do you need priority support or team management? Those start at Business.
- Do you need geo-targeted results? country_code is available on every tier.
- Do you need to handle CAPTCHA-heavy pages? stealth_proxy costs 75 credits per request.
- Have you reviewed the target site's terms of service? Public-facing pages can usually be scraped, but terms still apply.
Worked example: a brand-mention feed
Suppose you track a brand name across Google News. You build a feed URL for that brand, then send it to the API with extract_rules mapping headline, source, byline, timestamp, section tag, and snippet to field names. The response is a JSON array where each item is one article. You can then filter by section tag to separate business coverage from opinion pieces, or sort by timestamp to find the newest mention. If the markup changes and your selectors break, switch that field to ai_extract_rules with a natural-language description and keep the rest of the mapping intact.
Frequently asked questions
Do I need an account to scrape Google News RSS? No external account is required, but you do need an API key. Sign up for one (1,000 free credits, no card), send the URL, and the API handles the rest.
Is scraping Google News RSS legal? Public-facing pages can usually be scraped, but review the target site's terms of service before deploying and avoid post-login content.
What data can I extract from Google News RSS? Whatever appears on the public page can be targeted. Point extract_rules at CSS selectors, or describe the fields you want in ai_extract_rules, and the API returns structured JSON.
How do I get structured JSON from Google News RSS? You have two routes to parsed JSON: map CSS selectors to field names with extract_rules, or describe the fields in plain language with ai_extract_rules. Either way the response arrives already parsed.
Which programming languages can I use? Any. SDKs exist for Python, Node.js, Go, PHP, Ruby, and Java. Plain cURL works too.
How much does it cost? 1,000 free credits on signup, no card required. Paid plans start at $19/month. Credit cost per request depends on options: 5 credits for JS rendering, 25 for premium_proxy with JS, 75 for stealth_proxy.
| Option | Credits per request |
|---|---|
| Base request | 1 |
| render_js (JavaScript rendering) | 5 |
| premium_proxy with JS rendering | 25 |
| stealth_proxy | 75 |
Captured pricing reference; credits are valid for one month and do not roll over. Check current pricing before committing.
| Plan | Price /mo | API credits | Concurrent requests | Priority email support | Dedicated account manager | Team management |
|---|---|---|---|---|---|---|
| Hobby | $19 | 75,000 | 25 | Not included | Not included | Not included |
| Freelance | $49 | 250,000 | 50 | Not included | Not included | Not included |
| Startup (Recommended) | $99 | 1,000,000 | 100 | Not included | Not included | Not included |
| Business | $249 | 3,000,000 | 200 | Included | Included | Included |
| Business + | $599 | 8,000,000 | 400 | Included | Included | Included |
| Enterprise 14 | $999 | 14,000,000 | 500 | Included | Included | Included |
| Enterprise 24 | $1,599 | 24,000,000 | 600 | Included | Included | Included |
| Enterprise 41 (Recommended) | $2,399 | 41,000,000 | 700 | Included | Included | Included |
| Enterprise 69 | $3,599 | 69,000,000 | 800 | Included | Included | Included |
| Enterprise 120 | $5,799 | 120,000,000 | 900 | Included | Included | Included |
Captured pricing reference; all prices exclusive of VAT. JavaScript rendering, rotating and premium proxies, geotargeting, and screenshots/extraction rules are included on every tier. Check current pricing before committing.
Frequently asked questions
Do I need an account to scrape Google News RSS?
No external account is required. Sign up for an API key (1,000 free credits, no card), send the URL, and the API handles the rest.
Is scraping Google News RSS legal?
Public-facing pages can usually be scraped, but review the target site's terms of service before deploying and avoid post-login content.
What data can I extract from Google News RSS?
Any content rendered on the public page is fair game. Use extract_rules with CSS selectors, or ai_extract_rules for AI-driven extraction, and you get structured JSON back.
How do I get structured JSON from Google News RSS?
Supply extract_rules with CSS selectors mapped to field names, or pass ai_extract_rules with a natural-language spec. The response comes back as parsed JSON either way.
Which programming languages can I use to scrape Google News RSS?
Any. SDKs exist for Python, Node.js, Go, PHP, Ruby, and Java. Plain cURL works too.
How much does it cost to scrape Google News RSS?
1,000 free credits on signup, no card required. Paid plans start at $19/month for higher volume and concurrency. Credit cost per request depends on options: 5 credits for JS rendering, 25 for premium_proxy with JS, 75 for stealth_proxy.