Skip to content

Ground News Headlines Through One Scraping API

Ground News pages mix rendered JavaScript, rotating proxies and bot checks.

OUTPUT FORMATSHTMLJSONMarkdown

This API takes a single Ground News URL and returns rendered HTML or structured JSON, so your pipeline does not have to manage headless browsers or proxy pools. Below is what the request accepts, what comes back, and how to choose the right extraction mode and plan.

What a Ground News request returns

Each Ground News article page can be parsed into a consistent set of fields: headline, byline, publish timestamp, a source bias breakdown (left/center/right coverage), a coverage timeline, and the underlying article URLs. You can also request section tags and dek summaries when you need them. The response is rendered HTML ready to parse, or parsed JSON if you supply extraction rules.

Inputs and controls at a glance

The request is a GET call with an API key and a Ground News URL on ground.news. Optional parameters change how the page is fetched and parsed:

  • render_js — turn on JavaScript rendering for pages that need it.
  • stealth_proxy — route through stealth proxies when CAPTCHA or bot checks appear.
  • country_code — target a specific country or territory for geo-specific content.
  • ai_extract_rules — pass a natural-language spec and receive structured JSON.
  • extract_rules — map CSS selectors to field names for deterministic parsing.

You can combine these; for example, render_js plus ai_extract_rules is a common pairing for Ground News article pages.

Worked example: from URL to JSON

Suppose you want the bias breakdown and coverage timeline for a specific Ground News article. Send a GET request with the article URL and an ai_extract_rules spec such as: "headline, source bias breakdown, coverage timeline, and article URL." The API renders the page, applies the spec, and returns parsed JSON with those fields. If you prefer deterministic selectors, use extract_rules with CSS selectors mapped to the same field names. The same request pattern works for headlines and summaries, author data, or sentiment fields.

Credit costs per request

Credit consumption depends on the options you enable. The table below reflects the supplied credit rules; treat it as a planning reference and confirm current pricing before committing to volume.

Choosing a plan

Plans differ mainly in monthly API credits and concurrent requests. JavaScript rendering, rotating and premium proxies, geotargeting, and screenshots/extraction rules are included from the Hobby plan upward. Priority email support, a dedicated account manager, and team management appear on the Business plan and above. If you are unsure, start with the free credits and measure credits per successful Ground News page before choosing a tier.

Languages and SDKs

SDKs are published for Python, Node.js, Go, PHP, Ruby, and Java, and plain cURL works too. Pick whichever your stack already uses; the request shape is the same across languages.

Credit cost per successful request by option
OptionCredits per successful requestNotes
Base request1Requests start at 1 credit each.
JavaScript rendering (render_js)5Each successful request that enables JS rendering costs 5 API credits.
Premium proxy without JS rendering10Each successful request that enables Premium proxies costs 10 or 25 API credits, depending on whether JS rendering is disabled or not.
Premium proxy with JS rendering25Same premium-proxy rule, with JS rendering enabled.
Stealth proxy (stealth_proxy)75Stated in the FAQ answer on cost.

Credit figures are the supplied rules; confirm current pricing and any plan-specific variations before committing to volume.

Plan comparison (supplied figures)
PlanMonthly priceAPI creditsConcurrent requestsPriority support / AM / team mgmt
Hobby$19 /mo75,00025Not included
Freelance$49 /mo250,00050Not included
Startup (Recommended)$99 /mo1,000,000100Not included
Business$249 /mo3,000,000200Included
Business +$599 /mo8,000,000400Included
Enterprise 14$999 /mo14,000,000500Included
Enterprise 24$1,599 /mo24,000,000600Included
Enterprise 41 (Recommended)$2,399 /mo41,000,000700Included
Enterprise 69$3,599 /mo69,000,000800Included
Enterprise 120$5,799 /mo120,000,000900Included

All prices are exclusive of VAT. API credits are valid for one month and do not roll over. Figures are supplied reference values; confirm current pricing before purchase.

Frequently asked questions

Do I need an account to scrape Ground News?

No external Ground News account is required. You sign up for an API key (1,000 free credits, no card), send the URL, and the API handles rendering and proxy rotation.

Is scraping Ground News legal?

Public-facing pages can usually be scraped, but review the target site's terms of service before deploying and avoid post-login content.

What's the rate limit for scraping Ground News?

The API enforces concurrency limits per plan, not per-target rate limits. If Ground News throttles aggressive patterns, space out requests or use multiple sessions.

How do I get structured JSON from Ground News?

You have two routes to parsed JSON. With extract_rules, you supply CSS selectors and pair each one with the field name you want it stored under. With ai_extract_rules, you describe the fields you want in plain language instead of writing selectors. Either way, the response arrives already parsed as JSON rather than raw HTML.

Which programming languages can I use to scrape Ground News?

Any. SDKs are published for Python, Node.js, Go, PHP, Ruby, and Java. Plain cURL works too. Pick whatever your stack already uses.

How much does it cost to scrape Ground News?

1,000 free credits on signup, no card required. Paid plans start at $19/month for higher volume and concurrency. Credit cost per request depends on options: 5 credits for JS rendering, 25 for premium_proxy with JS, 75 for stealth_proxy.