Hacker News Data, Structured Through One API Call
Hacker News pages combine JavaScript rendering with active bot detection, which is why many teams hand the fetch-and-render step to a managed API instead of maintaining their own headless-browser fleet.
This page explains what the API returns from Hacker News, which request controls change the output, and how credits are consumed so you can size a plan before you wire anything into a pipeline.
What the API returns from Hacker News
Each Hacker News page can come back with the story title, its outbound URL, the point score, the comment count, the submitter, the timestamp, and the full discussion thread. That field set covers the three patterns most teams actually run: tracking front-page stories for trend dashboards, mining startup funding-round mentions for competitor and investment analysis, and measuring discussion metrics such as points and comment volume to see where audience engagement is concentrating.
You can request parsed HTML or structured JSON. For JSON, either map CSS selectors to field names through extract_rules, or describe the fields in natural language through ai_extract_rules and let the AI-driven extraction return parsed JSON. A Markdown output mode is also available when you want LLM-ready text rather than a JSON object.
Request controls and what each one changes
The controls below are the ones that materially change a Hacker News request. Use this as a field map before you build a request template.
- render_js — set to true to run the page in a real headless browser and return post-render HTML. Costs 5 API credits per successful request.
- stealth_proxy — routes through premium proxies to handle CAPTCHAs and bot checks. Costs 10 credits with JS rendering disabled, or 25 credits with JS rendering enabled.
- country_code — routes the request through a residential IP in the chosen country. Useful when content varies by geography.
- extract_rules — CSS or XPath selectors mapped to field names, returning parsed JSON.
- ai_extract_rules — a natural-language spec for AI-driven extraction, returning parsed JSON.
- Screenshots — capture a full-page screenshot of the rendered page.
A dashboard request builder lets you paste a URL, set parameters, and copy a generated snippet in Python, Node, Go, PHP, Ruby, or cURL, so you can test a configuration before committing it to code.
Credits, concurrency, and the rate-limit distinction
Two different limits matter, and they are easy to confuse.
API credits are consumed per request and are valid for one month; unused credits do not roll over. A plain request starts at 1 credit. Enabling JS rendering raises that to 5 credits per successful request. Enabling premium proxies costs 10 credits without JS rendering or 25 credits with it. Size your plan against the credit cost of the controls you actually need, not against raw request count.
Concurrency is a separate ceiling: it caps how many requests can be in flight at the same time, and it varies by plan. There is no per-target rate limit on Hacker News itself. If Hacker News throttles an aggressive pattern, space out requests or spread them across multiple sessions rather than assuming a plan-level rate limit will protect you.
A short decision checklist
Before you pick a plan, answer these in order:
- Which output do you need — parsed HTML, structured JSON via extract_rules or ai_extract_rules, or Markdown for an LLM pipeline?
- Does the page require JavaScript execution? If yes, budget 5 credits per successful request.
- Do you need to appear from a specific country? If yes, add country_code and account for the premium-proxy credit cost.
- What is your realistic peak concurrency, not your monthly request total? That drives the plan tier more than volume alone.
- Do you need team seats, priority support, or a dedicated account manager? Those features start at the Business tier.
If you can answer 1–4, the plan choice usually narrows to one or two options.
Worked example: a daily front-page snapshot
Suppose you want a daily snapshot of the Hacker News front page with title, URL, points, comment count, submitter, and timestamp, returned as JSON.
- Set render_js=true because the page runs JavaScript. That is 5 credits per successful request.
- Add extract_rules mapping CSS selectors to those six field names, or use ai_extract_rules with a natural-language description of the same fields.
- If you also need a specific country's view, add country_code; with JS rendering enabled, premium proxies cost 25 credits per request.
At 5 credits per request and one request per day, a month of daily snapshots costs roughly 150 credits — well inside the Hobby tier's 75,000 monthly credits. The binding constraint is more likely to be concurrency if you fan out across many topic feeds at once.
Plan tiers at a glance
The pricing table below reproduces the plan tiers, credit allowances, concurrency ceilings, and feature availability exactly as published. Treat the figures as a dated reference and confirm current pricing and terms with the provider before you commit to a plan. All prices are exclusive of VAT.
Setup and language support
Account creation gives you an API key and 1,000 free credits to start. SDKs are published for Python, Node.js, Go, PHP, Ruby, and Java, and plain cURL works as well. The dashboard request builder generates snippets in Python, Node, Go, PHP, Ruby, or cURL without writing code, so you can validate a request shape before integrating it into your stack.
| Plan | Price / month | API credits | Concurrent requests | Priority support | Account manager | Team management |
|---|---|---|---|---|---|---|
| Hobby | $19 | 75,000 | 25 | Not included | Not included | Not included |
| Freelance | $49 | 250,000 | 50 | Not included | Not included | Not included |
| Startup (Recommended) | $99 | 1,000,000 | 100 | Not included | Not included | Not included |
| Business | $249 | 3,000,000 | 200 | Included | Included | Included |
| Business + | $599 | 8,000,000 | 400 | Included | Included | Included |
| Enterprise 14 | $999 | 14,000,000 | 500 | Included | Included | Included |
| Enterprise 24 | $1,599 | 24,000,000 | 600 | Included | Included | Included |
| Enterprise 41 (Recommended) | $2,399 | 41,000,000 | 700 | Included | Included | Included |
| Enterprise 69 | $3,599 | 69,000,000 | 800 | Included | Included | Included |
| Enterprise 120 | $5,799 | 120,000,000 | 900 | Included | Included | Included |
Figures reflect the captured pricing page. Confirm current pricing and terms with the provider before committing. All prices exclusive of VAT.
| Control | Credit cost | Notes |
|---|---|---|
| Base request | 1 | Requests start at 1 credit each. |
| render_js=true | 5 | Each successful request that enables JS rendering costs 5 API credits. |
| Premium proxies, JS rendering disabled | 10 | Each successful request that enables premium proxies costs 10 or 25 API credits, depending on whether JS rendering is disabled or not. |
| Premium proxies, JS rendering enabled | 25 | Same rule as above. |
Credit costs are per successful request. API credits are valid for one month and do not roll over.
Frequently asked questions
Can I scrape Hacker News without writing code?
Yes. The dashboard request builder lets you paste a URL, set parameters, and copy a generated snippet in Python, Node, Go, PHP, Ruby, or cURL. You can validate a request shape there before moving it into your own codebase.
How do I handle JavaScript when scraping Hacker News?
Set render_js=true on the request. The page runs in a real headless browser, JavaScript executes server-side, and you receive the post-render HTML. This costs 5 API credits per successful request.
Can I scrape Hacker News from a specific country?
Yes. Pass country_code on the request to route through a residential IP in that country. This is useful when content varies by geography. Premium proxies cost 10 credits without JS rendering or 25 credits with it.
What's the rate limit for scraping Hacker News?
There is no per-target rate limit on Hacker News. The API enforces concurrency limits per plan instead. If Hacker News throttles an aggressive pattern, space out requests or use multiple sessions rather than expecting a plan-level rate limit to absorb it.
How do I get structured JSON from Hacker News?
You have two routes to a JSON body. The selector route takes extract_rules, where each CSS selector is paired with the output field name you want it stored under. The descriptive route takes ai_extract_rules, where you state in plain language which fields to pull and the model resolves them. Either way the response arrives already parsed as JSON, so no separate HTML parsing step is needed downstream.
Which programming languages can I use to scrape Hacker News?
Any language that can make an HTTP request. SDKs are published for Python, Node.js, Go, PHP, Ruby, and Java, and plain cURL works too. Pick whatever your stack already uses.