Skip to content

Pull Y Combinator Startup Data via API

Y Combinator's public directory is one of the most useful datasets for startup research, competitor tracking and investor monitoring.

OUTPUT FORMATSHTMLJSONMarkdown

It is also a JavaScript-heavy site behind an anti-bot stack. This page explains how a hosted scraping API turns a YC URL into clean HTML, Markdown or structured JSON — and what it costs in credits and plan tiers.

What a YC scraping request actually does

You send a URL from Y Combinator's public pages to the API endpoint together with your API key. The service renders the page in a headless browser, executes its JavaScript, rotates proxies and returns either the post-render HTML, clean Markdown, or structured JSON produced by CSS/XPath extraction rules or a natural-language AI extraction spec. You do not manage a browser fleet or a proxy pool yourself.

A typical request flow:

  1. Create an account to receive an API key and starting credits.
  2. Install an SDK (Python, Node, Go, PHP, Ruby, Java) or use plain cURL.
  3. Send the YC URL with your key and any optional parameters.
  4. Read back rendered HTML, Markdown or JSON.

Optional parameters let you turn on JavaScript rendering, route through a residential IP in a chosen country, or attach extraction rules. Each of these changes the credit cost of the request, so plan the parameter set before you scale.

What each YC startup page returns

For a typical YC company page, the fields you can expect to extract are:

  • Company name
  • One-liner description
  • Batch year
  • Sector
  • Founder profiles and social links
  • Funding rounds, total raised, round counts and lead investor names

In practice, YC directory work tends to cluster around a few recurring jobs: building a full roster for a specific batch, digging into funding detail company by company, and narrowing to recently funded startups inside a sector. Those same fields are what make YC data useful for startup research, competitor tracking and investor monitoring.

Decision checklist: hosted API vs self-managed stack

Use this checklist to decide whether a hosted scraping API fits your YC data task.

  • Do you need JavaScript execution? YC pages depend on JS. A hosted API runs the page in a real headless browser; a self-managed stack means running and patching your own Chrome fleet.
  • Do you need proxy rotation? Rotating and premium proxies are included in every standard plan here; self-managed means sourcing and rotating your own proxy pool.
  • Do you need geo-targeted requests? A country_code parameter routes through a residential IP in that country. Self-managed geo-routing requires your own residential proxy contracts.
  • Do you need structured output without writing selectors? AI extraction rules accept a natural-language spec and return JSON. Self-managed means writing and maintaining CSS/XPath selectors as the site changes.
  • Do you need concurrency above your plan limit? Concurrency is capped per plan; check the plan table below before committing to a batch size.
  • Do you need team seats and priority support? These appear only on higher tiers.

If most answers are yes, a hosted API removes infrastructure work. If you only need one-off pulls and already run a browser stack, the trade-off is different.

Credit costs and a worked example

Credits are consumed per successful request, and optional features multiply the cost. The supplied cost rules are:

  • Base request: starts at 1 credit.
  • JavaScript rendering enabled: 5 credits per successful request.
  • Premium proxies: 10 credits with JS rendering disabled, or 25 credits with JS rendering enabled.
  • API credits are valid for one month and do not roll over.

Worked example: suppose you pull 1,000 YC company pages with JavaScript rendering on and premium proxies on. At 25 credits per successful request, that is 25,000 credits — comfortably inside the Hobby plan's 75,000 monthly credits, but well above a plan that only offers base requests. If you drop premium proxies and keep JS rendering, the same 1,000 pages cost 5,000 credits. Always confirm the current credit rules on the pricing page before sizing a batch.

Plan tiers at a glance

The plan table below lists every standard and enterprise tier with its monthly price, API credit allowance, concurrency limit and feature inclusions. Prices are exclusive of VAT. Treat the figures as a dated reference and check the current pricing page before purchase. The full table is delivered as a protected module and is not reproduced here.

Failure distinction: concurrency limits vs target throttling

Two different failure modes are easy to confuse.

  • Concurrency limit (your side). The API enforces a maximum number of simultaneous requests per plan. If you exceed it, requests queue or fail regardless of the target site. Fix: reduce parallelism or upgrade the plan.
  • Target-side throttling (YC's side). YC may throttle aggressive request patterns even when you are under your concurrency limit. Fix: space out requests or use multiple sessions.

There is no per-target rate limit imposed by the API itself; the limit is concurrency per plan. If you see failures at low parallelism, suspect target-side throttling first.

When a YC scraping API is the right tool

A hosted API fits when you need rendered YC pages at scale without maintaining browsers and proxies, when you want structured JSON without writing selectors, or when you want to feed clean Markdown into an LLM for startup research. It is less compelling for a one-off single-page pull where a manual copy is faster, or where your existing stack already handles rendering and proxies at lower cost.

Related capabilities you may combine with a YC pull: AI data extraction, full-page screenshots, JavaScript scenarios (click, scroll, wait), Markdown output, and n8n workflow automation.

Standard and enterprise plan tiers
PlanPrice /moAPI CreditsConcurrent requestsJavaScript renderingRotating & Premium ProxiesGeotargetingScreenshots & Extraction RulesPriority Email SupportDedicated Account ManagerTeam Management
Hobby$1975,00025IncludedIncludedIncludedIncludedNot includedNot includedNot included
Freelance$49250,00050IncludedIncludedIncludedIncludedNot includedNot includedNot included
Startup (Recommended)$991,000,000100IncludedIncludedIncludedIncludedNot includedNot includedNot included
Business$2493,000,000200IncludedIncludedIncludedIncludedIncludedIncludedIncluded
Business +$5998,000,000400IncludedIncludedIncludedIncludedIncludedIncludedIncluded
Enterprise 14$99914,000,000500IncludedIncludedIncludedIncludedIncludedIncludedIncluded
Enterprise 24$1,59924,000,000600IncludedIncludedIncludedIncludedIncludedIncludedIncluded
Enterprise 41 (Recommended)$2,39941,000,000700IncludedIncludedIncludedIncludedIncludedIncludedIncluded
Enterprise 69$3,59969,000,000800IncludedIncludedIncludedIncludedIncludedIncludedIncluded
Enterprise 120$5,799120,000,000900IncludedIncludedIncludedIncludedIncludedIncludedIncluded

Prices are exclusive of VAT. Figures are a dated reference; check the current pricing page before purchase. The full table is delivered as a protected module and is not reproduced here.

Frequently asked questions

Can I scrape Y Combinator without writing code?

Yes. The dashboard request builder lets you paste a URL, set parameters, and copy the generated snippet in Python, Node, Go, PHP, Ruby, or cURL.

How do I handle JavaScript when scraping Y Combinator?

Pass render_js=true on the request. The page runs in a real headless browser, the JS executes server-side, and you receive the post-render HTML.

Can I scrape Y Combinator from a specific country?

Yes. Add country_code to the request and the call exits through a residential IP located in that country. That helps when the page you receive changes depending on where the visitor appears to be.

What's the rate limit for scraping Y Combinator?

There is no per-target rate limit from the API side. What you get instead is a ceiling on simultaneous requests, set by your plan. If YC starts pushing back on aggressive patterns, ease off the request pace or split the work across several sessions.

How do I get structured JSON from Y Combinator?

Two options get you parsed JSON. With extract_rules you pair CSS selectors with the field names you want; with ai_extract_rules you state the fields in everyday language. Both return the result as parsed JSON.

Which programming languages can I use to scrape Y Combinator?

Any. SDKs are published for Python, Node.js, Go, PHP, Ruby, and Java. Plain cURL works too. Pick whatever your stack already uses.