Social Media Scraper for Public Profile Data
Collect fresh, public profile and post data from major social platforms through a single API call, without running your own browsers, proxies or rendering infrastructure.
What to collect first
Most teams need three kinds of public signal. Follower counts support influencer discovery and competitor tracking. Per-post likes, shares and comment counts feed brand monitoring and campaign reporting. Mentions and hashtag use, watched close to real time, support reputation and trend work. Decide which signal you need first, because that choice determines the fields you extract and how often you refresh them.
A four-step workflow
- Create an account and copy your API key. 2. Install the SDK for your stack, or use cURL. 3. Send a GET request with a public profile or post URL; the page is rendered and rotating residential proxies are used, and rendered HTML comes back ready to parse. 4. Add options only when needed: render_js for JavaScript-heavy pages, stealth_proxy when CAPTCHAs appear, country_code for geo-targeting, and ai_extract_rules when you want fields described in plain language instead of selectors. A practical check: start with one profile URL and one extraction rule, confirm the fields, then scale to lists of URLs.
Choosing the right output
Use extract_rules when the page layout is stable and you know the selectors; it gives precise, repeatable fields. Use ai_extract_rules when layouts shift often or you prefer describing the wanted fields in natural language; it returns structured JSON without selectors. If you need to see what a person sees, capture a screenshot for visual verification. If dynamic content loads after interaction, run a JavaScript scenario that clicks, scrolls or waits before extraction. If the output is for an LLM workflow, request clean Markdown instead of raw HTML.
Reliability and limits
Proxy rotation and headless-browser rendering reduce IP-based blocking by mimicking ordinary browsing. Throughput scales with headless browsers and rotating proxies, and results typically arrive within a few seconds even on JavaScript-heavy pages. Note the distinction: concurrency is limited by your plan, while throttling by a target site is a separate behaviour you manage by spacing requests or using multiple sessions. Personal data is not collected or stored from scraped sites unless you explicitly request it.
Pricing and plan fit
{{OWNER_PLAN_PRICES_AND_LIMITS}} Compare plans by credits per month, concurrent requests, and whether JavaScript rendering, rotating and premium proxies, geotargeting, screenshots and extraction rules are included. Higher tiers add priority email support, a dedicated account manager and team management with per-user credit and concurrency quotas. Credits are valid for one month and do not roll over; requests start at 1 credit each, with rendering and proxy options costing more.
| Parameter | Use it when | What it does |
|---|---|---|
| render_js | Content loads via JavaScript | Executes the page in a headless browser and returns post-render HTML |
| stealth_proxy | CAPTCHAs or bot checks block requests | Routes through stealth proxies for harder anti-bot pages |
| country_code | Content varies by country | Routes through a residential IP in the chosen country |
| extract_rules | You know the CSS selectors | Maps selectors to field names and returns parsed JSON |
| ai_extract_rules | Layouts change or you prefer plain language | Returns structured JSON from a natural-language spec |
Parameter names are shown exactly as supplied; availability and credit costs must be confirmed by the owner.
Frequently asked questions
How do I handle JavaScript when scraping social media data?
Set render_js=true. The page runs in a headless browser on the server side, JavaScript executes there, and the returned HTML reflects the rendered page.
Can I scrape social media data from a specific country?
Yes. Supply country_code so the request is routed through a residential IP in that country, which helps when the content shown differs by location.
What's the rate limit for scraping social media data?
Limits are concurrency limits set by your plan rather than a per-target rate limit. If a target throttles aggressive patterns, space requests out or use multiple sessions.
How do I get structured JSON from social media data?
Use extract_rules to map CSS selectors to field names, or ai_extract_rules with a plain-language description of the fields you want. Either approach returns parsed JSON.
Which programming languages can I use to scrape social media data?
Any language works. SDKs are offered for Python, Node.js, Go, PHP, Ruby and Java, and plain cURL works as well, so you can stay with your existing stack.
How much does it cost to scrape social media data?
{{OWNER_FREE_CREDITS}} on signup, with {{OWNER_PAID_PLAN_START}} for paid plans. The credit cost per request depends on the options enabled: {{OWNER_CREDIT_COSTS_BY_OPTION}}.