Skip to content

Acceptable Use Policy for a Web Scraping API

This page explains the acceptable use rules that apply to a web scraping API service.

OUTPUT FORMATSHTMLJSONMarkdown

It covers the general framework, who is accountable for misuse, the activities that are forbidden, how content and use may be limited, and how the policy can change. The effective date of the policy described here is July 15th, 2024.

General framework of acceptable use

The policy applies to the services provided under a legitimate and legal purpose and to any ongoing agreement. Capitalized terms carry the same meaning as in the General Conditions where they are defined.

The aim is to protect the provider, users and internet users generally from illegal, fraudulent or abusive activity. Any access or use for those purposes is strictly prohibited, and suspected cases will be investigated.

The provider assumes services will be used in a normal state of affairs and opposes abuse, discrimination, rights infringement and any action that harms or disadvantages a group, individual or resource. Users are expected to comply with the policy.

Accountability

Users are responsible for their own actions and for anyone using the services for their purpose or benefit. That responsibility extends to unauthorized access and use that results from a failure to apply reasonable access controls.

Simply accessing or using the services implies adherence to the policy by anyone using them, including users, subscriber users and subsidiary users.

If a breach is suspected, the provider may limit access and use, terminate the agreement with the offending account or the account itself without prior notice, or take other remedial or preventive action it considers appropriate. To the extent permitted by law, no credits such as API credits are available for interruptions caused by a violation.

Forbidden activities

The policy groups forbidden activities into three areas: unauthorized materials, unauthorized message activity, and unethical, exploitative or malicious activity. The lists below are non-exclusive.

Access or use of unauthorized materials

The services must not be used to access, collect, transmit, distribute or store material that violates applicable law. This includes material protected by an intellectual property right such as copyright, trademark or trade secret without proper prior authorization, and material that is obscene, defamatory or an illegal threat, or that violates export control laws.

The user is solely responsible for all material they input, upload, disseminate, transmit, create or publish through the services, and for obtaining prior legal authorization for any such material or work.

Unauthorized message activity

The services must not be used to send unsolicited messages in bulk or otherwise, commercial or not, in violation of applicable laws and regulations (spam). Examples include spam solicitations, spam from other service providers, and collecting replies to spam sent from other providers.

The services must not be used to run unconfirmed mailing lists or telephone number lists (distribution lists), such as subscribing addresses or numbers to a messaging list without the owner's permission, or storing subscribed addresses or numbers. All distribution lists run or hosted by the services must be confirmed opt-in, with verification of the owner's express consent available for the life of the list. Email lists, telephone number lists or databases acquired from third parties for spam or unconfirmed distribution lists are prohibited.

These prohibitions apply to messages sent through the services or from any network by a user, subscriber user, subsidiary user or anyone acting on the user's behalf that directly or indirectly refer the recipient to a site hosted through the services.

Unethical, exploitative and malicious activity

The services must not be used for advertising, transmitting or making available software, products or services designed to violate this policy or another provider's acceptable use policy, such as tools for sending spam, network sniffing, pinging, packet spoofing, flooding, mail-bombing or denial-of-service attacks.

They must not be used to access an account or electronic resource the user does not own or is not authorized to access (for example hacking, cracking or phreaking), to introduce viruses or malicious code intentionally or recklessly, or to harass a group or individual through denial-of-service attacks, hate speech, advocacy of racial or ethnic intolerance, or activity intended to threaten, abuse, infringe rights or discriminate.

Other forbidden activities include obtaining or attempting to obtain services to avoid payment; using the services or API to obtain services from another provider to avoid payment; unauthorized access, alteration or destruction of information about other users; interfering with other users' or authorized individuals' use of the services, API or network; publishing or transmitting links that incite violence, depict a violent act, depict child pornography or threaten health and safety; violating consumer protection laws; and violating a person's privacy.

The services and API may not be used by any person or entity involved with or suspected of involvement in illegal gambling, terrorism, narcotics trafficking, arms trafficking, or the proliferation, development, design, manufacture, production, stockpiling or use of nuclear, chemical or biological weapons, weapons of mass destruction or missiles, including affiliation with others who support such activities.

The policy also lists ad fraud or click fraud; impersonation or spoofing for fraudulent purposes; creating fake accounts or content; automatic ticket purchasing (ticket-bots); raffles, lottery or gambling; fake engagement (likes, comments, shares and similar); collection of non-public information such as data behind a login; gaming or trading of in-game items or currency; use of streaming-related domains for video, music or image streaming; trading crypto or virtual currency or NFTs; SEO manipulation such as fake clicks in search results; posting on classified, used or resell sites; completing surveys for a benefit or anything of value; and any activity that violates applicable law, regulations or third-party rights.

Limitation of content and use

The provider may, in its sole discretion, proactively block certain web content such as adult content, governmental websites or harmful domains. The blocked content may change at any time without notice.

Use of the services may be limited at the provider's sole discretion, particularly to prevent potential damage or service disruption to third-party computers or services, without liability to customers for limits imposed. The provider may also terminate the agreement and access to the services without prior notice.

Users can report misuse or suspicious activity through the dedicated abuse contact.

Miscellaneous

Impersonating the provider, representing a significant business relationship with it, or claiming ownership of its properties, including to fraudulently gain service, custom, patronage or user trust, is strictly prohibited.

The policy is a non-exclusive list of activities and intent deemed incompatible with the services and the provider's activities.

The provider may modify the policy at any time by publishing a revised version on its website. The revised version takes effect at the earliest of the date the services are used after publication, or thirty (30) days after publication.

Policy structure at a glance
SectionWhat it coversReader action
General frameworkLegitimate and legal use; protection from illegal, fraudulent or abusive activityConfirm the intended use is lawful and non-abusive
AccountabilityResponsibility for own and others' use; enforcement and credit consequencesSecure access and ensure everyone using the account follows the policy
Forbidden activitiesUnauthorized materials, spam and distribution lists, malicious and unethical activityScreen planned tasks against the prohibited list before running them
Limitation of content and useProactive blocking, use limits and terminationExpect some domains or content to be unavailable; report misuse
MiscellaneousImpersonation ban, non-exclusive list, change processCheck the published version for updates

This map summarizes the policy sections; the full policy text controls.

Frequently asked questions

Who is responsible if someone else uses my account?

You are responsible for your own actions and for anyone using the services for your purpose or benefit. That includes unauthorized access resulting from a failure to apply reasonable access controls.

Do I get API credits back if my service is interrupted for a policy violation?

To the extent permitted by law, no credits such as API credits are available for interruptions resulting from a violation of the policy.

Can I collect data behind a login?

No. Collection of non-public information, such as data behind a login, is listed as a forbidden activity.

How do I report misuse?

Use the dedicated abuse contact published with the policy to report misuse or suspicious activity.

When does a revised policy take effect?

A revised version takes effect at the earliest of the date the services are used after publication, or thirty (30) days after publication.