Crawling, Scraping & Automated Access Policy
The listings, supplier profiles, buyer requests (RFQs), prices, images and data on Abraa.com belong to Abraa FZE and its suppliers. Copying them by automated means is not allowed without our written consent.
1Scope and acceptance
This policy forms part of the Abraa.com Terms of Use. It applies to every person, company, software tool, bot, agent or service that accesses any page, file, image, feed or API on abraa.com and its subdomains ("the Platform").
By accessing the Platform you agree to this policy. If you do not agree, do not access the Platform by automated means.
2What is prohibited
Unless you have a signed written agreement with Abraa FZE, you must not, directly or through anyone else:
- Crawl, spider, scrape, harvest, mirror or index the Platform, in whole or in part, by any automated or semi-automated means.
- Copy, extract, download or store product listings, titles, descriptions, prices, images, barcodes, categories, supplier profiles, company details or buyer requests (RFQs).
- Collect supplier or buyer contact details (names, phone and WhatsApp numbers, emails, addresses) for marketing, resale, lead generation or any other purpose.
- Use Platform content to train, fine-tune or evaluate any artificial-intelligence or machine-learning model or dataset.
- Republish, resell, syndicate or build a competing catalogue, directory, price-comparison or marketplace service using Platform content.
- Monitor prices, stock or listings on the Platform for commercial intelligence.
- Access hidden or undocumented endpoints or APIs, or send requests faster than normal human browsing.
- Bypass or interfere with any security measure, rate limit, CAPTCHA, login, membership gate or bot protection.
- Create fake, multiple or automated accounts, or use stolen or shared logins, to access gated content such as buyer leads.
- Disguise automated traffic as human traffic, rotate IP addresses or proxies, or fake user agents to avoid detection.
3Tools and methods covered
The ban applies whatever technology is used, including but not limited to:
- Web crawlers, spiders and bots
- Scraping scripts (Python, Node.js, PHP and others)
- Scrapy, BeautifulSoup, Cheerio, Puppeteer, Playwright, Selenium
- Headless and automated browsers
- Browser extensions and data-extraction plug-ins
- No-code scrapers (Octoparse, ParseHub, Apify, Browse AI and similar)
- AI agents, AI browsers and autonomous assistants
- AI training crawlers (GPTBot, ClaudeBot, CCBot, Bytespider and others)
- Scraping APIs, proxy networks and residential IP services
- Macros, RPA tools and spreadsheet import functions
- Data brokers and collection services acting for you
- People paid to copy data by hand in bulk
4What is allowed
- Search engines such as Googlebot and Bingbot may crawl and index the Platform to show search results and links, following our robots.txt.
- AI search and answer engines may access pages to show short answers that cite and link to Abraa.com, where our robots.txt allows it. This does not permit AI training.
- Normal human browsing, sharing links, and quoting short extracts with a link back to the page.
- Suppliers managing their own listings through their Abraa account or the tools we provide.
- Partners and developers with a signed data or API agreement with Abraa FZE.
Our robots.txt file and its content signals (search: yes, AI input: yes, AI training: no) form part of this policy. A crawler that is not named in robots.txt is not automatically allowed to scrape.
5How we detect and protect
We actively monitor the Platform and keep logs as evidence. Our measures include:
- Traffic and behaviour analysis, rate limiting and bot detection
- Device, browser and IP fingerprinting
- Hidden honeypot links that only bots follow
- Tracer ("canary") records in our catalogue that prove when our data appears elsewhere
6Consequences and legal action
If we detect or prove a breach of this policy, Abraa FZE may, without notice:
- Block IP addresses, networks, devices and user agents.
- Suspend or permanently close any related buyer or supplier accounts, without refund of membership fees.
- Demand deletion of copied data and request takedowns from hosting providers, marketplaces and search engines.
- Take legal action against the people and companies responsible in the courts of Dubai, United Arab Emirates, or any other competent jurisdiction, including claims for damages, legal costs and injunctions, and reporting to the authorities under applicable laws, including the UAE laws on combatting cybercrimes and on copyright and related rights.
Need our data? Ask us.
We work with partners, researchers and developers. For product feeds, catalogue data or API access, contact us for a licence. Suppliers can list their own products on Abraa for free.
To report scraping or misuse of Abraa content, email [email protected] with the subject "Scraping report". Abraa FZE may update this policy at any time; the version on this page applies. This policy does not limit any other rights of Abraa FZE under its Terms of Use or applicable law.
