Diffbot Review: Features, Pricing & Tests
- Diffbot is an AI extraction API. It uses computer vision and NLP to turn a URL into structured JSON, with 9 Extract endpoints (Analyze, Article, Product, Discussion, Image, Video, Event, Job, List) plus a 10-billion-entity Knowledge Graph.
- Pricing (from its pricing page) is credit-based: Free $0 (10K credits/mo, 5 calls/min), Startup $299 (250K), Plus $899 (1M), and Enterprise custom. The free plan is recurring and needs no card.
- Entry price is steep: the first paid tier is $299/mo. That buys data enrichment and entity graphs most scraping APIs do not offer, but it prices out small static-scraping jobs.
- Strengths users cite: rule-less extraction that survives layout changes, the Knowledge Graph, and clean JSON. Common gripe: cost, plus it is built for parsed entities, not raw HTML or hard anti-bot targets.
- Performance figures here are approximate, compiled from public + vendor figures, not our own first-hand tests. Independent benchmarks pending (how we test).
Diffbot is one of the oldest AI-extraction APIs in the market, and the question I get is whether its entity-first approach and $299/mo entry price earn their keep in 2026. This is a single-vendor review: what it is, how the pricing works, the features that matter, honest pros and cons with sentiment attributed, and who it fits. Every price, endpoint, and figure below comes from Diffbot’s own pricing, product, and documentation pages in mid-2026, attributed inline, because pricing pages move and review-site numbers go stale fast. If you want the wider category first, start with the web scraping pillar guide.
One disclosure up front: bestscraperapi.com earns affiliate commissions from some of the API vendors I write about, including the ChocoData comparison at the end. That does not change the numbers. Pricing comes straight from each vendor’s own page, and I flag every figure I could not verify rather than guessing.
A second note on performance. The speed and reliability figures in this review are approximate, compiled from Diffbot’s own published material plus aggregated public reports. They are not bestscraperapi.com’s own first-hand tests. My independent, like-for-like benchmarks are still in progress; see how we test for the methodology.
What is Diffbot?
Diffbot is an AI web-data API that takes a URL and returns clean, structured JSON, using computer vision and natural language processing to read a page the way a person would rather than relying on CSS selectors you write. Per its documentation, “Extract uses computer vision and natural language processing to automatically categorize and extract their contents into clean, structured JSON.” You send a request with your token and the target URL, Diffbot loads and renders the page, classifies what kind of page it is, and returns typed fields for that page type.
That design is the core difference from a proxy-and-HTML API. Most scraping tools hand you the raw HTML and leave parsing to you, the brittle work covered in the XPath and CSS selectors guide. Diffbot does the parsing itself and returns the finished entity. On top of the per-URL Extract APIs, it maintains a Knowledge Graph of over 10 billion entities it has already crawled, which you query directly for enrichment. The two layers are the whole product, and I cover each below.
How much does Diffbot cost?
Diffbot uses fixed monthly plans priced by the number of credits you get, and all tiers are listed with exact figures on its pricing page. The numbers below are from Diffbot’s pricing page in mid-2026. The free plan is recurring, not a one-time trial, and needs no credit card.
| Plan | Price/mo | Credits/mo | Rate limit | Active crawls |
|---|---|---|---|---|
| Free | $0 | 10,000 | 5 calls/min | Yes (Crawl included) |
| Startup | $299 | 250,000 | 5 calls/sec | Yes |
| Plus | $899 | 1,000,000 | 25 calls/sec | 25 |
| Enterprise | Custom | Custom | 25+ calls/sec | 100+ |
Per-credit rates fall as you climb: $0.001 per credit on Startup and $0.0009 on Plus, per the pricing page. Paid plans bill overage pro-rata at the plan rate when you pass the monthly allotment, while the Free tier returns a “429 Quota Exceeded error” once you hit the cap. All tiers include the core products (Extract, Bulk Extract, Crawl, Natural Language, Knowledge Graph Search and Enhance); the higher plans add more active crawls, more user licenses, and a custom SLA. Confirm the current per-tier breakdown on the Diffbot pricing page before you buy, since those move.
The headline to flag is the entry price. The first paid step is $299/mo, far above the pay-as-you-go APIs that start near $19/mo. That gap is the single biggest factor in whether Diffbot fits your budget, and I return to it in the comparison.
What are Diffbot’s Extract endpoints?
Diffbot offers nine Extract endpoints, each tuned to a page type, plus an Analyze endpoint that auto-detects the type for you. This is the table that matters most for scraping work, because it tells you what structured output you get per page. Descriptions below are quoted or paraphrased from Diffbot’s documentation index in mid-2026.
| Endpoint | Target page | What it returns |
|---|---|---|
| Analyze | Any URL | Auto-classifies the page, then extracts data by detected type |
| Article | News, blog posts, text pages | Clean article text, title, author, date, and related data |
| Product | E-commerce product pages | Pricing, product specs, images, and more |
| Discussion | Forums, reviews, comment threads | Entire threads of reviews and comments, structured |
| Image | Any page with images | Primary image(s) with metadata for each |
| Video | Video pages and platforms | Metadata, thumbnail, direct video URL, embed code |
| Event | Event pages | Dates, location and address, images, descriptions |
| Job | Job postings | Structured fields from the posting |
| List | Index, listing, search-result pages | A structured list of items from “list-like” pages |
The Analyze endpoint is the one to start with when you are scraping mixed or unknown URLs, since it picks the right extractor automatically. If you already know the page type, calling the specific endpoint (Product, Article, and so on) is the direct route. Output is JSON across the board, which drops straight into the workflow from the Python web scraping guide.
On rendering: Diffbot’s Extract loads pages with a full engine and reads the rendered result, so JavaScript-built content is handled without a separate flag, the trade-off explained in scraping without getting blocked. Its docs also reference finding JavaScript-generated links while crawling and an optional proxy setting to “avoid rate limiting or throttling responses when extracting from certain websites.” A minimal call is a single URL request. The pattern below follows Diffbot’s documented format; I have not executed it here, so I am not pasting fabricated output.
# Documented request pattern (not run here)
curl "https://api.diffbot.com/v3/product?token=YOUR_TOKEN&url=https://example.com/item"
For lighter, static targets you can pair or compare Diffbot with open tooling from the BeautifulSoup guide or the Scrapy guide, since Diffbot’s value is the AI parsing, not raw fetching.
What else does Diffbot offer beyond Extract?
Beyond the per-URL Extract endpoints, Diffbot ships a Knowledge Graph, Crawlbot, and a Natural Language API, which is what separates it from a plain scraping API. These cover enrichment and bulk indexing rather than single-page extraction. Details below are from Diffbot’s product pages in mid-2026.
| Product | What it does | Notable figure |
|---|---|---|
| Knowledge Graph | Pre-built database of crawled entities you query for enrichment | ”Over 10 billion” people, companies, products, articles, discussions; “50+ fields” per record |
| Crawlbot | Spiders a site and applies Extract APIs across many pages | ”Crawl 50 or 50k urls”; unlimited pages per its product page |
| Natural Language API | Pulls entities, relationships, and sentiment from raw text | Builds your own knowledge graphs from unstructured text |
| Enhance API | Enriches your existing person/company records against the graph | Integrates with Excel, Google Sheets, Tableau, Zapier |
The Knowledge Graph is the headline asset. Instead of scraping a site yourself, you query data Diffbot has already crawled using Diffbot Query Language (DQL) or the visual builder, and get back complete records with 50+ fields. Diffbot markets it as “the largest in the world” with “over 10 billion” entities, per its Knowledge Graph page. For lead prospecting, firmographic enrichment, or news monitoring, that is a different job than URL scraping, and it is the reason teams pick Diffbot over a cheaper HTML API. Crawlbot handles the bulk side: point it at a domain and it applies the Extract APIs across the crawl, useful when you need a whole catalog rather than one page.
How fast and reliable is Diffbot?
I do not have first-hand benchmark numbers for Diffbot yet, so I am labeling everything here clearly rather than inventing figures. AI extraction that renders every page and runs computer vision is doing more work per request than a static HTML fetch, so latency naturally runs higher than a plain proxy call. I treat any vendor-implied performance as directional, not a like-for-like benchmark.
| Metric | Figure | Source | Label |
|---|---|---|---|
| Extraction method | Computer vision + NLP, full render per page | Diffbot docs, mid-2026 | Vendor-published |
| Latency | Higher than static fetch; rendering + vision per call | Compiled from public + vendor figures | Approximate, not first-hand |
| Rate limits | 5 calls/min free, 5 calls/sec Startup, 25 calls/sec Plus | Diffbot pricing, mid-2026 | Vendor-published |
| Success on layout change | Rule-less extraction designed to survive redesigns | Diffbot docs, mid-2026 | Vendor self-reported |
Two caveats before you lean on these. First, the rate limits are the practical ceiling on throughput: 5 calls per minute on the free plan is fine for testing but not production, and you need Startup or Plus for real volume. Second, the latency note is approximate, compiled from public reports and vendor material, not bestscraperapi.com’s own measurement. My independent, same-target benchmark across providers is in progress at how we test; check back for measured numbers rather than trusting any vendor’s self-report, including this one.
What are the pros and cons of Diffbot?
The honest summary is that Diffbot is strong on AI extraction and unique on the Knowledge Graph, while the entry price and entity-first focus make it a poor fit for cheap, raw, or hard-anti-bot scraping. Sentiment below is attributed: these reflect commonly reported developer experience and Diffbot’s own documented behavior, not a controlled test by me.
| Pros | Cons |
|---|---|
| Rule-less AI extraction that survives layout changes, cited often by users | Entry paid plan is $299/mo, far above pay-as-you-go rivals |
| Nine typed Extract endpoints return clean JSON, no parser to maintain | Built for parsed entities, not raw HTML or hardest anti-bot targets |
| Knowledge Graph (10B+ entities) is a genuine enrichment differentiator | Free plan caps at 5 calls/min, too slow for production testing |
| Renders JavaScript pages without a separate flag | Credit costs vary by endpoint and call type, so budgeting takes care |
| Recurring free plan (10K credits/mo) with no card | Overkill if you only need simple static-page fetches |
The recurring theme in feedback is the trade between resilience and cost: teams praise extraction that does not break on a site redesign, then flag that $299/mo is a real commitment for anything but entity-grade work. The Knowledge Graph draws the most consistent praise as something competitors simply do not offer.
Who is Diffbot for?
Diffbot fits teams that need structured entity data at scale and value extraction that survives site changes over the lowest possible price. If your work is enrichment, market intelligence, news monitoring, or pulling typed records (products, articles, jobs, discussions) across many page formats, Diffbot’s rule-less APIs and Knowledge Graph do that with little parser maintenance. The fixed plans suit funded teams and data-heavy products where the entity output, not a cheap raw fetch, is the point.
It fits less well if your budget is tight and your targets are plain HTML, because the $299/mo entry prices out small static-scraping jobs, or if your blocker is aggressive anti-bot defense rather than parsing, since Diffbot’s strength is extraction, not a hard-target stealth proxy pool. For those cases, compare the per-request economics against a cheaper-entry or pay-as-you-go alternative before committing.
How does Diffbot compare to ChocoData?
ChocoData is the closest alternative I cover on the structured-output axis, and the two differ most on entry price, billing model, and what “structured” means. Both return parsed JSON instead of leaving you to write selectors. The comparison below is factual, from each vendor’s own pages in mid-2026.
| Factor | Diffbot | ChocoData |
|---|---|---|
| Lowest paid entry | $299/mo (Startup), 250,000 credits | $19/mo (Vibe), 27,000 requests (135,000 credits) |
| Free tier | 10,000 credits/mo, no card, recurring | 1,000 requests/mo (5,000 credits), no card, recurring |
| Billing unit | Credits (rate varies by endpoint and call) | Credits (5 per request; +10 render, +10 screenshot) |
| Structured output | 9 AI Extract endpoints + 10B-entity Knowledge Graph | Universal endpoint + 453 dedicated endpoints across 235 sites |
| Extraction approach | Computer vision + NLP, rule-less, page-type typed | Site-specific parsers returning parity-checked JSON |
| Best-fit job | Entity enrichment, resilient AI extraction at scale | Broad site coverage and per-site scraping at low entry cost |
The practical read: Diffbot’s paid entry is $299/mo with unique AI extraction and a 10-billion-entity Knowledge Graph, while ChocoData publishes a $19/mo paid entry, a recurring free tier, and a universal endpoint plus 453 dedicated endpoints across 235 sites, per ChocoData’s site in mid-2026. If you specifically need rule-less AI extraction that survives redesigns or the Knowledge Graph for enrichment, Diffbot covers ground ChocoData does not. If you want the lowest documented entry price and broad per-site coverage for scraping, ChocoData is the value pick. Try ChocoData.
One last reminder, because it matters for budgeting: every figure here is what each vendor published in mid-2026, and scraping-API pricing changes frequently. Confirm the current number on the vendor’s own pricing page, and size your plan to your real call mix rather than the headline credit count. For the broader landscape, the web scraping pillar guide and the Python guide cover the free alternatives you can pair with or replace an API with.
FAQ
Yes. Diffbot's Extract APIs load pages with a full rendering engine and use computer vision plus NLP to read the rendered result, so JavaScript-built content is extracted without a separate render flag. Its docs also cover finding JavaScript-generated links while crawling and an optional proxy setting to avoid rate limiting on certain sites. You send a URL, you get parsed JSON back.
Extract reads one URL you supply and returns structured fields for that page. The Knowledge Graph is a pre-built database of over 10 billion entities (people, companies, products, articles, discussions) that Diffbot already crawled, queried with Diffbot Query Language or the Enhance API. Extract is per-URL scraping; the Knowledge Graph is enrichment against data Diffbot holds, with 50+ fields per record per its product page.
For plain HTML scraping at low volume, the $299/mo entry plan is hard to justify when pay-as-you-go APIs start near $19/mo. Diffbot earns its price when you need rule-less AI extraction that survives site redesigns, typed entity output across many page formats, or the Knowledge Graph for enrichment. Match the tool to the job: entity data and resilience, not cheap raw fetches.