Firecrawl crawl limit: 10,000 default vs Sume's 20 pages
Firecrawl's crawl defaults to 10,000 pages. Sume's crawl takes limit up to 20 (default 10), so narrow with path prefixes and run several keyed crawls.

Sume's crawl endpoint, POST /v1/firecrawl/crawl, accepts limit from 1 to 20 with a default of 10. Firecrawl's crawl guide says its default limit is 10,000 pages. A site section bigger than 20 pages needs several narrower crawls, or crawl_map to list URLs and crawl_scrape for the ones you want.
Firecrawl's numbers are from its crawl guide and Sume's from OpenAPI and MCP tool descriptions, read 2026-09-30.
How do the two crawl limits compare?
Both also differ in how you collect results.
| Item | Firecrawl | Sume |
|---|---|---|
| Page limit | Default 10,000 | limit 1-20, default 10 |
| Start | Crawl request | url plus a stable key (Idempotency-Key header over HTTP, idempotency_key in MCP) |
| Collect | Poll GET /v2/crawl/{id} | jobs_wait on the job id, then crawl_get |
| Result lifetime | 24 hours after completion | Not stated in the sources read |
How do I cover a site bigger than 20 pages?
Split it by section and give each crawl its own idempotency key, scoping each with include_paths (how they differ from Firecrawl's). Or call crawl_map (limit 1-100) for URLs and scrape the relevant ones.
How do I wait for a crawl?
The description says to call jobs_wait on the returned job_id, then crawl_get with the same id, and never to start a second crawl to poll. Reusing the key on a retry is what keeps a repeat from becoming a second crawl; see idempotency keys.
What does truncated mean?
crawl_get returns bounded pages, and truncated means the result was cut. The guidance is to narrow the scope if you need more content, which is the same fix as the 20-page limit: smaller prefixes, more crawls.
Sources
Related posts
More in Developers
- Firecrawl executeJavascript return value on Sume
Firecrawl returns executeJavascript results in actions.javascriptReturns. Sume names it javascript_returns and bounds it; scripts max 4,000 characters.
- Firecrawl map endpoint limit 5000 vs Sume crawl_map limit 100
Firecrawl's /map defaults to 5000 links and allows 100000. Sume's crawl_map takes limit 1 to 100, so pick URLs, then scrape them with crawl_scrape.
- Firecrawl map sitemap skip/include/only: Sume crawl_map has no switch
Firecrawl's /map has a sitemap option (skip, include, only) and includeSubdomains. Sume's crawl_map takes only url and limit, and maps one origin.
- Firecrawl MCP timeout: Sume crawl_scrape's 35, 40 and 45 s deadlines
A synchronous crawl_scrape call has three deadlines: client abort at 35 s, MCP at 40 s, host watchdog at 45 s. Narrow the page or use crawl_site.
Written by Sume