Skip to main content

Documentation Index

Fetch the complete documentation index at: https://mintlify.com/D4Vinci/Scrapling/llms.txt

Use this file to discover all available pages before exploring further.

Scrapling provides three main fetcher types, each designed for specific use cases. Understanding their capabilities will help you choose the right tool for your scraping task.

​
Overview

FetcherSpeedStealthUse Case
FetcherFastestMediumStatic websites, APIs
StealthyFetcherMediumHighestAnti-bot bypass, Cloudflare
DynamicFetcherSlowerLowJavaScript-heavy sites

​
Fetcher (HTTP Requests)

Best for: Fast HTTP requests to static websites or APIs 
from scrapling.fetchers import Fetcher

page = Fetcher.get('https://quotes.toscrape.com/')
quotes = page.css('.quote .text::text').getall()
Features:
  • Built on curl_cffi for fast HTTP/1.1, HTTP/2, and HTTP/3 support
  • TLS fingerprint impersonation (mimics real browsers)
  • Automatic header generation for stealth
  • Supports GET, POST, PUT, DELETE methods
  • Lowest resource usage
When to use:
  • Scraping static HTML pages
  • Making API requests
  • Sites without heavy JavaScript or anti-bot protection
  • When speed is critical

​
StealthyFetcher (Anti-Bot Bypass)

Best for: Bypassing anti-bot systems like Cloudflare Turnstile 
from scrapling.fetchers import StealthyFetcher

# Bypass Cloudflare automatically
page = StealthyFetcher.fetch(
    'https://nopecha.com/demo/cloudflare',
    headless=True,
    solve_cloudflare=True
)
data = page.css('#padded_content a').getall()
Features:
  • Advanced stealth capabilities with fingerprint spoofing
  • Automatic Cloudflare Turnstile/Interstitial bypass
  • Canvas fingerprinting protection
  • WebRTC leak prevention
  • Passes most online bot detection tests
  • Built on Chromium with stealth patches
When to use:
  • Sites protected by Cloudflare Turnstile
  • Anti-bot systems that detect automation
  • When you need maximum stealth
  • Sites with CAPTCHA challenges

​
DynamicFetcher (Browser Automation)

Best for: Full browser automation with Playwright 
from scrapling.fetchers import DynamicFetcher

page = DynamicFetcher.fetch(
    'https://quotes.toscrape.com/',
    headless=True,
    network_idle=True,
    load_dom=True
)
quotes = page.css('.quote .text::text').getall()
Features:
  • Full Playwright browser automation
  • JavaScript execution and DOM manipulation
  • Wait for network idle, selectors, or custom conditions
  • Page actions for complex interactions
  • Real Chrome or Chromium support
When to use:
  • JavaScript-heavy single-page applications (SPAs)
  • Sites requiring complex user interactions
  • When you need to execute custom JavaScript
  • Dynamic content loading scenarios

​
Quick Decision Guide

1

Start with Fetcher

Always try Fetcher first - it’s the fastest option and works for most static sites.
2

Switch to StealthyFetcher if blocked

If you encounter Cloudflare or anti-bot protection, use StealthyFetcher.
3

Use DynamicFetcher for JavaScript-heavy sites

If content loads via JavaScript or you need browser automation, use DynamicFetcher.

​
Async Support

All fetchers support async operations: 
import asyncio
from scrapling.fetchers import AsyncFetcher, StealthyFetcher, DynamicFetcher

async def scrape():
    # Async HTTP request
    page1 = await AsyncFetcher.get('https://example.com')
    
    # Async stealth fetch
    page2 = await StealthyFetcher.async_fetch('https://protected-site.com')
    
    # Async dynamic fetch
    page3 = await DynamicFetcher.async_fetch('https://spa-site.com')

asyncio.run(scrape())

​
Next Steps

Static Requests

Learn about the Fetcher class for HTTP requests

Stealthy Mode

Bypass anti-bot systems with StealthyFetcher

Browser Automation

Full browser control with DynamicFetcher

Sessions

Manage persistent sessions and cookies

Build docs developers (and LLMs) love

Get started for freeTalk to us