Pixel Cloud Crawler

Configure and start web scraping jobs with multiple job types

Google Search

Search Google and extract results with contacts

Website Crawl

Multi-page crawling with priority queues

Page Scrape

Single page scraping with AI extraction

Craigslist

Bulk scraping with phone verification

Website Crawl Features

Crawl Strategy

BFS or priority-based crawling

robots.txt

Respect website crawling rules

Browser Mode

JavaScript rendering support

Job Type

Select the type of job you want to create

Google Search

Search Google and extract results with contact extraction

Website Crawl

Crawl multiple pages from a website

Page Scrape

Scrape a single page with optional AI extraction

Craigslist

Scrape Craigslist with contact extraction and phone verification

Job Name (optional)

Give your job a memorable name. Auto-generated if left blank.

Target URLs

Specify which URLs to crawl using one of the available methods

Website URL

Enter the starting URL for the crawl

Crawl Strategy

Configure how the crawler navigates through pages

Strategy

Explores all pages at current depth before going deeper

Max Depth

Maximum link depth to follow (1-10)

Max Pages

Maximum number of pages to crawl (1-10000)

URL Patterns

Include or exclude URLs matching specific patterns

Include Patterns

Only crawl URLs matching these patterns (glob-style)

Exclude Patterns

Skip URLs matching these patterns (glob-style)

Crawl Options

Additional configuration options for the crawl

Priority Queue

Use priority-based URL ordering

robots.txt Compliance

Respect robots.txt rules

Browser Mode

Use headless browser for JS-heavy sites

Extract Contacts

Find emails and phone numbers

How It Works

1
Enter your target URL(s) using single URL, list, file upload, or sitemap
2
Configure crawl strategy (BFS or Priority-based) and set depth/page limits
3
Optionally add include/exclude patterns to filter which URLs to crawl
4
Enable options like browser mode for JavaScript-heavy sites
5
Click "Start Crawl" and monitor progress in real-time