Listing Scraper — Builder

← Back

New Site

Basic

URL Template

Method

Response

Site Metadata

Name

Site URL (homepage)

Country

Niche

Tags

Bot Protections

Options

Request timeout (s) default: 30

Scrape concurrency default: global setting

Use proxy Use Headers Manager

HM Server

Create config

Name (cache key)

Script name

Target URL

Proxy API key (leave empty to use settings default)

Proxy project ID (optional)

Max cache

TTL (seconds)

Cache concurrency

Reuse cooldown (e.g. 4-7)

Updates semaphore (1–10)

Idle time (seconds)

Max failures

Meta (JSON, optional)

Headers

Bot Protections

Request Params

Query Params (JSON — always sent in URL regardless of method)

Category / Slug Iteration

Category location

Pagination

Pagination location

Style

Page size

Page size must match what the site returns per page — if the response has fewer items, scraping stops.

Max pages Scrape till last page

Schema Mapping

Products path (dot-notation to the array, e.g. data.items)

Field Map (unified key → raw path)

Syntax reference

JSON / API

`field`	direct field name
`parent.child`	nested dot-notation
`items.0.name`	array index access
`path1,path2`	fallback — first non-null wins
`path\|(\d+)`	regex — first capture group or full match
`path==value`	compare → boolean (case-insensitive)
`path!=value`	negative compare → boolean

HTML / HTML-in-JSON

`div.title`	text of CSS-matched element
`a.link@href`	attribute of matched element
`@data-id`	attribute on the card root
`selector\|regex`	extract then apply regex
`selector==value`	compare text → boolean
`selector!=value`	negative compare → boolean

Test & Detect

Detail Page

CSS Fields

JS rendering required

Sample product URL (Visual Mapper)

HTML option — stores the element's markup as-is. Useful for rich content like description blocks where formatting matters.

Notes

No notes yet

New Site

New Note