Advanced Member Scraper

Immediate Scraping - For small websites (up to 100 pages)

Batch/Cron Scraping - For large websites (thousands of pages)

Website URL Enter the base URL with member pages. The scraper will automatically detect pagination.

Name Keywords (comma separated) Keywords to identify name field

Phone Keywords (comma separated) Keywords to identify phone field

Email Keywords (comma separated) Keywords to identify email field

Company Keywords (comma separated) Keywords to identify company field

Address Keywords (comma separated) Keywords to identify address field

Designation Keywords (comma separated) Keywords to identify designation field

Batch Processing Options

Pages per Batch Number of pages to process per cron run (10-1000)

Start Page Page number to start from

End Page (Optional) Leave empty to scrape until no more pages

Batch Processing Notes:
• Use for large websites with thousands of pages
• Pages will be processed in batches via cron job (every 5 minutes)
• Check job status in the Scraping Jobs tab
• Each batch runs for ~5 minutes to avoid timeouts
• No browser timeout issues - runs in background

How it works:
1. Enter the website URL
2. Set keywords for each field you want to extract
3. The scraper will look for tables/cells containing these keywords
4. It extracts the values after the keywords
5. One complete record per page is saved

Default keywords are set for common patterns

Member Database

Loading member list...

Open Full Member List

Scraping Jobs

Loading scraping jobs...

Open Scraping Jobs