RipUrl.com - Scraping Engine API

Submit URLs for scraping via the API.

Endpoints

Submit a scrape job

POST /api/scrape
Content-Type: application/json
Authorization: Bearer <token>

{
  "url": "https://example.com",
  "webhook_url": "https://your-server.com/webhook"  // optional
}

Response:
{
  "success": true,
  "job_id": "api-xxxx-xxxx",
  "status_url": "/api/scrape/api-xxxx-xxxx"
}

Check job status

GET /api/scrape/:job_id
Authorization: Bearer <token>

Response (queued):
{ "status": "queued", "job_id": "...", "queue_position": 0 }

Response (processing):
{ "status": "processing", "job_id": "...", "details": {...} }

Response (completed):
{ "status": "completed", "job_id": "...", "result": {...} }

Example

# Submit a job
curl -X POST https://ripurl.com/api/scrape \
  -H "Authorization: Bearer YOUR_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"url": "https://example.com"}'

# Check status
curl https://ripurl.com/api/scrape/api-xxxx \
  -H "Authorization: Bearer YOUR_TOKEN"

Status

Jobs are processed and results are stored for 30 minutes.