v2.48.13

spider-rs/spiderv2.48.13Mar 31, 2026by j-mendez

AI Summary

Adds CLI authentication functionality for Spider Cloud, allowing users to store API keys locally and utilize various cloud modes for remote crawling and headless browser operations.

Key Highlights

  • New `spider authenticate` command
  • Support for Spider Cloud modes (proxy, api, unblocker, fallback, smart)
  • Remote headless browser support via Spider Browser Cloud
  • Key resolution order: flag > env var > stored credentials

New Features

  • CLI authentication command
  • Spider Cloud API integration
  • Remote headless browser support

Full Release Notes

## What's New

**`spider authenticate` command** — Store your [Spider Cloud](https://spider.cloud) API key locally for remote crawls.

### Usage

```sh
# Authenticate (stores key in ~/.spider/credentials)
spider authenticate sk-your-key
spider auth  # alias, interactive prompt

# Crawl via Spider Cloud (key auto-loaded)
spider crawl -u https://example.com -o

# Choose cloud mode
spider crawl -u https://example.com --spider-cloud-mode smart -o
spider crawl -u https://example.com --spider-cloud-mode unblocker -o

# Remote headless browser via Spider Browser Cloud
spider crawl -u https://example.com --spider-cloud-browser --headless -o
```

### Key Resolution Order
1. `--spider-cloud-key` flag
2. `SPIDER_CLOUD_API_KEY` env var
3. Stored credentials from `spider authenticate`

### Cloud Modes
| Mode | Description |
|------|-------------|
| `proxy` | Transparent proxy (default) |
| `api` | POST /crawl API |
| `unblocker` | Anti-bot bypass |
| `fallback` | Direct fetch first, fallback on 403/429/503 |
| `smart` | Auto-detects bot protection |

Sign up at https://spider.cloud for an API key.