Documentation

Features

Explore the powerful capabilities of the Cinder Frontend.

Universal Playground

The core feature of Cinder is a unified interface where users can test all scraping capabilities in one place. Switch between Scrape, Crawl, and Search operations with a single interface.

Scrape Feature

Instantly convert any URL into clean Markdown, HTML, or JSON. Perfect for quick content extraction and one-off website analysis.

Input & Validation

✓ URL input field with client-side validation

✓ Valibot schema for type safety

✓ Real-time validation feedback

✓ Support for HTTP and HTTPS protocols

Advanced Options

✓ Custom headers configuration

✓ Cookie management

✓ Exclude specific tags

✓ JavaScript rendering toggle (static vs dynamic)

Output Formats

✓ Markdown format (human-readable)

✓ HTML output (preserves structure)

✓ Raw JSON response

✓ Status code and metadata

Result Handling

✓ One-click copy to clipboard

✓ Download as file (Markdown or JSON)

✓ Badge indicators for status

✓ Syntax highlighting for code

Perfect for:

  • ✓ Quick content extraction
  • ✓ SEO analysis
  • ✓ Article downloading
  • ✓ Data collection for analysis
  • ✓ Testing website structure

Crawl Feature

Deep domain crawling with automatic link discovery, progress tracking, and comprehensive results. Ideal for mapping entire websites and batch processing.

Job Control

✓ Start crawl with base URL

✓ Pause/resume operations

✓ Depth configuration

✓ URL filtering options

Real-Time Monitoring

✓ Progress bar with percentage

✓ Live link discovery log

✓ Status badges (Success/Running/Failed)

✓ Auto-refresh with polling

Results Export

✓ All crawled links in structured format

✓ Metadata for each page

✓ CSV/JSON export options

✓ Downloadable report

Polling System

✓ Automatic status updates every 2s

✓ Efficient network usage

✓ Graceful cleanup on completion

✓ Smart error recovery

Perfect for:

  • ✓ Website mapping and analysis
  • ✓ Competitive intelligence
  • ✓ Automated content discovery
  • ✓ Link verification
  • ✓ Large-scale data collection

Search Feature

Combine web search with automatic content scraping. Enter a query, get ranked results, and automatically extract content from matching websites.

Query Input

✓ Natural language search queries

✓ Advanced search operators

✓ Result limit configuration

✓ Real-time search suggestions

Results Display

✓ Ranked search results

✓ Card layout for each result

✓ Title, URL, and snippet

✓ Metadata and relevance score

Loading States

✓ Skeleton loaders while fetching

✓ Progressive content loading

✓ Error recovery

✓ Empty state handling

Auto-Scraping

✓ Click to scrape any result

✓ Background extraction

✓ Content preview toggle

✓ Multiple format support

Perfect for:

  • ✓ Research and market analysis
  • ✓ Competitor monitoring
  • ✓ News aggregation
  • ✓ Knowledge base building
  • ✓ Content curation

Cross-Feature Capabilities

History Management

Store and re-run previous requests from localStorage without database overhead.

Dark/Light Themes

Auto-detect system preference or manual toggle with persistent selection.

Responsive Design

Optimized for mobile, tablet, and desktop with touch-friendly controls.

Error Handling

Comprehensive error messages with recovery suggestions and retry options.

Accessibility

WCAG 2.1 AA compliant with keyboard navigation and screen reader support.

Performance

Optimized bundle size, lazy loading, and efficient state management.

Roadmap