Database |> Language |>
Keywords
The following terms are keywords in LSD SQL as well as operations that are understood by Huxley (coming soon). In short, these are the primitives for wrangling content on the web.
For querying:
- FROM - Specify the URL to query
- SELECT - Choose what data to extract
- WHERE - Filter results
- GROUP BY - Organize results
- ACCORDING TO - Build atop other’s queries
- AGGREGATE - Combine results
- WITH - Set time-based query parameters
For data manipulation:
- MAP - Return sitemap and interactive elements
- ASSIGN - Define variables
- RUN - Execute commands
- SCAN - (coming soon)
- ZIP - Combine multiple queries
For navigation:
For browser automation:
For data extraction:
- HTML - Get raw HTML
- TEXT - Get readable text from a page
- MARKDOWN - Parse markdown
- PDF - Extract from PDFs
- URL - Obtain resolved URLs
