The MARKDOWN keyword can be helpful for when you’re interested in a web page and want to obtain content in markdown, as it has become the lingua franca for AI-driven applications. Similar to other page related keywords like PDF, you refer to it as you would a reserved column.
FROM url
|> SELECT MARKDOWN
The above would return a table containing MARKDOWN as the column identifier
MARKDOWN
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
# Some header
## Some subheader
All your base are belong to us
Like with other column identifiers, you can use the AS keyword to specify a different label
you=> FROM url |> SELECT MARKDOWN AS content;
content
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
# Some header
## Some subheader
All your base are belong to us
Say you want to get the markdown from Paul Graham’s website to train you AI on how to be a noob. Well here’s how you can do it:
FROM https://paulgraham.com/noob.html
SELECT MARKDOWN