> For the complete documentation index, see [llms.txt](https://docs.lingoblocks.com/docs/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.lingoblocks.com/docs/knowledge-base/website.md).

# Website

You can add website content to your assistant's knowledge base to make custom data available during conversations. Navigate to the Lingo Block [dashboard](https://app.lingoblocks.com/auth).

### Create knowledge

**Add knowledge.** Click on the “Add” button.&#x20;

<figure><img src="/files/E62vhdcdQZAWPu3zXioc" alt=""><figcaption></figcaption></figure>

**Choose your knowledge source.** Pick “Website” to import content from your website.

<figure><img src="/files/58r6qmkfPpLV2VjG2PyL" alt=""><figcaption></figcaption></figure>

**Domain**. When you select this option, our tool will attempt to scrape data from the entire website of the provided domain.

<figure><img src="/files/zVO2l8oekRiykzlAMVhC" alt=""><figcaption></figcaption></figure>

**URL**. If you only need data from a specific webpage, use this option. Just paste the desired URL, and the tool will only scrape data from that page.

<figure><img src="/files/hAO5sfHmCkyq341PrFSS" alt=""><figcaption></figcaption></figure>

**Sitemap**. This option allows you to scrape data from all URLs listed in a website’s sitemap.xml.

<figure><img src="/files/eXHhNt4RmH1B5DB7lcz5" alt=""><figcaption></figcaption></figure>

**Save**. Once you're satisfied with the list of URLs, click "Save" to begin the web scraping process.

<figure><img src="/files/MWJA9ZK97AJAp2gDlME0" alt=""><figcaption></figcaption></figure>

**Approximate scraping time**. 10 minutes for every 100 URLs.

###
