When integrating public data sources, you have two primary options:
- indexing an entire website: or
- web search queries.
Complete website integration
With Lampi AI, you can browse and crawl the content of a public website, making its information accessible from your data sources. This means you can ask AI agents to answer your query based on the content of that website.
As mentioned in Learn to integrate relevant data into Lampi, you can easily add websites to your data sources. In this case, the entire website will be indexed on the platform, allowing you to retrieve specific context from it.
Warning: Keep in mind that Lampi will index all pages of the website. If you choose to include a large content website, this may lead to latency issues or even errors, particularly for news websites with high volumes of pages.
Note: In future updates, Lampi will automatically check for updates to websites and refresh the indexed content accordingly.
Web search queries
With Lampi AI, you can search through your selected data sources and identify the most relevant context to address your queries. This is facilitated by the “Search” tool (refer to Retrieval Augmented Generation (RAG)).
However, there are times when the context required for your AI agent to respond effectively may come from public sources. This is where the Web Search and Browse tool comes into play, empowering your AI agent to search and browse the web to deliver the most up-to-date information.
To enable this capability, simply check the corresponding button in the chat bar.
Once the web search functionality is enabled, Lampi AI will generate a relevant Google query based on your request. It will then browse through the first few results (up to six pages) to collect context pertinent to your query.
This approach is especially beneficial in situations where data is obtained from various websites and frequently updated. Essentially, if you feel that a Google search is the most effective way to acquire the necessary information, this option is the perfect choice.
Warning: As Lampi is processing and analyzing all the pages content, response times can sometimes be as long as 30 seconds.
Note: In future updates, you will be able to select the settings of your web query (e.g., language, date, number of pages to browse).