Project SecOverview: From Queries to Insights, a Guide to Chat and Data-Pool Integration

Released: March 10, 2025 | Categories: Security SecOverview LLM
Author: samuelgiger

Discover how to enhance user interaction with a seamless chat system, integrated data pools, and smart API connections. Click to explore the guide on optimizing AI-powered chat experiences!

With the help of the Chat, there will be an option to ask questions about the current context of the page using the Chat Button at the bottom right side of the page. This will enable the viewer to ask questions about the handling of certain functions of a page. For example: "What parameters can I use for the NMAP-Scan?"

Ollama is used as the provider for the models. Depending on the model and model size, the hardware requirements can vary.

The following hardware was used to run the model for 1-3 users:

These specifications are not fully tested or recommended, just experiences!

Model	Hardware Requirements	User Experience
deepseek-r1:1.5b	NVIDIA GeForce GTX 960, 4GB VRAM	Speed: Slow, Answers/Context-Window: Short
deepseek-r1:8b	NVIDIA GeForce RTX 2070, 8GB VRAM	Speed: Moderate, Answers/Context-Window: Medium

Chat Page with Data-Pools

The Data-Pools enable loading additional context from external sources. Currently, the following data formats are supported:

Text File (.txt)

PDF File (.pdf)

JSON File (.json)

API Data (Auth: Bearer Token and response format JSON)

To use the additional context, select a Data-Pool using the button Select a data pool. After selecting the Data-Pool, simply enter a question and submit it.

Figure: Chat View

Files can be uploaded to a Pool. To access the Upload Page, use the URL https://YOUR-IP/chat/upload or use the button Upload-Files on the Chat Page.

Figure: Chat Upload Documents

Files can be uploaded to a Data-Pool. If a new Data-Pool is required, it can be created in the Admin-Portal. The Admin Panel is accessible here: https://YOUR-IP/admin

Do not add spaces to the Pool Name.

Figure: Chat RAG Pools

If API data integration is required, you can add the API Endpoint and Bearer Token in the Admin Panel. The Admin Panel is accessible here: https://YOUR-IP/admin

The entry can be made under CHAT - API Configurations - ADD API CONFIGURATION.

The following conditions and configurations are required:

The name must be unique (no spaces)

Assign a RAG Pool

The Base URL must be the API Endpoint

The API Key needs to be a Bearer Token

The response must be in JSON format

After adding the Endpoint, the service needs to be restarted. Connect to the server and restart the service secoverview.service with the following command:

systemctl restart secoverview.service

Chat Box

With the help of the Chat Box, the user can obtain additional information about certain actions or ask for help or an explanation.

Chat Box Context RSS Feeds

The Chat Box on the RSS Feeds page /rss/ has access to the latest news headlines and descriptions.

Chat Box Context YARA Scans

The Chat Box on the YARA Scans page /yara/ has access to the results of the current scan. If a past scan is opened with /yara/overview/ID, the Chat Box also has access to the scan results.

Chat Box Context NMAP Scan

The Chat Box on the /nmap/scan page has knowledge about the input fields of the form. On the scan results page /nmap/scans/ID, the Chat Box has access to the scan data, including the scanned IP/IP range as well as the scan results.

Chat Box Context BGP Check

The Chat Box on the /bgpviewcheck/ page has access to the response data.

Chat Box Context DNS Operation

The Chat Box on the /dns/ page has access to the response data.

Don't hesitate to contact me if you have any questions or requests.