Trustworthy LLMs with QueryCortex

Providing LLM-based search and analysis of confidential information using the access rights from the enterprise identity management system

Starting Point

Information on selected / deployed LLM version in the enterprise. Information about the interface of the local IDM as well as access to stored identities,

Objective

Enable LLM deployments in Intranets with confidential and fast changing information by considering access rights stored in IDM system

Added Value​

Enable the application of LLM-based searching and reporting on internal data while guaranteeing data confidentiality

From challenges to solutions

LLMs in Intranets

Business processes and reports need access to the most recent data. This information is frequently restricted for the public, but sometimes also for other co-workers.

Confidential information

Using LLMs for searching and reporting must not bypass the existing access rights. Thus, the LLM needs knowledge about the identity and the rights of the querying person.

Methods

The solution expands the feature vectors for searching the internal documents with attributes pointing to the access rights for the linked documents. Solely data sets visible for the user are included in the search.

Approach

A middleware pulls the access rights of the authorized user and compares those with the attributes attached to the feature vectors for the LLM search.

Impact

LLMs are usable in Intranets with the most recent and also with confidential data, allowing faster search and reporting.

Post-response check

An optional check searches for named entities and replaces those with anonymized entities, if the prompt response is intended e.g. for public presentation.

Deployed at customers

Interested in this topic?

Reach out to discuss the integration of LLMS and IDM systems with us.