The customer reported multiple issues with the Quality Check Agent related to sensitive data detection and usability. While the agent effectively identifies general quality issues, it incorrectly classifies technical or system-related information (such as software version numbers and standard product terminology) as sensitive data. Additionally, the current review experience lacks a consolidated view of all sensitive data findings, and users encounter workflow limitations when editing responses or choosing to retain flagged content.
Enhancement Requests
- Improve sensitive data classification to accurately distinguish technical terminology (e.g., Calypso version numbers, software versions, product names) from actual confidential information such as PII/PHI.
- Exclude software version details and standard product terminology from sensitive data detection.
- Provide a consolidated view of all sensitive data flags to simplify review.
- Enhance the review workflow by allowing easier editing, override, and retention of flagged content without unnecessary restrictions.
- Improve the Quality Check Agent's handling of negative responses by avoiding unnecessary negative phrasing when answering capability questions. For example, when asked about supported databases, the agent should emphasize supported databases instead of responding with statements such as "SQL Server is not supported."
- Improve the distinction between technical/product information and genuinely sensitive or confidential data to reduce false positives and improve overall usability.
