Instance - Nasdaq
Description:
The Answering Agent currently does not support prompt-based filtering or selective classification of questions. When a user provides a prompt instructing the agent to respond only to a specific subset of questions (e.g. "Respond to only technical questions"), the agent does not reliably honour this instruction — it continues to process and respond to all questions, including those that should be excluded.
Customer use case (Nasdaq):
Nasdaq's input files contain two distinct question types:
- Functional questions – All sections in the "Step" column except Must-haves and Should-haves (e.g. system behaviour, risk calculations, data flows).
- Technical questions – Only the Must-haves and Should-haves sections (e.g. infrastructure, compliance, security standards such as ISO 27001 and LGPD, high availability).
- Prompt used by customer:
"Respond to only technical questions from the list and provide Percentage of Fulfillment of PR in % as per coverage for the Eqlipse Clearing and provide the response in Comments." 1 - Expected behaviour: Only Must-haves and Should-haves (technical) questions are answered; all functional sections are excluded from the output.
- Actual behaviour: Functional items are being included or misclassified in the output.
- Requested capability:
- Ability to classify questions by type or section based on prompt instructions.
- Selectively process and respond only to the specified subset (e.g. Must-haves and Should-haves).
- Exclude all other question types from the output.
- Business impact: This would significantly improve usability for teams working with structured RFP/questionnaire files that contain mixed question types. Customer has explicitly requested prioritisation and review by the product team.
Regards,
Preethi.K
