Files
chatwoot/enterprise/lib/captain/assistant_false_promise_schema.rb
Aakash BakhleandGitHub 1c7e60880d fix: add harness on false promises (#14672)
# Pull Request Template

## Description


https://linear.app/chatwoot/issue/AI-179/false-promise-soft-handoff-guard

## Type of change

- [x] Bug fix (non-breaking change which fixes an issue)
## How Has This Been Tested?

Please describe the tests that you ran to verify your changes. Provide
instructions so we can reproduce. Please also list any relevant details
for your test configuration.

Against negative cases identified by evals

## Checklist:

- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my code
- [ ] I have commented on my code, particularly in hard-to-understand
areas
- [ ] I have made corresponding changes to the documentation
- [ ] My changes generate no new warnings
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] Any dependent changes have been merged and published in downstream
modules
2026-06-23 16:30:14 +05:30

17 lines
596 B
Ruby

class Captain::AssistantFalsePromiseSchema < RubyLLM::Schema
DECISIONS = %w[safe future_work_promise].freeze
REASONS = %w[
safe_response
asks_user_to_check_or_provide_info
external_support_direction
unaccepted_handoff_offer
future_check_or_investigation
future_notification_or_update
future_callback_or_email
background_escalation_promise
].freeze
string :decision, enum: DECISIONS, description: 'Whether the response contains an unsupported promise of future work'
string :reason, enum: REASONS, description: 'The reason for the selected decision'
end