Sony MathewandGitHub
8b977b35a8
## Description Adds the foundation for feature-specific LLM model routing so Captain AI features can resolve their effective provider/model from code defaults and account-level overrides. This fixes the provider metadata key in `config/llm.yml`, adds `Llm::FeatureRouter`, and routes existing `CaptainFeaturable` model defaults through the shared resolver. Fixes https://linear.app/chatwoot/issue/CW-7425/test-new-models ## Type of change - [ ] Bug fix (non-breaking change which fixes an issue) - [x] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality not to work as expected) - [ ] This change requires a documentation update ## How Has This Been Tested? - `bundle exec rspec spec/lib/llm/models_spec.rb spec/lib/llm/feature_router_spec.rb spec/models/concerns/captain_featurable_spec.rb` - 23 examples, 0 failures - `bundle exec rubocop lib/llm/models.rb lib/llm/feature_router.rb app/models/concerns/captain_featurable.rb spec/lib/llm/models_spec.rb spec/lib/llm/feature_router_spec.rb spec/models/concerns/captain_featurable_spec.rb` - no offenses - `bundle exec ruby -e "require 'yaml'; config = YAML.load_file('config/llm.yml'); abort('missing providers') unless config['providers']; abort('missing models') unless config['models']; abort('missing features') unless config['features']; puts 'llm.yml ok'"` - `git diff --check` ## Checklist: - [x] My code follows the style guidelines of this project - [x] I have performed a self-review of my code - [ ] I have commented on my code, particularly in hard-to-understand areas - [ ] I have made corresponding changes to the documentation - [x] My changes generate no new warnings - [x] I have added tests that prove my fix is effective or that my feature works - [x] New and existing unit tests pass locally with my changes - [ ] Any dependent changes have been merged and published in downstream modules
30 lines
854 B
Ruby
30 lines
854 B
Ruby
module Llm::FeatureRouter
|
|
class UnknownFeatureError < StandardError; end
|
|
|
|
class << self
|
|
def resolve(feature:, account: nil)
|
|
feature_key = feature.to_s
|
|
raise UnknownFeatureError, "Unknown LLM feature: #{feature_key}" unless Llm::Models.feature?(feature_key)
|
|
|
|
model = account_model_override(account, feature_key)
|
|
source = model.present? ? :account_override : :default
|
|
model ||= Llm::Models.default_model_for(feature_key)
|
|
|
|
{
|
|
feature: feature_key,
|
|
provider: Llm::Models.provider_for(model),
|
|
model: model,
|
|
source: source
|
|
}
|
|
end
|
|
|
|
private
|
|
|
|
def account_model_override(account, feature_key)
|
|
model = account&.captain_models&.[](feature_key).presence
|
|
return unless model
|
|
return model if Llm::Models.valid_model_for?(feature_key, model)
|
|
end
|
|
end
|
|
end
|