This PR adds a Captain Assistant **Overview** page to show some KPI metrics (conversations handled, auto-resolution, handoff, hours saved, reopen-after-resolve, conversation depth) with trend deltas vs the previous window, a real knowledge card, and a lazily-loaded, cached LLM welcome summary. ### Highlights - **Two contextual banners** on the overview: - **Inbox banner** — prompts the user to connect an inbox when the assistant has none, so it can actually do work. - **Coverage banner** — warns when FAQ coverage is below 85% with more than 100 responses pending review, linking straight to the pending queue. Dismissal persists per-assistant for 24h via localStorage. - **Batched stats builder** (`Captain::AssistantStatsBuilder`) computes both windows in single FILTER-aggregated scans to cut round trips, behind new `stats`/`summary` endpoints. - **Cards included but intentionally left dummy / not rendered yet:** `ResponseQualityCard` (flagged responses) and `CreditUsageCard` (credit usage + daily chart). Credits are an account-wide counter with no per-assistant or daily history, so there is no real data to back them yet; they ship in the codebase but are not wired into the page. ### Index migration - Replaces `index_messages_on_sender_type_and_sender_id` with `index_messages_on_sender_and_created` `(sender_type, sender_id, created_at)`. - **Why it helps:** the per-assistant windowed lookups filter `sender_*` *and* a `created_at` range. The old 2-column index matched every lifetime row for the assistant and filtered the time slice at the heap (~89% of rows discarded); adding `created_at` as a range column lets Postgres scan only the window, and fixes the row-count estimate so the planner picks a hash join over a nested loop on `reporting_events`. - **Why dropping the old index is safe:** the new index is a left-prefix superset `(sender_type, sender_id, ...)`, so every query the old one served is still served. No code references it by name, and dropping it keeps write amplification on `messages` neutral. Built/dropped with `CONCURRENTLY` and `if_not_exists`/`if_exists` guards. ## Preview <img width="2572" height="1754" alt="CleanShot 2026-06-29 at 22 38 51@2x" src="https://github.com/user-attachments/assets/3798d09e-7850-48e4-b2cd-508533f15cea" /> ## Banners #### Inbox connect alert <img width="2178" height="612" alt="CleanShot 2026-06-30 at 14 26 55@2x" src="https://github.com/user-attachments/assets/373c371c-bb7d-4291-a0f9-620673078302" /> #### Coverage alert <img width="2178" height="612" alt="CleanShot 2026-06-30 at 14 25 41@2x" src="https://github.com/user-attachments/assets/e12d6308-11b6-4ba2-88a2-8a3077dd3e8f" /> --------- Co-authored-by: Sivin Varghese <64252451+iamsivin@users.noreply.github.com>
84 lines
2.3 KiB
Ruby
84 lines
2.3 KiB
Ruby
# Generates the LLM welcome summary for the Captain Overview page from the
|
|
# assistant's stats hash (see Captain::AssistantStatsBuilder). Renders the
|
|
# captain_overview_summary.liquid prompt and returns markdown.
|
|
class Captain::OverviewSummaryService < Captain::BaseTaskService
|
|
pattr_initialize [:account!, :assistant!, :first_name!, :stats!, :period!]
|
|
|
|
def perform
|
|
api_response = make_api_call(
|
|
feature: 'editor',
|
|
messages: [
|
|
{ role: 'system', content: system_prompt },
|
|
{ role: 'user', content: 'Write the summary.' }
|
|
]
|
|
)
|
|
|
|
return api_response if api_response[:error]
|
|
|
|
{ message: api_response[:message] }
|
|
end
|
|
|
|
private
|
|
|
|
def system_prompt
|
|
Liquid::Template.parse(prompt_from_file('captain_overview_summary')).render(prompt_variables)
|
|
end
|
|
|
|
def prompt_variables
|
|
stat_variables.merge(period_variables)
|
|
end
|
|
|
|
def stat_variables
|
|
{
|
|
'first_name' => first_name.to_s,
|
|
'assistant_name' => assistant.name.to_s,
|
|
'conversations_handled' => current(:conversations_handled),
|
|
'hours_saved' => current(:hours_saved),
|
|
'auto_resolution_rate' => current(:auto_resolution_rate),
|
|
'auto_resolution_trend' => trend(:auto_resolution_rate),
|
|
'handoff_rate' => current(:handoff_rate),
|
|
'handoff_trend' => trend(:handoff_rate),
|
|
'reopen_rate' => current(:reopen_rate),
|
|
'reopen_trend' => trend(:reopen_rate),
|
|
'knowledge_coverage' => stats.dig(:knowledge, :coverage).to_s,
|
|
'knowledge_approved' => stats.dig(:knowledge, :approved).to_s,
|
|
'knowledge_documents' => stats.dig(:knowledge, :documents).to_s
|
|
}
|
|
end
|
|
|
|
def period_variables
|
|
{
|
|
'today' => formatted_date(Time.zone.today),
|
|
'period_label' => period[:label].to_s,
|
|
'period_start' => formatted_date(period[:starts_on]),
|
|
'period_end' => formatted_date(period[:ends_on])
|
|
}
|
|
end
|
|
|
|
def formatted_date(date)
|
|
date.strftime('%B %-d, %Y')
|
|
end
|
|
|
|
def current(key)
|
|
stats.dig(key, :current).to_s
|
|
end
|
|
|
|
def trend(key)
|
|
stats.dig(key, :trend).to_s
|
|
end
|
|
|
|
def event_name
|
|
'captain_overview_summary'
|
|
end
|
|
|
|
def use_account_openai_hook?
|
|
true
|
|
end
|
|
|
|
# The overview summary is an internal analytics readout, not a customer-facing
|
|
# response, so it should not consume or be blocked by the captain_responses quota.
|
|
def counts_toward_usage?
|
|
false
|
|
end
|
|
end
|