Shivam MishraandGitHub
3d20a7b049
## Manually triggering help center generation
Open a Rails console (`bundle exec rails console`):
```ruby
account = Account.find(<ACCOUNT_ID>)
user = account.users.first
# Optional: refresh brand info from the customer's website
domain = 'example.com'
result = WebsiteBrandingService.new("noreply@#{domain}").perform
account.update!(
name: result[:title].presence || account.name,
custom_attributes: account.custom_attributes.merge('website' => domain, 'brand_info' => result)
)
# Optional: wipe existing portals so a fresh one is created
account.portals.destroy_all
Onboarding::HelpCenterCreationService.new(account, user).perform
```
Sidekiq must be running — articles are written by
`Onboarding::HelpCenterArticleGenerationJob`. Avoid running on
production; generation calls the LLM provider.
### Generation flow (Happy Path)
```mermaid
sequenceDiagram
autonumber
participant Kickoff as HelpCenterCreationService
participant DB as DB
participant GenJob as HelpCenterArticleGenerationJob
participant Curator as HelpCenterCurator
participant Firecrawl as Firecrawl
participant CuratorLLM as Curation LLM
participant Redis as Redis Progress
participant WriterJob as HelpCenterArticleWriterJob
participant Builder as HelpCenterArticleBuilder
participant WriterLLM as Writer LLM
participant Cable as ActionCable
Kickoff->>DB: Create portal for account<br/>homepage_link=https://chatwoot.com
Kickoff->>DB: Attach brand logo if available
Kickoff->>GenJob: Enqueue generation job<br/>account_id, portal_id, user_id, generation_id
GenJob->>Curator: Curate help center plan
Curator->>Firecrawl: map https://chatwoot.com<br/>search: docs help support faq
Firecrawl-->>Curator: Return discovered links
Curator->>CuratorLLM: Select categories + article plans<br/>from discovered links only
CuratorLLM-->>Curator: Return categories, articles, allowed_urls
GenJob->>DB: Create portal categories
GenJob->>GenJob: Stamp articles with category_id
GenJob->>GenJob: Filter article URLs against allowed_urls
GenJob->>GenJob: Drop articles with no category<br/>or no approved source URLs
GenJob->>Redis: Start progress<br/>status=generating, total=N, finished=0
loop For each approved article
GenJob->>WriterJob: Enqueue writer job<br/>title, category_id, approved URLs
end
par Writer jobs run independently
WriterJob->>Builder: Build article from approved URLs
Builder->>Firecrawl: batch_scrape approved URLs
Firecrawl-->>Builder: Return Markdown source pages
Builder->>WriterLLM: Rewrite sources into one article
WriterLLM-->>Builder: Return title, description, Markdown content
Builder->>DB: Create draft portal article<br/>meta.source_urls
WriterJob->>Redis: Increment finished count
WriterJob->>Cable: Broadcast help_center.article_generated
end
WriterJob->>Redis: If finished >= total<br/>mark status=completed
WriterJob->>Cable: Broadcast help_center.generation_completed
```
### Redis State Management
```mermaid
stateDiagram-v2
[*] --> active_pointer_set
active_pointer_set --> generating: generation job creates valid plan
active_pointer_set --> skipped: curation skipped/failed
generating --> generating: each writer job increments finished
generating --> completed: finished == total
generating --> ignored_completion: generation_id superseded
skipped --> [*]
completed --> [*]
ignored_completion --> [*]
```
31 lines
2.1 KiB
Ruby
31 lines
2.1 KiB
Ruby
class Captain::Llm::HelpCenterCurationSchema < RubyLLM::Schema
|
|
CATEGORIES_DESCRIPTION = 'High-level categories that group the chosen articles. Use only as many ' \
|
|
'as the content naturally breaks into. Names must be short (1-3 words) and reusable.'.freeze
|
|
ARTICLES_DESCRIPTION = 'A curated starting set of help-center articles selected from the input URL list. ' \
|
|
'Quality over quantity: only include pages with clear, high-value, substantive help ' \
|
|
'content. Skip blog posts, marketing/landing pages, login, pricing, legal, careers, ' \
|
|
'customer testimonials, press, about/company, whitepapers, support contact pages, ' \
|
|
'terms of service, privacy policy.'.freeze
|
|
TITLE_DESCRIPTION = 'Concise article title (max 80 chars), rewritten if the source title is too long or marketing-y.'.freeze
|
|
CATEGORY_DESCRIPTION = 'One sentence describing what kind of articles belong in this category.'.freeze
|
|
URLS_DESCRIPTION = '1 to 3 source URLs from the input list. Prefer grouping when pages cover related ' \
|
|
'aspects of the same topic — overview + deep-dive, FAQ + how-to, policy + FAQ, ' \
|
|
'parent topic + its troubleshooting page. Merged sources give the writer more ' \
|
|
'context and produce stronger articles than several thin stubs.'.freeze
|
|
|
|
array :categories, description: CATEGORIES_DESCRIPTION, min_items: 1, max_items: 10 do
|
|
object do
|
|
string :name, description: 'Short, human-readable category name (1-3 words).', max_length: 60
|
|
string :description, description: CATEGORY_DESCRIPTION, max_length: 200
|
|
end
|
|
end
|
|
|
|
array :articles, description: ARTICLES_DESCRIPTION, min_items: 1, max_items: 25 do
|
|
object do
|
|
array :urls, description: URLS_DESCRIPTION, min_items: 1, max_items: 3, of: :string
|
|
string :title, description: TITLE_DESCRIPTION, max_length: 80
|
|
string :category_name, description: 'Must exactly match one of the names emitted in the categories field.', max_length: 60
|
|
end
|
|
end
|
|
end
|