Commit Graph
4 Commits
Author SHA1 Message Date
Roman RizziandPenar Musaraj c7acb4a6a0 REFACTOR: Support of different summarization targets/prompts. (#835)
* DEV: Add summary types

* Refactor for different summary types

* Use enum for summary types

* Update lib/summarization/strategies/topic_summary.rb

Co-authored-by: Penar Musaraj <[email protected]>

* Update lib/summarization/strategies/topic_gist.rb

Co-authored-by: Penar Musaraj <[email protected]>

* Update lib/summarization/strategies/chat_messages.rb

Co-authored-by: Penar Musaraj <[email protected]>

* Fix chat_messages single prompt

* Small tweak to the chat summarization prompt

---------

Co-authored-by: Penar Musaraj <[email protected]>
2024-10-15 13:53:26 -03:00
Sam 14443bf890 FIX: more robust summary implementation (#750)
When navigating between topic we were not correctly resetting
internal state for summarization. This leads to a situation where
incorrect summaries can be displayed to users and wrong summaries
can be displayed.

Additionally our controller for grabbing summaries was always
streaming results via message bus, which could be delayed when
sidekiq is overloaded. We now will return the cached summary
right away if it is available direct from REST endpoint.
2024-08-13 08:47:47 -03:00
SamandRoman Rizzi 1320eed9b2 FEATURE: move summary to use llm_model (#699)
This allows summary to use the new LLM models and migrates of API key based model selection

Claude 3.5 etc... all work now. 

---------

Co-authored-by: Roman Rizzi <[email protected]>
2024-07-04 10:48:18 +10:00
Keegan George 1b0ba9197c DEV: Add summarization logic from core (#658) 2024-07-02 08:51:59 -07:00