Sam 825f01cfb2 FEATURE: even smoother streaming (#420)
Account properly for function calls, don't stream through <details> blocks
- Rush cooked content back to client
- Wait longer (up to 60 seconds) before giving up on streaming
- Clean up message bus channels so we don't have leftover data
- Make ai streamer much more reusable and much easier to read
- If buffer grows quickly, rush update so you are not artificially waiting
- Refine prompt interface
- Fix lost system message when prompt gets long
2024-01-15 18:51:14 +11:00
2023-02-17 11:33:47 -03:00
2023-12-26 14:49:55 -03:00
2023-02-17 11:33:47 -03:00
2023-11-03 11:30:09 +00:00
2023-11-03 11:30:09 +00:00
2024-01-13 00:28:06 +01:00
2023-02-17 11:33:47 -03:00
2024-01-13 00:28:06 +01:00
2023-09-04 15:46:35 -03:00
2023-07-15 00:56:15 +02:00
2024-01-13 00:28:06 +01:00
S
Description
No description provided
Readme
36 MiB