Discourse/discourse-ai
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,158 Commits 45 Branches 0 Tags
issue/ai-tools-enum-button
Commit Graph
4 Commits
Author SHA1 Message Date
Roman Rizzi e2e753d73c FEATURE: Formalize support for matryoshka dimensions. (#1083) 
We have a flag to signal we are shortening the embeddings of a model.
Only used in Open AI's text-embedding-3-*, but we plan to use it for other services.
 2025-01-22 11:26:46 -03:00
Roman Rizzi a5e5ae72a8 FIX: Open AI embedding shortening is only available for some models (#1080) 2025-01-21 17:50:40 -03:00
Roman Rizzi f5cf1019fb FEATURE: configurable embeddings (#1049) 
* Use AR model for embeddings features

* endpoints

* Embeddings CRUD UI

* Add presets. Hide a couple more settings

* system specs

* Seed embedding definition from old settings

* Generate search bit index on the fly. cleanup orphaned data

* support for seeded models

* Fix run test for new embedding

* fix selected model not set correctly
 2025-01-21 12:23:19 -03:00
Roman Rizzi 534b0df391 REFACTOR: Separation of concerns for embedding generation. (#1027) 
In a previous refactor, we moved the responsibility of querying and storing embeddings into the `Schema` class. Now, it's time for embedding generation.

The motivation behind these changes is to isolate vector characteristics in simple objects to later replace them with a DB-backed version, similar to what we did with LLM configs.
 2024-12-16 09:55:39 -03:00