Rafael dos Santos Silva eb93b21769 FEATURE: Add BGE-M3 embeddings support (#569)
BAAI/bge-m3 is an interesting model, that is multilingual and with a
context size of 8192. Even with a 16x larger context, it's only 4x slower
to compute it's embeddings on the worst case scenario.

Also includes a minor refactor of the rake task, including setting model
and concurrency levels when running the backfill task.
2024-04-10 17:24:01 -03:00
2023-02-17 11:33:47 -03:00
2023-02-17 11:33:47 -03:00
2023-11-03 11:30:09 +00:00
2023-11-03 11:30:09 +00:00
2024-03-06 15:23:29 +01:00
2023-02-17 11:33:47 -03:00
2024-01-13 00:28:06 +01:00
2023-09-04 15:46:35 -03:00
2024-01-13 00:28:06 +01:00
S
Description
No description provided
Readme
36 MiB