Discourse/discourse-ai
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
a028309cbdb0565bb1c485f5cefd2af41ac7ecb2
discourse-ai/tokenizers
T
History
Rafael dos Santos Silva 3c9513e754 Refinements to embeddings and tokenizers (#61) 
* Refinements to embeddings and tokenizers

* lint

* Truncate with tokenizers for summary

* fix
2023-05-15 15:10:42 -03:00
..
Apache License
Refinements to embeddings and tokenizers (#61)
2023-05-15 15:10:42 -03:00
bert-base-uncased.json
FEATURE: Add a basic tokenizer API (#37)
2023-04-19 11:55:59 -03:00
claude-v1-tokenization.json
Refinements to embeddings and tokenizers (#61)
2023-05-15 15:10:42 -03:00
MIT License
Refinements to embeddings and tokenizers (#61)
2023-05-15 15:10:42 -03:00
README.md
Refinements to embeddings and tokenizers (#61)
2023-05-15 15:10:42 -03:00

README.md

bert-base-uncased.json

Licensed under Apache License

claude-v1-tokenization.json

Licensed under MIT License

Reference in New Issue View Git Blame Copy Permalink