1
0
mirror of synced 2026-08-05 07:16:54 +00:00

4 Commits

Author SHA1 Message Date
Natalie Tay 2486e0e2dd DEV: Extract configs to a yml file and allow local config (#1142) 2025-02-24 16:22:19 +11:00
Sam 0c9466059c DEV: improve artifact editing and eval system (#1130)
- Add non-contiguous search/replace support using ... syntax
- Add judge support for evaluating LLM outputs with ratings
- Improve error handling and reporting in eval runner
- Add full section replacement support without search blocks
- Add fabricators and specs for artifact diffing
- Track failed searches to improve debugging
- Add JS syntax validation for artifact versions in eval system
- Update prompt documentation with clear guidelines

* improve eval output

* move error handling

* llm as a judge

* fix spec

* small note on evals
2025-02-19 15:44:33 +11:00
Rafael dos Santos Silva 86591cf1d2 CHORE: Update Readme (#185) 2023-09-04 15:46:35 -03:00
Roman Rizzi 2b319d9077 Initial commit 2023-02-17 11:33:47 -03:00