Tagged “tuning”
-
Decoding settings for grounded answers
Temperature and its neighbours do something different in RAG than in creative writing. Sensible values, and what they can't fix.
-
How many chunks to include
More retrieved context is not reliably better. Why adding chunks stops helping, and how to find where that happens for your system.