
RAG & data
What a RAG question costs: how many chunks to send
One RAG question is roughly question + instructions + N chunks in, a short answer out. Here is how to count it and what 1,000 questions cost.
Working with documents, search and context.

One RAG question is roughly question + instructions + N chunks in, a short answer out. Here is how to count it and what 1,000 questions cost.