The Hidden Cost of Context Windows

Description

Long context is not free and not always better. Measured cost and quality across context lengths on a real workload, plus the retrieval strategy that beat simply pasting everything in.