The lifecycle of a code AI completion

The lifecycle of a code AI completion

Philipp Spiess provides a deep dive into how Sourcegraph's Cody code completion assistant works. Lots of fascinating details in here:

"One interesting learning was that if a user is willing to wait longer for a multi-line request, it usually is worth it to increase latency slightly in favor of quality. For our production setup this means we use a more complex language model for multi-line completions than we do for single-line completions."

This …

ai anthropic assistant claude code code completion deep dive generativeai latency lifecycle line llms request sourcegraph