Autocomplete improvements for DeepSeek-V2

Kelvin YapKelvin YapOctober 7, 2024Cody,Enterprise,v5.8.0

DeepSeek-V2 was recently introduced as the default autocomplete model for Cody Enterprise customers, and in this release we have implemented optimizations to prompt caching and direct routing that have resulted in improved latency and quality for both single-line and multi-line completions.

These improvements to autocomplete are available to all Cody Enterprise customers who are using DeepSeek-V2 via Cody Gateway.