The Decoder· Matthias Bastian·· 6 h ago
Deepseek open-sources the inference engine that powers its fastest and cheapest AI model
Deepseek open-sources the inference engine that powers its fastest and cheapest AI model
AI summary
Deepseek is open-sourcing DeepInfer, the inference framework behind its fast V4.1-Flash model. The vLLM-based system cuts compute costs and energy use when running AI models. The release adds more pricing pressure on Western providers like OpenAI and Anthropic.
Selection record
Threshold 76Media and individualsFirst 72Second 62
Not admittedSum of both 134 < twice the threshold 152
- Source tier
- Media and individuals; this tier's threshold is 76
- Pre-filter
- passed：开源AI推理引擎及模型服务
A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.
Source: The Decoder · the-decoder.com