Skip to content

All AI news

0 today

Oct 21

Wednesday
  1. [AINews] DeepSeek DeepInfer: Open Source SOTA Inference running 155T toks/day/cluster making $22m/day at ~80% margin for a 81 day payback

    DeepSeek has open sourced DeepInfer, the production inference framework behind V4.1 Flash. Customised from vLLM under the Apache 2.0 licence, it supports distributed inference, speculative decoding, SWA Bounded Replay and structured output, and covers both NVIDIA and Huawei Ascend platforms.

  2. ChatGPT now lets you lock your chats

    The company says the feature is designed for situations where users might be discussing something personal or planning a surprise and want to keep those conversations private when handing their device to friends or family to show them something in another chat.

  3. Discover tools at runtime with AWS Agent Registry

    Hardcoded tool wiring breaks down as an agent's catalog grows from a handful of tools to hundreds. This post walks through a runtime Discover, Instantiate, Execute loop built on AWS Agent Registry, where an orchestrator discovers MCP servers and A2A agents through semantic search at runtime instead of compiling every tool at build time.

  4. Access OpenAI GPT models on Amazon Bedrock from Canada with cross-Region inference

    Canadian organizations can now access OpenAI GPT-5.6, GPT-6, and GPT-6.1 models on Amazon Bedrock from the Canada (Central) and Canada West (Calgary) Regions using cross-Region inference. This post covers the models and inference profiles, how to set up permissions, and how to invoke them with the Responses, Chat Completions, and Converse APIs.

Oct 20

Tuesday

Oct 19

Monday
  1. web-edit 0.1a2

    Release: web-edit 0.1a2 web-edit ( previously ) is my tiny web app for browsing and editing files in a folder. I mainly built it for editing files on different machines via Tailscale. I added a "copy to clipboard" option for both text and image data.

  2. llm-echo 0.5

    Release: llm-echo 0.5 I'm working towards a new LLM release, and testing PRs caused me to revisit the llm-echo debug plugin. This plugin provides a "model" which doesn't involve an LLM at all - it just repeats back the prompts that have been fed to it.

Oct 18

Sunday

Oct 17

Saturday
  1. LaTeX renderer

    Tool: LaTeX renderer Inspired by Paul Ford and Aboard Foundary's new web app Tiny Little Office , which provides a suite of web app content editors (a Word Processor, Outliner, Presentation Builder, Spreadsheet, Calculator, Drawing Tool, Diagram Maker, Animator, Calendar, and Trip Planner).

Oct 16

Friday