Skip to content

Deployment

The engineering of running models: inference optimisation, memory and cost, serving architecture and infrastructure choices.

Latest selected

21–40 of 79

Oct 16

Friday

Oct 15

Thursday

Oct 14

Wednesday

Oct 13

Tuesday

Oct 12

Monday

Oct 8

Thursday

Oct 6

Tuesday
  1. Introducing GLM 5.3 on Amazon Bedrock

    GLM 5.3 from Z.ai is now available on Amazon Bedrock: a 753B-parameter mixture-of-experts model built for coding and long-horizon agentic tasks. Learn how to invoke it with the OpenAI-compatible APIs, cut cost and latency with prompt caching, and run an authorized security test with the open-source Strix agent.

Oct 2

Friday
  1. Toward provably private learning from federated data

    In “Toward provably private learning from federated data”, we announce the next generation of our FL system, which leverages Trusted Execution Environments (TEEs) to provide verifiable and auditable guarantees for data anonymization. Gboard has adopted the system to launch next-word prediction models in English and Japanese, with stronger privacy guarantees and improved accuracy.

Oct 1

Thursday

Sep 30

Wednesday
  1. Build a multi-agent music production pipeline on Amazon Bedrock AgentCore Runtime Instances

    Amazon Bedrock AgentCore Runtime Instances gives multi-agent workflows AWS managed EC2 infrastructure with GPUs, persistent volumes, and multi-day sessions. In this post, we deploy a three-agent music production pipeline where the agents colocate on one GPU instance, share a filesystem, and hand work to each other to produce a finished track.