AWS Machine Learning Blog· Shubham Gupta·· 1 d ago
How ArisGlobal scaled generative AI inference on Amazon Bedrock
How ArisGlobal scaled generative AI inference on Amazon Bedrock
AI summary
ArisGlobal runs NavaX, its life-sciences AI engine, on Amazon Bedrock. By caching the shared prompt prefix instead of each per-case document, ArisGlobal cut effective input cost by about 50% and overall monthly inference spend by about 40%, while onboarding more tenants without proportional cost growth.
Selection record
Threshold 60Official, first-handFirst 38Second 34
Not admittedSum of both 72 < twice the threshold 120
- Source tier
- Official, first-hand; this tier's threshold is 60
- Pre-filter
- passed:生成式AI推理优化与Bedrock缓存实践
A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.
Source: AWS Machine Learning Blog · aws.amazon.com