Skip to content
AWS Machine Learning Blog· Shubham Gupta·· 1 d ago

How ArisGlobal scaled generative AI inference on Amazon Bedrock

How ArisGlobal scaled generative AI inference on Amazon Bedrock

AI summary

ArisGlobal runs NavaX, its life-sciences AI engine, on Amazon Bedrock. By caching the shared prompt prefix instead of each per-case document, ArisGlobal cut effective input cost by about 50% and overall monthly inference spend by about 40%, while onboarding more tenants without proportional cost growth.

Selection record

Not admittedSum of both 72 < twice the threshold 120

Source tier
Official, first-hand; this tier's threshold is 60
Pre-filter
passed:生成式AI推理优化与Bedrock缓存实践

A model scores each item twice, independently, against one written standard, out of 100. An item is admitted only when the two scores add up to twice the threshold. The threshold is set per source tier.

Source: AWS Machine Learning Blog · aws.amazon.com