Batch Intelligence at Scale: Cost-Efficient Multi-Agent LLM Workflows with Built-In Resilience
AI-generated summary Walmart Global Tech deployed multi-agent LLM workflows across 4,700 stores for nightly batch inventory forecasting. Aditya Mulik explains that shifting from PTUs to pay-as-you-go reduced cloud inference costs from over 100k dollars to 10k dollars per month.