AssemblyAI Uses AWS Spot Instances for Cost-Effective Speech-to-Text Inference
AI-generated summary AssemblyAI uses a mixed fleet of Amazon EC2 Spot Instances and On-Demand Instances across multiple NVIDIA GPU instance families for speech-to-text inference. According to production deployment results, AssemblyAI achieved 70 percent cost savings on inference compute by using Amazon EC2 Spot Instances with GPUs.