Why Baseten treats inference as an operating business
AI-generated summary Baseten co-founder and CEO Tuhin Srivastava discussed the work of running trained models during a 44-minute interview with Mario Gabriele on The Generalist. Srivastava says a fine-tuned Stable Diffusion customer traffic event exposed the difficulty of serving larger models on GPUs.