Cloud Computing

New instance families promise lower cost per token for batch and real-time inference.