OpenAI Posts First Benchmark Results for Jalapeño Custom Inference Chip
OpenAI's first custom inference chip beat commercial systems on throughput per kilowatt and token latency in public benchmarks, and future generations are already underway.
Topic