Tested on SemiAnalysis’ InferenceX benchmark, Jalapeño registered both more tokens per user and more throughput per kilowatt than the currently available state-of-the art.
TE
Source
This article was originally published by TechCrunch and written by Russell Brandom.
Read original article on TechCrunch