The race is on and the revolution will probably be televised. Chatter about Groq began on the positioning previously often called Twitter when Matt Schumer, CEO of HypeWriteAI and OthersideAI, waxed poetic about Groq’s AI PU inference engine, reporting Mixtral serves almost 500 current/s (in different phrases, delivering immediate responses), and shortly after submitting a stunning display. Groq CEO Jonathan Ross even visited CNN to point out off the engine, impressing the reporter.
And all of this serves to supply a steady various to Nvidia’s GPU dominance. With a 265% year-over-year improve in income, Nvidia is betting it can keep that dominance. Groq says that within the worst case its expertise makes use of a few third of a GPU’s energy, however most workloads use simply one-tenth of the facility. And in a world the place it looks like these LLM workloads won’t ever cease growing and power demand will proceed to rise (though apparently, the earth is teetering getting ready to local weather disaster), properly, Groq is the final word challenger to the GPU-dominated, an extremely slender, resource-poor computing panorama.
In truth, Ross claims that by subsequent yr, greater than half of the world’s computing energy will run on their chips. What’s going to this world seem like? Ross may have solutions and extra at VentureBeat’s Rework 2024. He’ll delve into why AI insights are essential to enterprise expertise, why effectivity is a urgent want at the moment—and why Groq is on the forefront of this revolution. He provides a kind of jaw-dropping dwell demos to focus on Groq’s capabilities and speak about what’s subsequent on the roadmap.
Register now to get an unique have a look at Groq’s newest developments, in addition to the prospect to get right into a room with the world’s prime AI innovators and listen to all the recent gossip first-hand. VB Rework 2024 will happen July 9/11 in San Francisco. The subject has by no means been extra related: large-scale AI work with a give attention to real-world questions and issues, in addition to hands-on AI technology case research and crucial software tales straight from business leaders.
The countdown is on: register now!
