In the wave of artificial intelligence, Etched's Sohu AI chip has attracted widespread attention in the industry with its characteristics designed for the Transformer architecture. This chip not only represents a major innovation in the field of AI hardware, but also indicates a new trend in the future development of AI technology.
Etched's sudden rise
Founded by Harvard dropouts Gavin Uberti and Chris Zhu, Etched has been around for less than two years, but its development of the Sohu chip has already caused an uproar in the AI chip market. The $120 million Series A funding round not only provides impetus for the company's R&D and marketing, but also reflects investor confidence in this innovative technology.
Technological innovation of Sohu chips
The biggest technical highlight of the Sohu chip is that it etches the Transformer architecture directly into the chip, which makes Sohu much more powerful than traditional GPUs and other general-purpose AI chips when handling AI inference tasks. Manufactured using TSMC's 4nm process, Sohu achieves a significant increase in performance while consuming less energy.
Figure: The biggest highlight of the Sohu chip is the etching of the Transformer architecture directly into the chip
A leap in performance and data support
In the throughput test of the Llama 70B, the Sohu chip demonstrated an impressive performance of processing more than 500,000 tokens per second, which is unmatched by other similar products on the market today. For example, Sohu is 20 times faster than NVIDIA's H100, which is not only impressive, but also demonstrates Sohu's huge potential for AI inference tasks.
Broad application prospects and examples
The Sohu chip has a wide range of applications, including but not limited to real-time voice brokerage, millisecond-level processing of thousands of words of text, more powerful code tree search, and parallel comparison of hundreds of responses. The realization of these functions provides the possibility for the operation of trillion-level parameter models in the future, and greatly promotes the application of AI technology in all walks of life.
Overall, Etched's Sohu chip, with its innovative design and excellent performance, has become an emerging force in the field of AI chips. Its emergence has not only injected new vitality into the development of AI technology, but also set a new benchmark for the entire industry. With the continuous progress of AI technology and the continuous expansion of application fields, Sohu chips are expected to occupy an important position in the future AI chip market and promote the development of the entire industry in a more efficient and professional direction.
The success of the Sohu chip is not only a victory for Etched, but also a leap forward for the entire AI industry. We expect that this AI chip specially designed for the Transformer architecture can show more potential in practical applications, promote the development of AI technology to a higher level, and bring more changes to human society."
