NEO Semiconductor's innovation also brings 8 times the memory density
Source:
|
Author:佚名
|
Published time: 2024-08-18
|
322 Views
|
🔊 Click to read aloud
❚❚
▶
|
Share:
On August 18th, semiconductor company NEO Semiconductor announced the launch of 3D X-AI chip technology, designed to replace existing DRAM chips in high bandwidth memory (HBM) to enhance artificial intelligence processing performance and significantly reduce energy consumption. The 3D X-AI chip integrates 8000 neuron circuits, which directly perform AI processing tasks in 3D DRAM, achieving AI performance acceleration of up to 100 times. At the same time, due to the significant reduction in data transmission requirements, the power consumption of the chip has been reduced by 99%, effectively reducing the power consumption and heating problems of the data bus. NEO Semiconductor's innovation also brings 8 times the memory density, and its 3D X-AI chip contains 300 DRAM layers, supporting the operation of larger scale AI models. The company has previously announced the world's first 3D DRAM technology, and the 3D X-AI chip is a further innovation based on this, achieving an AI processing throughput of up to 10 TB/s per chip through a stacked packaging similar to HBM. NEO Semiconductor founder and CEO Andy Hsu pointed out that the separation of data storage and processing in current AI chip architectures has led to performance bottlenecks and high power consumption issues. The 3D X-AI chip significantly reduces the amount of data transmitted between HBM and GPU by performing AI processing in each HBM chip, thereby improving performance and reducing power consumption. Industry analyst Jay Kramer believes that the application of 3D X-AI technology will accelerate the development of emerging AI use cases and drive the creation of new use cases, opening a new era for AI application innovation.
On August 18th, semiconductor company NEO Semiconductor announced the launch of 3D X-AI chip technology, designed to replace existing DRAM chips in high bandwidth memory (HBM) to enhance artificial intelligence processing performance and significantly reduce energy consumption. The 3D X-AI chip integrates 8000 neuron circuits, which directly perform AI processing tasks in 3D DRAM, achieving AI performance acceleration of up to 100 times. At the same time, due to the significant reduction in data transmission requirements, the power consumption of the chip has been reduced by 99%, effectively reducing the power consumption and heating problems of the data bus. NEO Semiconductor's innovation also brings 8 times the memory density, and its 3D X-AI chip contains 300 DRAM layers, supporting the operation of larger scale AI models. The company has previously announced the world's first 3D DRAM technology, and the 3D X-AI chip is a further innovation based on this, achieving an AI processing throughput of up to 10 TB/s per chip through a stacked packaging similar to HBM. NEO Semiconductor founder and CEO Andy Hsu pointed out that the separation of data storage and processing in current AI chip architectures has led to performance bottlenecks and high power consumption issues. The 3D X-AI chip significantly reduces the amount of data transmitted between HBM and GPU by performing AI processing in each HBM chip, thereby improving performance and reducing power consumption. Industry analyst Jay Kramer believes that the application of 3D X-AI technology will accelerate the development of emerging AI use cases and drive the creation of new use cases, opening a new era for AI application innovation.
