日前，由Xiaoyu Ma和David Patterson联合署名的文章《Challenges and Research Directions for Large Language Model Inference Hardware》正式发布。这篇文章被发布以后，引起了广泛关注。文章中，作者围绕LLM推理芯片的挑战以及解决方案，给出了建议。

Microsoft Corp. researchers today open-sourced Pi-3 Mini, a language model with 3.8 billion parameters that can outperform neural networks more than 10 times its size. The company says that Pi-3 Mini ...

Language isn’t always necessary. While it certainly helps in getting across certain ideas, some neuroscientists have argued that many forms of human thought and reasoning don’t require the medium of ...

Large language models (LLMs) like BERT and GPT are driving major advances in artificial intelligence, but their size and complexity typically require powerful servers and cloud infrastructure. Running ...

“We must strive for better,” said IBM Research chief scientist Ruchir Puri at a conference on AI acceleration organised by the computer company and the IEEE in November. He expects almost all language ...

As tech companies race to deliver on-device AI, we are seeing a growing body of research and techniques for creating small language models (SLMs) that can run on resource-constrained devices. The ...

Large language model AIs might seem smart on a surface level but they struggle to actually understand the real world and model it accurately, a new study finds. When you purchase through links on our ...

As great as generative AI looks, researchers at Harvard, MIT, the University of Chicago, and Cornell concluded that LLMs are not as reliable as we believe. Even a big company like Nintendo did not ...

Microsoft Corp. today released the code for Phi-4, a small language model that can generate text and solve math problems. The company first detailed the model last month. Initially, Phi-4 was only ...

What if you could demystify one of the most fantastic technologies of our time—large language models (LLMs)—and build your own from scratch? It might sound like an impossible feat, reserved for elite ...