过去八年，Transformer 几乎重塑了整个人工智能研究版图。自 2017 年 Google 在「Attention Is All You Need」中提出这一架构以来，「注意力机制」逐渐从一种工程技巧演变为深度学习的通用范式——从自然语言处理到计算机视觉，从语音、多模态到科学计算，Transformer 正在成为事实上的基础模型骨架。以 ...

2017年，Google发表了那篇改变AI格局的论文“Attention is All You ...

2025年，视频生成领域迎来爆发式发展。OpenAI的Sora、Google DeepMind的Veo 3以及Runway的Gen-4等模型相继问世，其生成的视频质量已达到以假乱真的程度，甚至被应用于Netflix剧集《永恒族》的视觉特效制作。这些技术突破不仅让专业创作者受益，更通过ChatGPT和Gemini等应用向普通用户开放，推动AI视频生成进入大众化时代。

Eight names are listed as authors on “Attention Is All You Need,” a scientific paper written in the spring of 2017. They were all Google researchers, though by then one had left the company. When the ...

In 2017, eight machine-learning researchers at Google released a groundbreaking research paper called Attention Is All You Need, which introduced the Transformer AI architecture that underpins almost ...

The transformer, today's dominant AI architecture, has interesting parallels to the alien language in the 2016 science fiction film "Arrival." If modern artificial intelligence has a founding document ...

Aidan Gomez was an intern at Google Brain in 2017, when he helped co-author the "Attention Is All You Need" paper that conceptualized the transformer and eventually kicked off the generative ...

Before Illia Polosukhin left Google in 2017, he had a brainstorming lunch and then returned to his desk to build what may have been the very first transformer, the neural network architecture that ...

Posts from this topic will be added to your daily email digest and your homepage feed. is editor-at-large and Vergecast co-host with over a decade of experience covering consumer tech. Previously, at ...