VentureBeat

A look under the hood of transfomers, the engine driving AI model evolution

Today, virtually every cutting-edge AI product and model uses a transformer architecture. Large language models (LLMs) such as GPT-4o, LLaMA, Gemini and Claude are all transformer-based, and other AI ...
VentureBeat

Sapient debuts with new AI architectures, aiming to beat Transformers’ reasoning with recurrent neural networks

Sapient Intelligence, Singapore’s first foundation model AI startup, has announced the successful closure of its seed funding round, raising $22 million at a valuation of $200 million. Backed by ...
Geeky Gadgets

Meet Titans : Google’s New Brain Inspired AI Model That Outshines Transformers

Google has introduced “Titans,” a innovative AI architecture designed to address the limitations of the widely-used Transformer model. Since its introduction in 2017, the Transformer model has been a ...
Semiconductor Engineering

Transistor Sizing Approach for OTA Circuits Using a Transformer Architecture

A new technical paper titled “Accelerating OTA Circuit Design: Transistor Sizing Based on a Transformer Model and Precomputed Lookup Tables” was published by University Minnesota and Cadence. “Device ...
SiliconANGLE

AI21 Labs’ updated hybrid SSM-Transformer model Jamba gets longest context window yet

OpenAI rival AI21 Labs Ltd. today lifted the lid off of its latest competitor to ChatGPT, unveiling the open-source large language models Jamba 1.5 Mini and Jamba 1.5 Large. The new models are based ...