VentureBeat

New transformer architecture can make language models faster and resource-efficient

Large language models like ChatGPT and Llama-2 are notorious for their extensive memory and computational demands, making them costly to run. Trimming even a small fraction of their size can lead to ...
VentureBeat

Microsoft trains world's largest Transformer language model

Microsoft AI & Research today shared what it calls the largest Transformer-based language generation model ever and open-sourced a deep learning library named DeepSpeed to make distributed training of ...
SiliconANGLE

IBM releases Granite 4 series of Mamba-Transformer language models

IBM Corp. on Thursday open-sourced Granite 4, a language model series that combines elements of two different neural network architectures. The algorithm family includes four models on launch. They ...
Geeky Gadgets

Diffusion LLMs Arrive : Is This the End of Transformer Large Language Models (LLMs)?

The development of large language models (LLMs) is entering a pivotal phase with the emergence of diffusion-based architectures. These models, spearheaded by Inception Labs through its new Mercury ...
The Next Web

Understanding Transformers, the machine learning model behind GPT-3

You know that expression When you have a hammer, everything looks like a nail? Well, in machine learning, it seems like we really have discovered a magical hammer for which everything is, in fact, a ...