VentureBeat

Context compression finally works in production: new research cuts LLM input 16x without the accuracy hit

Context windows are becoming a computational bottleneck. The longer an agent runs, the more tokens accumulate from retrieved documents, reasoning traces and conversation history, and the more memory ...
EDN

MLPerf and the rise of latency-aware LLM benchmarking

Any discussion of modern AI system performance must include MLCommons and its MLPerf benchmark suite, which has become the industry’s de facto standard for measuring machine learning performance.
XDA Developers on MSN

I tested Google's new Gemma 4 12B on my 8GB GPU, and now I don't want to go back to smaller models

Not bad for limited hardware ...
IEEE

Visual Evidence-aware for Object Hallucinations Rectification in LLM-based Video Captioning

Abstract: Recent neural models for video captioning are typically built using a framework that combines a pre-trained visual encoder with a large language model(LLM) decoder. However, large language ...
note

Local LLM Performance Verification for 16GB VRAM or Less Part 7: Was the "Coder-Specialized Model" Just for Show? How 4 Popular Models Were Completely Defeated by the Benchmark ...

This time, I have gathered four open models that claim to be "coding-specialized." While the lineup is varied, including Qwen-based and Gemma fine-tuned models, they all share one goal: to verify if ...
note

Multimodal LLMs That Ditched the Encoder — Reading the "Direct Projection" Architecture of Gemma 4 12B

On June 3, 2026, Google DeepMind released Gemma 4 12B (where 12B = 12G = 12 billion parameters). It is a model capable of handling images, audio, and video, making it an AI that can process multiple ...
IEEE

Spatio-Temporal and Retrieval-Augmented Modeling for Chest X-Ray Report Generation

Abstract: Chest X-ray report generation has attracted increasing research attention. However, most existing methods neglect the temporal information and typically generate reports conditioned on a ...
Tech Times

NVIDIA Diffusion LLM Hits 2.42x Throughput Without Retraining: Nemotron TwoTower Released

NVIDIA diffusion language model Nemotron TwoTower achieves 2.42x LLM inference throughput without a full retraining run, ...
InfoQ

Gemma 4 12B Enables On-Device, Multimodal Agentic Workflows with an Encoder-free Architecture

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...