TORQ framework enhances LLM accuracy with MXFP4 quantization

Researchers have developed TORQ, a new framework for quantizing Large Language Models (LLMs) using the MXFP4 format. This method addresses accuracy degradation issues by analyzing and correcting imbalances in activation quantization. TORQ employs a two-level orthogonal rotation strategy to optimize the activation space, significantly improving LLM accuracy with 4-bit floating-point quantization. AI

Summary written by gemini-2.5-flash-lite from 1 source. How we write summaries →

IMPACT Improves LLM efficiency and accuracy by enabling better low-bit quantization, potentially reducing inference costs.

RANK_REASON The cluster contains a research paper detailing a new method for LLM quantization. [lever_c_demoted from research: ic=1 ai=1.0]

Read on Hugging Face Daily Papers →

• LLMs
• MXFP4
• Qwen3

• paper
• infra