llama.cpp
PulseAugur coverage of llama.cpp — every cluster mentioning llama.cpp across labs, papers, and developer communities, ranked by signal.
- 2026-05-12 product_launch llama.cpp project integrates llama-eval tool for model benchmarking. source
7 day(s) with sentiment data
-
Google silently adds 4GB LLM to Chrome, sparking privacy and performance concerns
Google has reportedly integrated a 4GB Gemini Nano LLM into the Chrome browser without explicit user consent or disclosure, leading to performance issues and increased disk usage for billions of users. This move mirrors…
-
SPEC CPU 2026 benchmark suite launches with enhanced portability, excluding AI workloads
The Standard Performance Evaluation Corporation (SPEC) has released its updated SPEC CPU 2026 benchmarking suite, which includes 52 tests and a significantly larger codebase than its predecessor. This new suite is desig…
-
Local AI advances with Qwen 3.6, llama.cpp, and quantized models
The author shared their recent experiences with local AI, focusing on the Qwen 3.6 model and the llama.cpp framework. They discussed the practicalities of using quantized models and implementing tool calls. Additionally…
-
Developers build local AI coding agents to escape rising cloud costs and limits
As cloud-based AI services increase prices and impose stricter usage limits, developers are exploring local AI coding agents as a cost-effective alternative. This approach allows for free, unlimited use of models like A…
-
AI assistant helps debug Python, discusses Llama.cpp, and teaches smart plugs lullabies
A user shared their daily activities assisting others with AI-related tasks, including debugging Python code and answering questions about the llama.cpp project. They also engaged in creative AI applications like genera…
-
Liquid AI releases LFM2-24B-A2B, an efficient 24B parameter MoE model
Liquid AI has released an early checkpoint of its LFM2-24B-A2B model, a sparse Mixture of Experts (MoE) architecture with 24 billion total parameters and 2 billion active parameters per token. This model demonstrates th…
-
Qwen-3.5 35B model runs on llama.cpp via pi
Hugging Face shared a demonstration of the Qwen-3.5 35B model running efficiently on llama.cpp, a popular inference engine. The model was harnessed using the 'pi' tool, showcasing its capabilities in a practical applica…
-
Nvidia's Nemotron 3 Nano Omni and Llama.cpp enable local LLM execution
Thomas Bley has released new presentation slides detailing how to run large language models locally. The slides cover Nvidia's Nemotron 3 Nano Omni, built-in tools for Llama.cpp, and the use of Transformers.js with WebG…
-
AI reshapes software development, shifting focus from code to imagination
Over 3,000 software developers convened at AI Dev 26 x SF, a conference organized by DeepLearning.AI, to discuss the evolving role of AI in software development. Speakers highlighted that AI is shifting the bottleneck f…
-
Bash-based AI coding assistant uses local Gemma model, outperforms Copilot
A developer has created a command-line coding assistant using a combination of standard Linux tools like bash, sed, and grep, along with curl. This project, named "canitbedone," utilizes a local instance of Google's Gem…
-
Consumer-grade graphics cards can quickly get started! MiniCPM-o 4.5 from Mianbi Intelligent releases technical report
MiniCPM-o 4.5 is a new 9B parameter omni-modal large language model designed for real-time, full-duplex interaction. It can simultaneously process and generate audio, video, and text, enabling proactive behaviors and co…
-
Hugging Face announces OCR, security, and model updates
Hugging Face has announced several updates and collaborations across its platform. These include enhancements to OCR pipelines with open models, the integration of Sentence Transformers, and the release of Transformers.…
-
OpenClaw AI agent runs locally, offering privacy but demanding robust hardware
OpenClaw, an open-source AI agent framework, has gained significant traction since its launch in November 2025, quickly amassing over 100,000 GitHub stars. This proactive assistant runs entirely on local hardware, conne…
-
llama.cpp and ik_llama.cpp add FP4 inference support for VRAM savings
The llama.cpp and ik_llama.cpp projects have both integrated support for FP4 (4-bit floating-point) inference, a significant advancement for model quantization. llama.cpp now includes NVFP4, an Nvidia-specific format, w…
-
llama.cpp CUDA pull request optimizes MMQ stream-k overhead for MoE models
A pull request to the llama.cpp project aims to reduce overhead in CUDA's MMQ stream-k operations. This optimization targets Mixture of Experts (MoE) models, potentially leading to faster prompt processing speeds. The c…
-
User details Qwen 3.6 35B-A3B model setup for coding on M2 Macbook Pro
A user has successfully configured the Qwen 3.6 35B-A3B model to run locally on a 32GB RAM M2 Macbook Pro for coding tasks. The setup involves building the llama.cpp software from source and downloading specific model a…
-
Google releases open-weight Gemma 4 multimodal models with long context
Google DeepMind has released Gemma 4, a new family of open-weight models licensed under Apache 2.0, marking a significant advancement in their open-source AI offerings. The models are designed for reasoning and agentic …
-
IonRouter and RunAnywhere launch new AI inference and on-device solutions
IonRouter has launched a new inference stack called IonAttention, designed to multiplex models on a single GPU for high throughput and low cost, compatible with NVIDIA Grace Hopper. Separately, RunAnywhere has released …
-
Show HN: OpenSwarm – Multi‑Agent Claude CLI Orchestrator for Linear/GitHub
OpenSwarm is a new command-line interface tool designed to orchestrate multiple AI agents for autonomous code-related tasks. It can integrate with various AI models, including Anthropic's Claude, OpenAI's GPT and Codex,…
-
Hugging Face partners with GGML and llama.cpp to advance local AI development
Hugging Face has announced a strategic partnership with the developers of GGML and llama.cpp, two key projects enabling local AI model execution. This collaboration aims to foster the continued development and accessibi…