Tag

#local-ai

94 posts0 followers

Explore Hashnode

Alternatives

Dragos Roua3h ago · 2 min read

[ Video ] Testing Apple Intelligence on my 16GB MacBook Pro

This is the 8th episode in the series where I’m testing a local AI model that runs on a 16GB MacBook Pro. Today I’m doing something special: I picked the model that Apple ships with Apple Intelligence

dragosroua.hashnode.dev

Quentin Merle2d ago · 9 min read

Implementing Client-Side AI in E-Commerce (WebLLM & Privacy-First Architecture)

While browsing the Vans website, I tried out their new shopping assistant. The UX is great: it's fluid, context-aware, and easily understands my needs as a casual skater. Behind this interface are gia

vibrisse-studio.hashnode.dev

Adi Shik6d ago · 10 min read

What a 1997 chess engine taught me about LLM inference

TL;DR You don't need an LLM agent to optimize inference. Across six tuning tracks on an NVIDIA L4, Tensward's expert rules and heuristics matched frontier LLM agents running at maximum effort - Astra

openingthehood.hashnode.dev

Haithem SlimiOct 14 · 13 min read

The Memory Wall: How NVIDIA’s RTX Spark Changes the AI Bottleneck

Introduction When people talk about AI hardware, the conversation usually centers on compute. How many teraflops can a chip push? How many operations per second? Faster chips sound like faster AI. But

2 nightthoughts.me

Haithem SlimiOct 13 · 6 min read

The Future Is Both

New to the jargon? Start with the glossary → Most AI systems today pick a side. They run entirely local or entirely cloud. That's a design choice, not a law of nature. The choice made sense when loca

nightthoughts.me

Sanjay JanaOct 11 · 5 min read

Building Solomon: a private, local-first AI assistant

Why we built Solomon Solomon is an AI assistant that chats, searches the web with citations, reads your files and draws images, and most of it runs on our own machines. We built it to see how far a pr

codedecoder.hashnode.dev

Mihai_LeanZeroOct 8 · 53 min read

Qwen3.8 Flash vs Max Prime: Forge app benchmark

Qwen3.8 Flash vs Max Prime is the oddest result inside one model family on our boards. The far cheaper Flash beat Qwen3.8 Max Prime on Forge 1.0, an Atlassian Forge app built with no internet, 0.7961

leanzero.hashnode.dev

Haithem SlimiOct 7 · 8 min read

Who Actually Saves Money?

Who Actually Saves Money? New to the jargon? Start with the glossary → "Local AI is free." You'll see that line in forum threads, in YouTube comments, in the pitch for every new tool that runs on you

1 nightthoughts.me

Dragos RouaOct 8 · 2 min read

[ Video ] Running Liquid AI LFM V2.5 on my 16 GB MacBookPro

This is our fourth video in the series: Local AI – models that you can actually run on an entry level machine, like a 16GB MacBookPro. This time we’re testing LFM 2.5 3B, a 3 billion model from Liquid