Articles tagged "llm"

Spring AI Agentic Patterns: Agent Skills for Clinical Decision Support

14-Jun-2026

Spring AI Agentic Patterns: Agent Skills for Clinical Decision Support

How med-expert-match-ce uses 9 domain-specific Agent Skills from spring-ai-agent-utils to build a modular, LLM-agnostic specialist-matching system on Spring Boot 4 and Spring AI 2.0.

Running Gemma 4 12B Locally with Speculative Decoding on Ubuntu

10-Jun-2026

Running Gemma 4 12B Locally with Speculative Decoding on Ubuntu

A practical guide to running Gemma 4 12B locally on Ubuntu using llama.cpp, Hugging Face automatic model loading, and speculative decoding with MTP.

Running Gemma 4 31B Faster at Home with Speculative Decoding

15-May-2026

Running Gemma 4 31B Faster at Home with Speculative Decoding

A practical guide to running Gemma 4 31B on a dual-GPU Ubuntu box using llama.cpp TurboQuant, Gemma 4’s MTP assistant head, and speculative decoding to nearly double token throughput.

Why Vector Search Is Harder Than It Looks (And Why It Matters)

10-Apr-2026

Why Vector Search Is Harder Than It Looks (And Why It Matters)

A simple, practical introduction to embeddings, vector indexes, and real-world semantic search