Articles tagged "llm" - Page 2

27-May-2025

How to Run LLMs Locally: A Complete Step-by-Step Guide

Unlock the power of AI on your own hardware with this comprehensive guide to running large language models (LLMs) locally. Learn about privacy, hardware requirements, quantization, and practical tools like LM Studio and Ollama for private, cost-effective, and customizable AI.

26-May-2025

Hardware Options for Running Local LLMs 2025

Explore the optimal hardware for running large language models (LLMs) locally, from entry-level edge devices like NVIDIA Jetson Orin Nano Super to powerful GPUs, Apple M3 Ultra Mac Studio, and modern CPUs like AMD Ryzen 7 8745HS. Learn how to choose the right setup for efficient AI performance, balancing cost, speed, and scalability.

25-May-2025

How benchmark local LLMs

A practical benchmarking local LLMs using Ollama: covers script automation, hardware detection, performance metrics

24-May-2025

Test results for local running LLMs using Ollama on RTX4060 Ti

Local LLMs Benchmark data sorted by evaluation performance