+- ASK NC (https://ask.nascompares.com)
+-- Forum: Q&A (https://ask.nascompares.com/forumdisplay.php?fid=1)
+--- Forum: Before you buy Q&A (https://ask.nascompares.com/forumdisplay.php?fid=2)
+--- Thread: Advice on NAS and local LLM server combo (/showthread.php?tid=11591)
Advice on NAS and local LLM server combo - Enquiries - 01-06-2025
I'm thinking of building/buying my first NAS. In addition I've been toying with the idea of setting up powerful (at that budget limit) local LLM for personal use-cases like file/photo management, automation and to start building small projects with AI. So my options are as below:
1. build a cheap low spec NAS + connect an RTX 3090 with my laptop via thunderbolt eGPU
2. Build a home server in a Jonsbo N5 or equivalent with powerful mobo, cpu, lots of ram and a powerful GPU and also include a bunch of SATA and NVME for the NAS combined
3. buy a NAS and buy a mini PC and hook to an eGPU dock if needed
4. buy the Zettlab D6 Ultra, and use their AI features and give up on a more powerful local AI for now.
Your help and recommendation would be really appreciated.
Many thanks
Elvis
RE: Advice on NAS and local LLM server combo - ed - 01-10-2025
Option 1: Low-Spec NAS + RTX 3090 eGPU
Pros:
Cost-effective for storage and AI compute if you already own the laptop and GPU.
Easy to scale storage separately from compute.
Cons:
Limited by Thunderbolt’s bandwidth for AI workloads.
Laptop performance might bottleneck the RTX 3090 for LLMs.
Verdict: Viable if cost and flexibility are top priorities, but performance for AI tasks may be constrained.
Option 2: Build a Home Server (Recommended)
Pros:
Combines high-performance local AI compute and NAS functionality.
Fully customizable—can include a high-performance GPU (e.g., RTX 3090) and robust storage options (SATA + NVMe).
Future-proof with upgrade potential for AI and storage.
Cons:
Initial setup complexity and potential noise/power considerations.
Verdict: Best balance of performance and scalability for your AI and NAS needs. A Jonsbo N5 or similar chassis is ideal for this setup.
Option 3: Buy a NAS + Mini PC with eGPU
Pros:
Dedicated devices for storage and compute.
Easier maintenance and management for NAS.
Cons:
Higher cost due to separate systems.
Limited upgrade flexibility compared to a combined server build.
Verdict: Good for simplicity and modularity but less cost-efficient for high-performance use.
Option 4: Buy Zettlab D6 Ultra
Pros:
AI-focused features out of the box.
Simplifies setup with an integrated solution.
Cons:
Limited local AI customization compared to an RTX 3090-based solution.
Expensive relative to performance for LLM workloads.
Verdict: Ideal if you want a plug-and-play AI NAS but lacks the flexibility of custom builds.
Recommended Build (Option 2)
Chassis: Jonsbo N5 or similar for compact yet spacious design.
CPU/Mobo: AMD Ryzen 7000 series or Intel 13th Gen with an ITX/ATX board supporting high PCIe bandwidth for GPUs.
GPU: RTX 3090 (or better if budget allows) for LLM tasks.
RAM: 64GB+ for handling AI workloads.
Storage:
NVMe: 1–2TB for OS and AI datasets.
SATA HDDs: 16–24TB for NAS storage in RAID 1/5.
PSU: 750W+ for stability with high-performance components.
This setup ensures high performance for local AI tasks while providing ample storage and future-proofing for both NAS and LLM use.