Running LLMs Locally

I recently bought a new mini PC to host my homelab services. The new host is something like 10x more powerful than the old. Old New CPU Core i5-3427 i9-12900HK RAM 16GB 32GB Disk 60GB mSATA 1TB NVMe GPU HD 4000 Iris Xe It’s just sitting here doing nothing most of the time so I thought I might give running some AI stuff on it. Previously I had set up one of the earlier versions of Stable Diffusion to run on my desktop....

September 6, 2025

I should have set up syncthing months ago

Syncthing is a way to, well, synchronize files across multiple hosts. My mental model is that it’s a self hosted Dropbox, although it’s not an exact 1-1 comparison. I’ve been playing around with handheld emulation devices for the last few years. One of the most consistently annoying aspects of using these devices is getting files on and off of them. It’s also uniquely awful depending on your device. If you’re lucky, the device offers some kind of usb disk mounting, although filesystem coherency is risky with those....

September 6, 2025

How this site is hosted

This site is generated using Hugo, with the PaperMod theme. It is served using Caddy running within docker. I am not a web developer. I find almost all browser based technologies confounding. I looked into several “wordpress” like solutions for a home website, but when faced with setting up some kind of PHP/node.js + SQL stack to run it I ran right over to markdown based static site generators with community theme support....

September 1, 2025

Initial Post

I am writing an initial post using Hugo. Ideally, this becomes the new markgius.com, but I haven’t quite decided yet. It’s been a very long time since I wrote regularly, and previously I had used jekyll with github pages. Now I’m going to take a stab at self hosting with Hugo. I’m hoping to get back to writing down things more often. I do a lot of weird little things and sometimes it’s nice to just refer back to my brainspace from weeks, months or years back to get ideas....

September 1, 2025