Gemini Articles of Interest
A Gemini client* is needed for the following links.
-
Technology and Free Software
-
Toby's tinylog
I wanted to find out what the minimum hardware for running a reasonably good Large Language Model at home would be, so I bought a refurbished ThinkCentre M715q with AMD Radeon 5 PRO 2400GE CPU. It's a 2018-era machine costing only around $200. With no upgrades, I was able to run llama.cpp in CPU-only mode on the smallest Llama 2 7b model (q2_K) generating 5.2 tokens/sec! Very impressive! I can also run Vicuna 13b (q4_1) at over 2 tokens/sec after upgrading the RAM to 16Gb. All this while consuming around 40W of power. One trick I had to employ is to use "LLAMA_AVX2=1 make" to compile, as it doesn't detect AVX2 by default. Anwyay, I love this ThinkCentre machine, it is amazing bang-for-buck and will be my main dev machine for the forseeable future.
-
Is it UTF-8?
Another method is to brute force the problem with a Monte Carlo simulation, which at best will waste lots of CPU. However, where Monte Carlo is practical this may help confirm that a better approach has not gone off the rails. Or, that both the Monte Carlo and the better approach are wrong in ways that produce the same results, which maybe isn't so likely? Richard Feynman said things about actually verifying results in his 1974 commencement address at Caltech.
-
Dotfiles: You're doing it wrong
When it comes to managing dotfiles, people like to come up with all kind of different and complicated solutions: bare repositories, git submodules, self grown bootstrap scripts, symlinks. Let me tell you: you're doing it wrong!
-
Some explanations about OpenBSD memory usage
I regularly see people reporting high memory usage on OpenBSD when looking at some monitoring program output.
Those programs may be not reporting what you think. The memory usage can be accounted in different ways.
Most of the time, the file system cache stored in-memory is added to memory usage, which lead to think about a high memory consumption.
-
Internet/Gemini
-
How to run newsboat over SSH
RSS is dead, isn't it?
Well, not at all, not for me. I've been an rss user ever since I've made my first step into the world wide web. When Google Reader still has been a thing and the world has been ok. I just like the idea to keep up to date with all the things I'm interested in, without any algorithm predicting what I'm going to read.
After g'reader died, RSS feeds felt more liken an on-off relationship. I tried different alternatives and even stopped using them altogether. But there was definitely something missing. Someone told me about ttrss then, while others moved to feedly, a free as in pay-with-your-data software-as-a-service solution.
-
Easing back into gemspace
Hey, it's been awhile. I've had a long, long year and a lot has happened. The good thing though is that I'm going to have some stability soon for basically the first time in my life.
-
-