My name is Hunter and I’m a senior computer science student at New College of Florida. I spend much of my free time working on my homelab and personal, tech-related, projects. I hope this blog will fix a great error of mine; I almost never record my adventures, solutions, or projects. I have relied heavily on tech blogs growing up and I feel it would be irresponsible not to give back to that community now that I have the knowledge to.
In the world of Linux, the often-overlooked nice command holds the power to harmonize the demands of competing processes vying for system resources. This unassuming utility allows you to adjust the scheduling priority of a process, making it more or less “nice” to other processes…
Continue reading...As the field of large language models continues its rapid advancement, a key area meriting further research is the balance between model parameter count and numerical precision. While traditionally focusing on 32-bit or 16-bit floating point representations, recent explorations have unveiled the promise of quantizing…
Continue reading...What is Mamba? Before we dive into using Mamba models with the text-generation WebUI, let’s first understand what Mamba is. Mamba is a new type of language model architecture that offers an alternative to the widely-used Transformer models. It’s called a “linear time, state-space model,”…
Continue reading...Today’s mainstream Linux distributions have outstanding stability and compatibility. Distributions like Manjaro and Ubuntu have a plug-and-play aspect that can give their closed source alternatives a run for their money. That said, you still occasionally run into hiccups. External GPUs, or eGPUs, have increased in…
Continue reading...