Deep Dive Series: Fine-Tuning (Small) Large Language Models on a PC
Series Overview – What We’re Building Welcome to a technical journey through building a fine-tuning system on consumer hardware. The End Result: What Success Looks...
Category: Python
Fine-Tuning Small Language Models on a basic Desktop PC
Can you really fine-tune a language model on a medium-spec desktop PC? Spoiler: Yes, and it works better than you’d expect. TL;DR: The Results Here’s...
A quick start for Python decorators
Synopsis #!/usr/bin/env python3 import shutil # Decorator which pre-checks the space in /tmp # and throws an exception if the space is more than #...
PyCon(line) AU 2020 Rube Codeberg competition
This is for fun, for silliness and for do not use anywhere-ness – or to quote the instructions: If you’ve ever wondered just how egregious...
pip – Cannot fetch index base URL http://pypi.python.org/simple/
You want to use pip to install a module from PyPI. However your server distribution in a little old (at the time of writing this...
Generating pi (π) using random numbers
I was entertained by Numberphile’s dice-based generation of an approximate of pi so thought I’d throw together a quick script to try this out: random_vals_pi The...