Introduction to Distributed RL Sandboxing on GKE

Reinforcement Learning (RL) is the cornerstone of modern AI training. Rather than train a model to produce an expected output, we verify if it has achieved a particular outcome. This is …

Ok, so you’re writing an AI agent to automate some task (who isn’t these days?). But where does it live? That largely depends on what you want it to do.

XPK Cluster Create

Simplifying AI Infra Management

You’ve probably used terraform and kubectl to set up infrastructure and deploy code to it (if you haven’t, thanks for stopping by, but this post might not be super interesting …

The Am Dash And Discerning Human Writing from AI

Was This Post Written by Gemini?^*

The other day I was listening to one of my favorite podcasts talking about AI’s writing style. And of course, they were talking about the Em dash. I’ll let …

I’ve been a big fan of Gemini CLI since I was first lucky enough to test an early version internally it before it launched publicly. It’s become an integral part of my workflow, and MCP servers only expand the world of …

Fine-Tuning Mixtral-8x7B: A Deep Dive into a Multi-Node Slurm and FSDP Workflow

Training or fine-tuning large language models like Mixtral-8x7B is a significant challenge due to their large size. Sometimes, to make these …

Fine-tuning Gemma 3 on an A4 Slurm Cluster

Note: This post has been adapted into a formal tutorial on the Google Cloud documentation site.

Overview

This post demonstrates how to fine-tune the Gemma 3 language model on a multi-node, …

Fine-tuning Gemma 3 on an A3 Mega Slurm Cluster

Note: This post has been adapted into a formal tutorial on the Google Cloud documentation site.

Overview

This post demonstrates how to fine-tune the Gemma 3 language model on a multi-node, …

I have been hooked on Factorio for years now. It is my favorite video game, and probably one of the most impressively documented feats of software engineering in gaming. Check out their long-lived series of technical blog posts: Factorio …

Backlogged Pinball

Earlier this year, I built a pinball-based demo for Cloud Next 2024. I’m preparing some posts about specific aspects of it, but I wanted to post a brief overview first. Backlogged is a physical pinball machine …