Introduction to Distributed RL Sandboxing on GKE

Reinforcement Learning (RL) is the cornerstone of modern AI training. Rather than train a model to produce an expected output, we verify if it has achieved a particular outcome. This is …

XPK Cluster Create

Simplifying AI Infra Management

You’ve probably used terraform and kubectl to set up infrastructure and deploy code to it (if you haven’t, thanks for stopping by, but this post might not be super interesting …

Fine-Tuning Mixtral-8x7B: A Deep Dive into a Multi-Node Slurm and FSDP Workflow

Training or fine-tuning large language models like Mixtral-8x7B is a significant challenge due to their large size. Sometimes, to make these …

Fine-tuning Gemma 3 on an A4 Slurm Cluster

Note: This post has been adapted into a formal tutorial on the Google Cloud documentation site.

Overview

This post demonstrates how to fine-tune the Gemma 3 language model on a multi-node, …

Fine-tuning Gemma 3 on an A3 Mega Slurm Cluster

Note: This post has been adapted into a formal tutorial on the Google Cloud documentation site.

Overview

This post demonstrates how to fine-tune the Gemma 3 language model on a multi-node, …

I have been hooked on Factorio for years now. It is my favorite video game, and probably one of the most impressively documented feats of software engineering in gaming. Check out their long-lived series of technical blog posts: Factorio …

This site is hosted on Google Cloud using a Cloud Storage bucket to serve static HTML files generated using Hugo. I like this setup because it is fast, simple, and the content is easy to move to another platform or hosting provider if I …