Apache Airflow Template Variables and Dataset scheduled DAGs.

Quick notes about migrating Airflow DAGs from cron expression schedules to Dataset schedules.

Continue reading

Adventures in Least Privilege: Securely Granting Cloud Storage Read Permissions.

Explore the efficiency of granting bucket-level read permissions over project-level access in cloud storage security. Simplify access control today.

Continue reading

The Orchestrator Pattern in Prefect deployments.

Let's take a quick look at how to have a Prefect flow trigger a downstream deployment.

Continue reading

Islands and Gaps

A classic SQL exercise in the real world!

Continue reading

What are Github Actions? - Part 4

Let's take a closer look at how our GitHub Action deploys to Prefect Cloud.

Continue reading

What are Github Actions? - Part 3

Breaking down our first workflow Job!

Continue reading

What are Github Actions? - Part 2

A quick intro to workflow triggers and Github Action env vars.

Continue reading

What are Github Actions?

A simple CI/CD platform with all fixins'.

Continue reading

Git Hooks. Use them please.

Git hooks are a simple way of helping to reduce pesky unwanted errors from polluting your commit history........or worse accidentally kicking off some CI/CD process you aren't ready for.

Continue reading

Bulk Renaming With Vim's :cdo

This week we are going to quickly go over vim's :cdo command to make minor bulk edits to the numerous files.

Continue reading

Unix tools - xargs

eXtended ARGumentS 🤔

Continue reading

Read Files on AWS S3 Without Copying As A Local File

Not sure what's in a file in an S3 bucket? Peak inside it without having to copy it on to your machine.

Continue reading

Data Visualization with pandas & Dash Part 2

Building a quick interactive web app to display recently prepared data from the 1st post in this 2 part series.

Continue reading

Unpacking Argument Lists

Recent real life example of having to utilize the "Splat" operator to work with variable length lists that are to be input to methods that require separate positional arguments.

Continue reading

Data Visualization with pandas & Dash

A quick rundown of using Python's pandas package to prep flat file data for plotting with Dash.

Continue reading

Virtualenv with Python

On creating isolated python environments

Continue reading

Playing around with P5.js

~On trying to be more artsy~

Continue reading