Stream Your Data Using Nothing But Python’s Requests Library
Understand when to stream data, how to configure a pipeline and learn from my mistakes building streaming pipelines.
Zach Quinn
Flattening Your SQL Tables — Not As Easy As It Sounds
How to expose deeply nested SQL fields — and why you need to be careful when handling complex raw data.
Write Your First SQL ETL Pipeline (Part II)
How to create and load an aggregate table for your GCP usage using ETL principles and SQL commands.
Write Your First SQL ETL Pipeline (Part I)
You’ve written enough queries; it’s time to move to production.
SQL Users: Reduce Your CASE Statements With A Lookup Table
Map fields in your SQL tables without using CASE.
Measuring Impact As A Data Engineer
How data engineers can more accurately trace the impact of your data, your work and your team within your organization.
3 Data Engineering Quick Fixes When You Hit An Optimization Ceiling
Use the 3 Rs of optimization to smash through technical barriers.
Data Scientists: Answer 6 Questions to Summarize Your Insights In 1 Sentence
A simplified writing technique to help you communicate complex data science problems, describe methods and share results.
So, You Think A Company Misused Your Data. How To Write A DSAR.
Learn how to audit a company for your user data, request data suppression or even request total deletion — all in one email.
Don’t Get Cocky: 5 Confidence Shortcuts That Will Break Your Production Pipelines
As you gain proficiency, you gain confidence; this can lead to cutting corners — and the potential to make big mistakes.
Scrape, Clean and Store Zillow Apartment Data — Part II
Store data scraped from Zillow in a BigQuery table and view.
Scrape, Clean and Store Zillow Apartment Data (ETL Pipeline)
Use Python to find an apartment on Zillow.