Parse 12 Months Of Credit Card Statements In 3 Minutes
How to use Python to read multi-page PDFs, transform unstructured data and SQL to format the final result in BigQuery.
Zach Quinn
Set Up A Virtual Environment In A Compute Engine VM In 5 Min.
Set up a virtual environment, install Python & pip and run Python scripts in a Google Cloud Compute Engine virtual machine.
Why Is Authenticating Google Cloud Platform Applications So Hard?
Distinguishing between Google Cloud Platform and a typical API’s authentication process emphasizes the need for secure credential storage.
Beyond Timestamps: Using BigQuery's APPENDS() for Forensic Table Validation
Leverage BigQuery SQL table metadata to deduplicate, partition and delete data — all using only one word.
Deploy Your Google Cloud Functions The Right Way (Step-by-Step Guide)
Covering GitHub versioning, CI/CD pipeline development and scheduling jobs within Google Cloud Platform.
Go From Staging Table To Production Data With 1 Stupid Simple SQL Line
A risk-averse approach to “flipping the switch” from test tables to production tables featuring a subtle BigQuery SQL function.
Why Do My Data Engineering Requests Take Forever?
How data engineers can set realistic development expectations and respond to impatient stakeholders.
Using PyPDF For PDF →CSV Conversion To Find Missing Groceries
Convert PDFs to CSVs in an unusual–but practical–use case of real-life data engineering problem-solving.
If You Must Use A Spreadsheet As A Database At Least Use This Kind
Spreadsheets are a breeding ground for data inaccuracy — unless you can solve one core problem.
I Lost 3 Days Of Data By Not Taking 10 Min. For These Deprecation Steps
How data engineers can anticipate, adapt to and recover from inevitable data downtimes and API outages.
How I Used Python & SQL To Build A Looker Dash During A Baseball Game
The 35 line SQL Query That Powers A Top 3 SQL Publication’s Analytics (Part II).
The Subtle Power Of SQL’s Overlooked DML Function
One function you gloss over has the power to save you hours of development time — and preserve data accuracy.