The Ultimate Guide To GCP Observability

Zach Quinn

Zach Quinn

— 5 min read
Share

LQL, Python and Audit Strategies For Diagnosis & Triage.

Part 1: Logging Query Language

LQL can be used in the Logs Explorer to fetch real-time data on Google Cloud products like Cloud Functions and Virtual Machines as well as non-GCP resources like resources connected to Amazon Web Services’ accounts.

If you’ve never accessed the Logs Explorer within your GCP project, you can navigate to the Logs Explorer in the GCP console and then build queries either manually or by clicking to enable various filters.

The query pane enables click-based operations such as searching for text strings across specific fields, toggling options from within the filter menus, and composing more advanced queries using LQL.

Once your queries become more specific, it is likely you’ll need to move beyond the constraints of the LQL point-and-click UI features.

Build Your Pipeline To A Data Engineering Career

You’ve reached the limit of the public preview. The full version of this post includes the implementation details: The code, the edge cases, and the "why" behind the architecture.

When you join PipelineToDE, you get:

  • The DA → DE Pathway Course: A structured roadmap to bridge the gap between analysis and engineering.
  • Weekly Senior Deep Dives: Fresh, tactical insights on Python, Cloud (GCP/AWS), and modern orchestration delivered every week.
  • Production-Ready Blueprints: Access to 80+ protected stories and code repos from my time in the trenches as a Senior DE
  • The DE Job Board (Coming Soon): Exclusive access to a curated board of high-agency Data Engineering roles.

Read more