Derrick Qin's Blog

Odd IAM issue using GCP Pub/Sub Ruby SDK to publish messages

Sep 29, 20232 min read

Ruby is a programming language that is popular in Google Cloud community. Recently, I got an odd IAM issue from a client using its GCP Pub/Sub SDK...

Odd IAM issue using GCP Pub/Sub Ruby SDK to publish messages

CloudSQL Query Insight - Query details truncated to 1024 characters

Sep 22, 20232 min read

Query insights is a useful feature to help Cloud SQL users to detect, diagnose, and prevent query performance problems for Cloud SQL databases. One...

CloudSQL Query Insight - Query details truncated to 1024 characters

Cloud Composer Airflow and BigQuery External Table with Google Sheets

Jul 22, 20232 min read

BigQuery has a useful feature which allows the user to create external table with data on Google Sheets. It is very convenient because BigQuery users...

Cloud Composer Airflow and BigQuery External Table with Google Sheets

Export data from Cloud SQL to GCS using BigQuery Federated Query and Scheduled Query

Jul 1, 20232 min read

Recently, I worked with a client who wanted to export data from Cloud SQL to GCS daily. They tried Cloud SQL Serverless Export orchestrated by Cloud...

Export data from Cloud SQL to GCS using BigQuery Federated Query and Scheduled Query

Run dbt with Cloud Composer and Cloud Run

Jun 24, 20232 min read

Recently, a client wanted to use dbt core in Cloud Composer Airflow but they encountered Python dependencies issues. To solve this issue, I built a...

Run dbt with Cloud Composer and Cloud Run

Enable auto-shutdown for Vertex AI Workbench user-managed Notebooks

Jun 16, 20231 min read

Vertex AI Workbench user-managed notebooks instances let you create and manage deep learning virtual machine (VM) instances that are prepackaged with...

Enable auto-shutdown for Vertex AI Workbench user-managed Notebooks