Google BigQuery is a serverless, highly scalable data warehouse.
Google BigQuery Python SDK is not compatible with gevent. Use a worker type other than gevent when deploying with gunicorn.
Installation
Required packages: sqlalchemy-bigquery
echo "sqlalchemy-bigquery" >> ./docker/requirements-local.txtConnection String
bigquery://{project_id} Authentication Methods
Supported Features
JOINsSubqueriesDynamic SchemaCatalog SupportDynamic CatalogSSH TunnelingQuery CancellationFile UploadUser ImpersonationCost EstimationSQL Validation
Feature Score: 83/201
Time Grains
Common Time Grains:
SECONDMINUTEHOURDAYWEEKMONTHQUARTERYEAR
Extended Time Grains:
FIVE_SECONDSTHIRTY_SECONDSFIVE_MINUTESTEN_MINUTESFIFTEEN_MINUTESTHIRTY_MINUTESHALF_HOURSIX_HOURSWEEK_STARTING_SUNDAYWEEK_STARTING_MONDAYWEEK_ENDING_SATURDAYWEEK_ENDING_SUNDAYQUARTER_YEAR
Extended Aggregate Functions
The base aggregates (SUM, COUNT, AVG, MIN, MAX, COUNT DISTINCT) are supported everywhere; these are opt-in per engine.
MEDIANSTDDEV_SAMPVAR_SAMP
Troubleshooting
Common error messages you may encounter when connecting to or querying Google BigQuery, along with their causes and solutions.
Notes
Create a Service Account via GCP console with access to BigQuery datasets. For CSV/Excel uploads, also install pandas_gbq.
Resources