Apache DataFusion

https://datafusion.apache.org/

DataFusion is a highly performant query engine

Installation

Required packages: flightsql-dbapi

Drivers

Arrow Flight SQL (Recommended)Recommended

PyPI Package: flightsql-dbapi

datafusion://host:port

Supported Features

JOINsSubqueriesDynamic SchemaCatalog SupportDynamic CatalogSSH TunnelingQuery CancellationFile UploadUser ImpersonationCost EstimationSQL Validation

Feature Score: 24/201

Time Grains

Common Time Grains:

SECONDMINUTEHOURDAYWEEKMONTHQUARTERYEAR

Extended Time Grains:

FIVE_SECONDSTHIRTY_SECONDSFIVE_MINUTESTEN_MINUTESFIFTEEN_MINUTESTHIRTY_MINUTESHALF_HOURSIX_HOURSWEEK_STARTING_SUNDAYWEEK_STARTING_MONDAYWEEK_ENDING_SATURDAYWEEK_ENDING_SUNDAYQUARTER_YEAR

Extended Aggregate Functions

The base aggregates (SUM, COUNT, AVG, MIN, MAX, COUNT DISTINCT) are supported everywhere; these are opt-in per engine.

MEDIANSTDDEV_SAMPVAR_SAMP

Help improve this documentation by editing the engine spec:

Edit datafusion.py