Skip to content

Data utils

Utilities related to handling various data sources e.g.: databases, cloud blob storage.

Pyarrow2redshift

Map Apache Arrow to Redshift.

map classmethod

map(dtype: DataType, string_type: str) -> str

Pyarrow to Redshift data types conversion.

UnsupportedType

Bases: Exception

Unsupported type exception.

reflect_meta_data

reflect_meta_data(engine: Engine, schema: str | None, table: str) -> Table | None

Reflects the metadata from the engine.

reflect_select_query

reflect_select_query(engine: Engine, table: Table) -> Query

Reflect the select query from the meta data.