NOTE: This project is archived as KX have released an official interface which is much more performant and feature rich: https://code.kx.com/q/interfaces/arrow/

qParquet

Library to read and write data from parquet files.

Apache Parquet is a columnar storage format available to any project in the Hadoop ecosystem

Requirements

• kdb+ ≥3.5 64-bit
  • embedPy
• Python ≥3.5
  • pandas
  • pyarrow

Run

Start q with qparquet

q qparquet.q

Or from q, load qparquet.q.

q)\l qparquet.q

Functions

.qparquet.getTable

.qparquet.setTable

.qparquet.getColumnNames

.qparquet.getColumns

.qparquet.getColumn

.qparquet.getColumnCustom

.qparquet.getColumnsCustom

.qparquet.getTableCustom

Reference links

• https://arrow.apache.org/docs/python/parquet.html
• https://code.kx.com/v2/ml/embedpy/