From a4f1678e1f37a3b3e7ad29a3a7682dda2a9b9118 Mon Sep 17 00:00:00 2001 From: maxim-lixakov Date: Mon, 15 Apr 2024 14:52:40 +0300 Subject: [PATCH] [DOP-13855] - update temporal mapping --- .../db_connection/clickhouse/types.rst | 39 +++++++++---------- 1 file changed, 18 insertions(+), 21 deletions(-) diff --git a/docs/connection/db_connection/clickhouse/types.rst b/docs/connection/db_connection/clickhouse/types.rst index cbdaf7863..b0171b503 100644 --- a/docs/connection/db_connection/clickhouse/types.rst +++ b/docs/connection/db_connection/clickhouse/types.rst @@ -127,7 +127,7 @@ Numeric types +--------------------------------+-----------------------------------+-------------------------------+-------------------------------+ | Clickhouse type (read) | Spark type | Clickhouse type (write) | Clickhouse type (create) | +================================+===================================+===============================+===============================+ -| ``Bool`` | ``BooleanType()`` | ``UInt64`` | ``UInt64`` | +| ``Bool`` | ``BooleanType()`` | ``UInt64`` | ``UInt64`` | +--------------------------------+-----------------------------------+-------------------------------+-------------------------------+ | ``Decimal`` | ``DecimalType(P=10, S=0)`` | ``Decimal(P=10, S=0)`` | ``Decimal(P=10, S=0)`` | +--------------------------------+-----------------------------------+-------------------------------+-------------------------------+ @@ -143,9 +143,7 @@ Numeric types +--------------------------------+-----------------------------------+-------------------------------+-------------------------------+ | ``Decimal128(S=0..38)`` | ``DecimalType(P=38, S=0..38)`` | ``Decimal(P=38, S=0..38)`` | ``Decimal(P=38, S=0..38)`` | +--------------------------------+-----------------------------------+-------------------------------+-------------------------------+ -| ``Decimal256(S=0..75)`` | unsupported [3]_ | | | -+--------------------------------+-----------------------------------+-------------------------------+-------------------------------+ -| ``Decimal256(76)`` | ``DecimalType(P=38, S=38)`` | ``DecimalType(P=38, S=38)`` | ``DecimalType(P=38, S=38)`` | +| ``Decimal256(S=0..76)`` | unsupported [3]_ | | | +--------------------------------+-----------------------------------+-------------------------------+-------------------------------+ | ``Float32`` | ``FloatType()`` | ``Float32`` | ``Float32`` | +--------------------------------+-----------------------------------+-------------------------------+-------------------------------+ @@ -196,33 +194,32 @@ Notes: * ``TIMESTAMP`` is alias for ``DateTime32``, but ``TIMESTAMP(N)`` is alias for ``DateTime64(N)`` +-----------------------------------+--------------------------------------+----------------------------------+-------------------------------+ -| Clickhouse type (read) | Spark type | Clickhousetype (write) | Clickhouse type (create) | +| Clickhouse type (read) | Spark type | Clickhouse type (write) | Clickhouse type (create) | +===================================+======================================+==================================+===============================+ | ``Date`` | ``DateType()`` | ``Date`` | ``Date`` | +-----------------------------------+--------------------------------------+----------------------------------+-------------------------------+ -| ``Date32`` | unsupported | | | -+-----------------------------------+--------------------------------------+----------------------------------+-------------------------------+ -| ``DateTime32``, seconds | ``TimestampType()``, microseconds | ``DateTime64(6)``, microseconds | ``DateTime32``, seconds, | +| ``Date32`` | ``DateType()`` | ``Date`` | ``Date`` | +| | | | **cannot be inserted** [6]_ | +-----------------------------------+--------------------------------------+----------------------------------+-------------------------------+ -| ``DateTime64(3)``, milliseconds | ``TimestampType()``, microseconds | ``DateTime64(6)``, microseconds | ``DateTime32``, seconds, | -| | | | **precision loss** [5]_ | -| | | | | -+-----------------------------------+--------------------------------------+----------------------------------+-------------------------------+ -| ``DateTime64(6)``, microseconds | ``TimestampType()``, microseconds | ``DateTime64(6)``, microseconds | ``DateTime32``, seconds, | -+-----------------------------------+--------------------------------------+----------------------------------+ **cannot be inserted** [6]_ | -| ``DateTime64(7..9)``, nanoseconds | ``TimestampType()``, microseconds, | ``DateTime64(6)``, microseconds, | | -| | **precision loss** [4]_ | **precision loss** [4]_ | | -| | | | | +| ``DateTime32``, seconds | ``TimestampType()`` | ``DateTime64(6)``, microseconds | ``DateTime32`` | ++-----------------------------------+--------------------------------------+----------------------------------+ seconds | +| ``DateTime64(3)``, milliseconds | ``TimestampType()`` | ``DateTime64(6)``, microseconds | **precision loss** [4]_ | ++-----------------------------------+--------------------------------------+----------------------------------+ | +| ``DateTime64(6)``, microseconds | ``TimestampType()`` | ``DateTime64(6)``, microseconds | | +-----------------------------------+--------------------------------------+----------------------------------+ | -| ``-`` | ``TimestampNTZType()``, microseconds | ``DateTime64(6)`` | | +| ``DateTime64(7..9)``, nanoseconds | ``TimestampType()`` | ``DateTime64(6)`` | | +| | | microseconds | | +| | | **precision loss** [4]_ | | +-----------------------------------+--------------------------------------+----------------------------------+-------------------------------+ -| ``IntervalNanosecond`` | unsupported | | | +| ``-`` | ``TimestampNTZType()`` | ``DateTime64(6)`` | | ++-----------------------------------+--------------------------------------+----------------------------------+-------------------------------+ +| ``IntervalNanosecond`` | ``LongType()`` | ```Int64`` | ``Int64`` | +-----------------------------------+ | | | | ``IntervalMicrosecond`` | | | | +-----------------------------------+ | | | | ``IntervalMillisecond`` | | | | -+-----------------------------------+--------------------------------------+----------------------------------+-------------------------------+ -| ``IntervalSecond`` | ``IntegerType()`` | ``Int32`` | ``Int32`` | ++-----------------------------------+ | | | +| ``IntervalSecond`` | | | | +-----------------------------------+ | | | | ``IntervalMinute`` | | | | +-----------------------------------+ | | |