[DOP-16941] Add spark-dialect-extension package to Clickhouse documen…

…tation
MobileTeleSystems · Oct 1, 2024 · 45c6bb8 · 45c6bb8
1 parent f8c6d3f
commit 45c6bb8
Show file tree

Hide file tree

Showing 10 changed files with 38 additions and 3 deletions.
diff --git a/.../changelog/next_release/+.bugfix.hdfs.rst → docs/changelog/next_release/+.bugfix.1.rst b/.../changelog/next_release/+.bugfix.hdfs.rst → docs/changelog/next_release/+.bugfix.1.rst
diff --git a/...changelog/next_release/+.bugfix.kinit.rst → docs/changelog/next_release/+.bugfix.2.rst b/...changelog/next_release/+.bugfix.kinit.rst → docs/changelog/next_release/+.bugfix.2.rst
diff --git a/docs/changelog/next_release/310.doc.rst b/docs/changelog/next_release/310.doc.rst
@@ -0,0 +1 @@
+Add note about `spark-dialect-extension <https://github.com/MobileTeleSystems/spark-dialect-extension>`_ package to Clickhouse connector documentation.
diff --git a/docs/connection/db_connection/clickhouse/types.rst b/docs/connection/db_connection/clickhouse/types.rst
@@ -3,6 +3,16 @@
 Clickhouse <-> Spark type mapping
 =================================
 
+.. note::
+
+    The results below are valid for Spark 3.5.3, and may differ on other Spark versions.
+
+.. note::
+
+    It is recommended to use `spark-dialect-extension <https://github.com/MobileTeleSystems/spark-dialect-extension>`_ package,
+    which implements writing Arrays from Spark to Clickhouse, fixes dropping fractions of seconds in ``TimestampType``,
+    and fixes other type conversion issues.
+
 Type detection & casting
 ------------------------
 

diff --git a/docs/connection/db_connection/greenplum/types.rst b/docs/connection/db_connection/greenplum/types.rst
@@ -3,6 +3,10 @@
 Greenplum <-> Spark type mapping
 =================================
 
+.. note::
+
+    The results below are valid for Spark 3.2.4, and may differ on other Spark versions.
+
 Type detection & casting
 ------------------------
 

diff --git a/docs/connection/db_connection/mongodb/types.rst b/docs/connection/db_connection/mongodb/types.rst
@@ -3,6 +3,10 @@
 MongoDB <-> Spark type mapping
 ==============================
 
+.. note::
+
+    The results below are valid for Spark 3.5.3, and may differ on other Spark versions.
+
 Type detection & casting
 ------------------------
 

diff --git a/docs/connection/db_connection/mssql/types.rst b/docs/connection/db_connection/mssql/types.rst
@@ -1,7 +1,11 @@
 .. _mssql-types:
 
 MSSQL <-> Spark type mapping
-=================================
+============================
+
+.. note::
+
+    The results below are valid for Spark 3.5.3, and may differ on other Spark versions.
 
 Type detection & casting
 ------------------------

diff --git a/docs/connection/db_connection/mysql/types.rst b/docs/connection/db_connection/mysql/types.rst
@@ -1,7 +1,11 @@
 .. _mysql-types:
 
 MySQL <-> Spark type mapping
-=================================
+============================
+
+.. note::
+
+    The results below are valid for Spark 3.5.3, and may differ on other Spark versions.
 
 Type detection & casting
 ------------------------

diff --git a/docs/connection/db_connection/oracle/types.rst b/docs/connection/db_connection/oracle/types.rst
@@ -3,6 +3,10 @@
 Oracle <-> Spark type mapping
 =============================
 
+.. note::
+
+    The results below are valid for Spark 3.5.3, and may differ on other Spark versions.
+
 Type detection & casting
 ------------------------
 

diff --git a/docs/connection/db_connection/postgres/types.rst b/docs/connection/db_connection/postgres/types.rst
@@ -1,7 +1,11 @@
 .. _postgres-types:
 
 Postgres <-> Spark type mapping
-=================================
+===============================
+
+.. note::
+
+    The results below are valid for Spark 3.5.3, and may differ on other Spark versions.
 
 Type detection & casting
 ------------------------