You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am trying to write from Kafka Source to Hive Target.
I am using "com.hortonworks.spark.sql.hive.llap.streaming.HiveStreamingDataSource" format to write data into Hive table.
Table is ORC format and fully transactional. I am using HDP 3.1 cluster.
The column data type is binary.
When I write from CLI, the data can be seen in String.
While doing the same using "com.hortonworks.spark.sql.hive.llap.streaming.HiveStreamingDataSource" format, the data is being inserted in binary form in the Hive Table.
+----------------------+
| hive_binary.co |
+----------------------+
| ShreeshData1 | -->when inserted from CLI
| [B@1ebd3260 | -->when writing from spark using "com.hortonworks.spark.sql.hive.llap.streaming.HiveStreamingDataSource" format
+----------------------+
I am trying to write from Kafka Source to Hive Target.
I am using "com.hortonworks.spark.sql.hive.llap.streaming.HiveStreamingDataSource" format to write data into Hive table.
Table is ORC format and fully transactional. I am using HDP 3.1 cluster.
The column data type is binary.
When I write from CLI, the data can be seen in String.
While doing the same using "com.hortonworks.spark.sql.hive.llap.streaming.HiveStreamingDataSource" format, the data is being inserted in binary form in the Hive Table.
+----------------------+
| hive_binary.co |
+----------------------+
| ShreeshData1 | -->when inserted from CLI
| [B@1ebd3260 | -->when writing from spark using "com.hortonworks.spark.sql.hive.llap.streaming.HiveStreamingDataSource" format
+----------------------+
Is it the bug or is it the expected behavior?
Attaching Standalone spark program
standAlone.txt
Create Table Command : create table hive_binary (co binary);
Table Properties :
The text was updated successfully, but these errors were encountered: