Limited by the architecture of Hive-managed HDFS, the Data Synchronization node and the DB Table Output operator in the Data Transformation node support only append writes and cannot perform data updates when writing data to Transwarp Inceptor data sources.
When writing data to Transwarp Inceptor data sources, you are advised to change the data type of target table fields from char (if any) to varchar, as the char-type data is currently not supported.
When configuring field mappings with the target table set to Auto Created Table, you can enable NOT NULL constraints via checkbox selection, but these constraints will not be visually indicated on the frontend page.
You can select partition tables as data destinations in scheduled tasks, as shown in the following figure.
You can set partition keys when Target Table is set to Auto Created Tables in scheduled tasks, as shown in the following figure.
For details, see Partition Table Creation and Data Reading/Writing.
The following table describes the types of fields that can be selected as partition keys.
Types of fields that can be selected as partition keys for Transwarp Inceptor database tables
Integer type: tinyint, smallint, int, and bigint
Floating-point type: float and double
String type: string and varchar
Date type: date and timestamp
Others: array, map, struct, and others
Types of fields that cannot be selected as partition keys in a Transwarp Inceptor database
Complex type: such as array, map, and struct. Fields of these data types cannot be selected as partition keys in a Hive database.
NULL type: The Hive database does not support NULL-type fields as partition keys.
Collection type: such as set, list, and tuple. Fields of these data types cannot be selected as partition keys in a Hive database.
Other specific data types: such as bit, decimal, and binary. These types of fields cannot be selected as partition keys in a Hive database.
Partitions have a hierarchical relationship based on their definition order, supporting at most eight levels. The first partition key is the level-one partition, the second is the level-two partition, and so on.
If a field is defined as a partition field, it is placed at the end in Field Mapping by default.
A Partition Write Setting item is added, which is displayed on the Write Method tab page when a partition table (with defined partition keys) is selected as the target table or when you define partition keys for the target table when selecting Auto Created Table, as shown in the following figure.
Partitioning levels and partition keys are displayed and uneditable. You can configure write methods and partition values.
Write Method: You can choose from Static Partition and Dynamic Partition.
Partition Value: You need to configure partition values for partition keys if you select Static Partition.
For details, see Overview of Data Pipeline.
For details, see Overview of Data Service.
滑鼠選中內容，快速回饋問題
滑鼠選中存在疑惑的內容，即可快速回饋問題，我們將會跟進處理。
不再提示
10s後關閉
Submitted successfully
Network busy