Scheduled Task supported the reading from and writing into the StarRocks database.
Pipeline Task supported the writing of data into the StarRocks database.
FineDataLink supports connection to the StarRocks database.
For details about the usage instructions, see StarRocks Instruction.
1.19 and above
Collect the following information before connecting FineDataLink to the database.
IP address and port number of the database server
Database name
Username and password of the database
1. Ensure that FineDataLink can access the frontend node (FE) and the backend node (BE) before establishing a data connection.
2. Ensure that the FE can access the BE to write the data into a StarRocks database.
In the process of loading data into StarRocks using FineDataLink, local text files or program files are imported using the HTTP-based Stream Load method to the FE, which then uses an HTTP redirect to forward the load request to a BE.
Alternatively, FineDataLink can submit the import command to a specified BE. The final result of importing is returned by the BE coordinator. This method is suitable for importing 1 GB to 10 GB of data.
1. Log in to FineDataLink, choose System Management > Data Connection > Data Connection Management, click New Data Connection, and click the StarRocks icon, as shown in the following figure.
2. Fill in the connection information, as shown in the following figure.
Configure the FE to write data into the StarRocks database. The configuration is described as follows.
The FE address is the connection target of Stream Load.
The format is IP address: Port number. You can use the following command to query the FE-related port.
For example, 192. 168. 101. 71: 8030,192.168.101.209: 9030. You can enter multiple FE addresses, where the FE uses a polling mechanism to decide which BE will serve as a coordinator to receive and process the load requests.
The default port number of the FE is 8030. (Must configure it to write data into a StarRocks database.) The default port number of JDBC is 9030. (Configure it as needed.)
3. Click Test Connection. If the connection is successful, click Save to save the configuration.
After configuring the data source, you can use it in Data Development. For details, see Overview of Data Development.
After configuring the data source, you can use it in Data Pipeline. For details, see Overview of Data Pipeline.
After configuring the data source, you can use it in Data Service. For details, see Overview of Data Service.
The following is an example of using StarRocks in the Data Synchronization node to develop the data.
滑鼠選中內容,快速回饋問題
滑鼠選中存在疑惑的內容,即可快速回饋問題,我們將會跟進處理。
不再提示
10s後關閉
Submitted successfully
Network busy