luoyafei opened a new issue #1257: Routine load problem
URL: https://github.com/apache/incubator-doris/issues/1257
 
 
   Q: create routine load, but table no data to load.
   
   resource:
   >Only 1 FE, 1 BE, 1 KFK, 1 ZK
   >`FE`, `BE`, `KFK`,` ZK` all on the same machine
   
   
   
   kafka version:
   
   ```
   0.10.1.0
   ```
   
   create topic:
   
   ```shell
   bin/kafka-topics.sh --create --topic test --replication-factor 1 
--partitions 1 --zookeeper 10.39.59.92:2181
   ```
   
   create table:
   
   ```sql
   CREATE TABLE IF NOT EXISTS test_table
   (
   `id` INT NOT NULL,
   `name` VARCHAR(20) NOT NULL,
   `timestamp` DATETIME NOT NULL,
   `count` INT SUM DEFAULT "0"
   )
   ENGINE=olap
   AGGREGATE KEY(`id`,`name`,`timestamp`)
   PARTITION BY RANGE(`timestamp`)
   (
   PARTITION `p201906` VALUES LESS THAN ("2019-07-01 00:00:00"),
   PARTITION `p201907` VALUES LESS THAN ("2019-08-01 00:00:00")
   ) DISTRIBUTED BY HASH(`id`) BUCKETS 8
   PROPERTIES
   (
   "replication_num" = "1"
   );
   ```
   
   create routine:
   
   ```sql
   CREATE ROUTINE LOAD feed.load_test ON test_table
   COLUMNS(id, name, timestamp, count)
   PROPERTIES
   (
   "desired_concurrent_number"="1"
   )
   FROM KAFKA
   (
   "kafka_broker_list" = "10.39.59.92:9092",
   "kafka_topic" = "test"
   );
   ```
   There appears to be an import operation, but there is no data in the table 
`test` 
   
![image](https://user-images.githubusercontent.com/18156435/58958007-78bd5000-87d4-11e9-92ef-2126f9637ed8.png)
   
   
   
   Long agter then execution, I found these logs in FE
   
![image](https://user-images.githubusercontent.com/18156435/58957537-60006a80-87d3-11e9-82c7-2bb4e31c9230.png)
   
   And BE also has a large number of such logs
   
![image](https://user-images.githubusercontent.com/18156435/58957656-976f1700-87d3-11e9-83df-af16b2abe653.png)
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to