EmmyMiao87 opened a new issue #1407: The broker load is cancelled with error 'tablet writer writer failed' URL: https://github.com/apache/incubator-doris/issues/1407 **Describe the bug** The broker load is cancelled with reason 'tablet writer writer failed'. The olap engine find the exists (txn_id, load_id, tablet_id). It causes the tablet_writer_mgr failed when it try to write the row_batch by delta writer. Then the job is cancelled. **To Reproduce** Steps to reproduce the behavior: 1. CREATE TABLE `store_sales` ( `ss_item_sk` int(11) NULL COMMENT "", `ss_ticket_number` int(11) NULL COMMENT "", `ss_sold_date_sk` int(11) REPLACE NULL COMMENT "", `ss_sold_time_sk` int(11) REPLACE NULL COMMENT "", `ss_customer_sk` int(11) REPLACE NULL COMMENT "", `ss_cdemo_sk` int(11) REPLACE NULL COMMENT "", `ss_hdemo_sk` int(11) REPLACE NULL COMMENT "", `ss_addr_sk` int(11) REPLACE NULL COMMENT "", `ss_store_sk` int(11) REPLACE NULL COMMENT "", `ss_promo_sk` int(11) REPLACE NULL COMMENT "", `ss_quantity` int(11) SUM NULL COMMENT "", `ss_wholesale_cost` decimal(7, 2) SUM NULL COMMENT "", `ss_list_price` decimal(7, 2) SUM NULL COMMENT "", `ss_sales_price` decimal(7, 2) SUM NULL COMMENT "", `ss_ext_discount_amt` decimal(7, 2) SUM NULL COMMENT "", `ss_ext_sales_price` decimal(7, 2) SUM NULL COMMENT "", `ss_ext_wholesale_cost` decimal(7, 2) SUM NULL COMMENT "", `ss_ext_list_price` decimal(7, 2) SUM NULL COMMENT "", `ss_ext_tax` decimal(7, 2) SUM NULL COMMENT "", `ss_coupon_amt` decimal(7, 2) SUM NULL COMMENT "", `ss_net_paid` decimal(7, 2) SUM NULL COMMENT "", `ss_net_paid_inc_tax` decimal(7, 2) SUM NULL COMMENT "", `ss_net_profit` decimal(7, 2) SUM NULL COMMENT "" ) ENGINE=OLAP AGGREGATE KEY(`ss_item_sk`, `ss_ticket_number`) DISTRIBUTED BY HASH(`ss_item_sk`, `ss_ticket_number`) BUCKETS 100 PROPERTIES ( "storage_type" = "COLUMN" ); 2. load job by broker load (streaming) LOAD LABEL tpcds.store_sales ( DATA INFILE("bos://xxx") INTO TABLE `store_sales` COLUMNS TERMINATED BY "|") WITH BROKER broker ( "bos_endpoint" = "xxx", "bos_accesskey" = "xxx", "bos_secret_accesskey"="xxx" ) properties ("max_filter_ratio" = "0.5", "strict_mode" = "false"); **Expected behavior** The duplicated request need to be skipped. The job should not be cancelled. It should skip it and continue loading. **Screenshots** The log in be: W0627 23:32:39.164078 43315 olap_engine.cpp:954] find transaction exists when add to engine.partition_id: 12037, transaction_id: 2005, table: .12426.1782960977 W0627 23:32:39.164129 43315 tablet_writer_mgr.cpp:154] tablet writer writer failed, tablet_id=12426, transaction_id=2005 W0627 23:32:39.164191 43315 internal_service.cpp:107] tablet writer add batch failed, message=tablet writer write failed, id=9687a924433d42d0-8c57969ba6d4fe16, index_id=10416, sender_id=0 W0627 23:32:39.225698 43138 olap_table_sink.cpp:310] NodeChannel add row failed, load_id=9687a924433d42d0-8c57969ba6d4fe16, tablet_id=12366, node=10.227.96.17:8061, errmsg=tablet writer write failed W0627 23:32:39.225729 43138 olap_table_sink.cpp:310] NodeChannel add row failed, load_id=9687a924433d42d0-8c57969ba6d4fe16, tablet_id=12366, node=10.227.96.18:8061, errmsg=tablet writer write failed
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
