[GitHub] [druid] wangxiaobaidu11 removed a comment on pull request #12159: Add Spark Writer support.

Thu, 24 Feb 2022 23:16:21 -0800 


wangxiaobaidu11 removed a comment on pull request #12159:
URL: https://github.com/apache/druid/pull/12159#issuecomment-1046145314


   @JulianJaffePinterest  
   I use these code:
    `  NumberedPartitioner partitioner = new 
NumberedPartitioner(dataset.select(colSeq));`  
    `   Dataset<Row> partitionedDataSet = partitioner.partition(`  
    `           "time_stamp", "millis", "DAY", 2000, false, Option.empty());`  
    `  
partitionedDataSet.write().format("druid").mode(SaveMode.Overwrite).options(map).save();`
  
   Import the data of one day, the data is about 400,000 rows,  I think it will 
be 200 partition num 
   But the process is overshadowed, only  reserve 1 partition 
   
![image](https://user-images.githubusercontent.com/24448732/154930026-d96a3e7c-5b65-42f9-b3b3-e46f2f488caa.png)
   
![image](https://user-images.githubusercontent.com/24448732/154929014-4764bd1c-87d7-412e-856f-cf3731878f80.png)
   
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to