vinothchandar commented on issue #971: Setting "hoodie.parquet.max.file.size" 
to a value >= 2 GiB leads to no data being generated
URL: https://github.com/apache/incubator-hudi/issues/971#issuecomment-546390153
 
 
   Once you fix this, all is good
   
   ```
   $ ls -lR /tmp/amazon_reviews_hudi/
   total 0
   drwxr-xr-x  10 vchandar  wheel  320 Oct 25 07:58 US
   
   /tmp/amazon_reviews_hudi//US:
   total 3244416
   -rw-r--r--  1 vchandar  wheel  547148304 Oct 25 08:00 
57e83ba1-036b-41f4-ae84-30ae84bfa689-0_2-9-21_20191025075611.parquet
   -rw-r--r--  1 vchandar  wheel  547319837 Oct 25 08:00 
cefc04de-d880-4500-aaeb-267688f7f0a8-0_1-9-20_20191025075611.parquet
   -rw-r--r--  1 vchandar  wheel  547065620 Oct 25 08:00 
ff60519b-6beb-4f48-bb2d-17390cdd0e5e-0_0-9-19_20191025075611.parquet
   08:00:57 [amazon-reviews-dataset]$
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to