[GitHub] [incubator-hudi] prashanthpdesai commented on issue #661: Tracking ticket for reporting Hudi usages from the community

2020-05-21 Thread GitBox 


prashanthpdesai commented on issue #661:
URL: https://github.com/apache/incubator-hudi/issues/661#issuecomment-632311231


   @vinothchandar : sure , yes we are still in pre prod . 
   
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [incubator-hudi] prashanthpdesai commented on issue #661: Tracking ticket for reporting Hudi usages from the community

2020-05-21 Thread GitBox 


prashanthpdesai commented on issue #661:
URL: https://github.com/apache/incubator-hudi/issues/661#issuecomment-632263515


   we are trying to use HUDI Deltastreamer to read from compacted Kafka topic 
in production environment and pull the messages incrementally, tried initially 
with MOR with continuous mode of streamer faced small file issue , now planning 
to run it in minbatch(every 2 hours) with COPY_ON_WRITE to avoid compaction 
etc. we are facing offsetoutofrange exception.  



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org