Re: Strange exception after upgrade to 0.4.7

2019-05-29 Thread Vinoth Chandar
Also curious if this error does not happen with 0.4.6? Can you please confirm that? It would be helpful to narrow it down On Wed, May 29, 2019 at 6:25 PM vbal...@apache.org wrote: > Hi Yuanbin, > > Not sure if I completely understood the problem. Are you using > "com.uber.hoodie" format for rea

Re: Strange exception after upgrade to 0.4.7

2019-05-29 Thread vbal...@apache.org
Hi Yuanbin, Not sure if I completely understood the problem. Are you using "com.uber.hoodie" format for reading the dataset ? Are you using hoodie-spark-bundle ? >From the stack overflow link,  >https://stackoverflow.com/questions/48034825/why-does-streaming-query-fail-with-invalidschemaexcepti

Strange exception after upgrade to 0.4.7

2019-05-29 Thread FIXED-TERM Cheng Yuanbin (CR/PJ-AI-S1)
All, After we upgrade to the new release 0.4.7. One strange exception occurred when we read the com.uber.hoodie dataset from parquet. This exception never occurred in the previous version. I am so appreciate if anyone can help me locate this exception. Here I attach part of the exception log. A

Re: Read RO table in Spark as hive table | No records returned

2019-05-29 Thread nishith agarwal
Thanks for the details Satish. 1. I am using the Multi partition data - There is an option in HiveSyncTool to use multi-partitioning : --partition-value-extractor which you can use to have a custom partition extractor. 2 As I am using spark ,I can get the partition added by querying on dataset an