Hi Vinoth, I've tested your branch with EMR 5.26 (amazon hadoop 2.8.5, spark 2.4.3) and the json->avro->parquet works. Using the same test data as in the demo folder. Additional jars added: --jars jars/aws-java-sdk-core-1.10.34.jar,jars/aws-java-sdk-s3-1.10.34.jar,jars/hadoop-aws-2.8.5.jar
Thank you. On Tue, Sep 3, 2019 at 8:04 AM Vinoth Chandar <[email protected]> wrote: > Folks, > > Finally the redesigned bundles are up at > https://github.com/apache/incubator-hudi/pull/873 > <https://github.com/apache/incubator-hudi/pull/873> > > This reduces the amount of classes in the bundles 6.5x and thus reduces > probability of class/jar mismatches as well. Currently, all the integration > tests and demo steps pass cleanly. > > I am looking into all issues aggregated at HUDI-159 and try to test more > combinations. If you could test this with your setups or other environments > as well, report issues as subtasks in HUDI-159, send PRs to this branch, > that would be great! > > > /thanks/vinoth > -- *Raymond Xu* Sr. Software Engineer | Zendesk Singapore LinkedIn <http://linkedin.com/in/xushiyan> | GitHub <http://github.com/xushiyan>
