Thanks Raymond! That gives a lot of confidence. On Thu, Sep 5, 2019 at 6:39 PM Raymond Xu <[email protected]> wrote:
> Hi Vinoth, > > I've tested your branch with EMR 5.26 (amazon hadoop 2.8.5, spark 2.4.3) > and the json->avro->parquet works. Using the same test data as in the demo > folder. > Additional jars added: --jars > > jars/aws-java-sdk-core-1.10.34.jar,jars/aws-java-sdk-s3-1.10.34.jar,jars/hadoop-aws-2.8.5.jar > > Thank you. > > > On Tue, Sep 3, 2019 at 8:04 AM Vinoth Chandar <[email protected]> wrote: > > > Folks, > > > > Finally the redesigned bundles are up at > > https://github.com/apache/incubator-hudi/pull/873 > > <https://github.com/apache/incubator-hudi/pull/873> > > > > This reduces the amount of classes in the bundles 6.5x and thus reduces > > probability of class/jar mismatches as well. Currently, all the > integration > > tests and demo steps pass cleanly. > > > > I am looking into all issues aggregated at HUDI-159 and try to test more > > combinations. If you could test this with your setups or other > environments > > as well, report issues as subtasks in HUDI-159, send PRs to this branch, > > that would be great! > > > > > > /thanks/vinoth > > > > > -- > *Raymond Xu* > Sr. Software Engineer | Zendesk Singapore > LinkedIn <http://linkedin.com/in/xushiyan> | GitHub > <http://github.com/xushiyan> >
