[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1342: [SUPPORT] do cow tables need to be converted when changing from hoodie to hudi?
lamber-ken edited a comment on issue #1342: [SUPPORT] do cow tables need to be converted when changing from hoodie to hudi? URL: https://github.com/apache/incubator-hudi/issues/1342#issuecomment-588567557 hi @tooptoop4, I test it in my local env. No need to run any convert utility. **Notice:** - Change `com.uber.hoodie` to `org.apache.hudi` - Better to improve spark to 2.4.4 version - Add `org.apache.spark:spark-avro_2.11:2.4.4` to start command ``` bin/spark-shell \ --packages org.apache.hudi:hudi-spark-bundle_2.11:0.5.1-incubating,org.apache.spark:spark-avro_2.11:2.4.4 \ --conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer' ``` More, from `0.4.6` to `0.5.1` is a big version change, I suggest that you'd better test it with some old cow tables in your environment too. If you meet some issue, you can ask us at any time. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1342: [SUPPORT] do cow tables need to be converted when changing from hoodie to hudi?
lamber-ken edited a comment on issue #1342: [SUPPORT] do cow tables need to be converted when changing from hoodie to hudi? URL: https://github.com/apache/incubator-hudi/issues/1342#issuecomment-588567557 hi @tooptoop4, I test it in my local env. No need to run any convert utility. **Notice:** - Change `com.uber.hoodie` to `org.apache.hudi` - Better to improve spark to 2.4.4 version - Add `org.apache.spark:spark-avro_2.11:2.4.4` to start command ``` bin/spark-shell \ --packages org.apache.hudi:hudi-spark-bundle_2.11:0.5.1-incubating,org.apache.spark:spark-avro_2.11:2.4.4 \ --conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer' ``` More, from `0.4.6` to `0.5.1` is a big version change, I suggest that you'd better test it with some old cow tables in your environment. If you meet some issue, you can ask us at any time. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1342: [SUPPORT] do cow tables need to be converted when changing from hoodie to hudi?
lamber-ken edited a comment on issue #1342: [SUPPORT] do cow tables need to be converted when changing from hoodie to hudi? URL: https://github.com/apache/incubator-hudi/issues/1342#issuecomment-588567557 hi @tooptoop4, I test it in my local env. No need to run any convert utility. **Notice:** - Change `com.uber.hoodie` to `org.apache.hudi` - Better to improve spark to 2.4.4 version - Add `org.apache.spark:spark-avro_2.11:2.4.4` to start command ``` bin/spark-shell \ --packages org.apache.hudi:hudi-spark-bundle_2.11:0.5.1-incubating,org.apache.spark:spark-avro_2.11:2.4.4 \ --conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer' ``` More, from `0.4.6` to `0.5.1` is a big version change, I suggest that you'd better test it with some old cow tables in your environment. If you meet some issue, you can ask us at any time. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
