[GitHub] [hudi] codejoyan commented on issue #2592: [SUPPORT] Does latest versions of Hudi (0.7.0, 0.6.0) work with Spark 2.3.0 when reading orc files?

2021-04-08 Thread GitBox
codejoyan commented on issue #2592: URL: https://github.com/apache/hudi/issues/2592#issuecomment-816012992 Please let me know if there are any suggestions to try out -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hudi] codejoyan commented on issue #2592: [SUPPORT] Does latest versions of Hudi (0.7.0, 0.6.0) work with Spark 2.3.0 when reading orc files?

2021-03-08 Thread GitBox
codejoyan commented on issue #2592: URL: https://github.com/apache/hudi/issues/2592#issuecomment-792916097 Unfortunately even after building the file and using `-Pspark-shade-unbundle-avro` I am running into the same issue. Am I missing anything **Build command:** `mvn

[GitHub] [hudi] codejoyan commented on issue #2592: [SUPPORT] Does latest versions of Hudi (0.7.0, 0.6.0) work with Spark 2.3.0 when reading orc files?

2021-03-06 Thread GitBox
codejoyan commented on issue #2592: URL: https://github.com/apache/hudi/issues/2592#issuecomment-791988738 Hi @umehrot2 I tried using `databricks-avro` along with `avro 1.7.7` and [avro 1.8.2](url) but I still get `NoSuchMethod` exceptions still. I am yet to try and build Hudi.

[GitHub] [hudi] codejoyan commented on issue #2592: [SUPPORT] Does latest versions of Hudi (0.7.0, 0.6.0) work with Spark 2.3.0 when reading orc files?

2021-03-02 Thread GitBox
codejoyan commented on issue #2592: URL: https://github.com/apache/hudi/issues/2592#issuecomment-789180761 Thanks @bvaradar This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hudi] codejoyan commented on issue #2592: [SUPPORT] Does latest versions of Hudi (0.7.0, 0.6.0) work with Spark 2.3.0 when reading orc files?

2021-02-25 Thread GitBox
codejoyan commented on issue #2592: URL: https://github.com/apache/hudi/issues/2592#issuecomment-786379571 This is the spark version of the cluster being used at work so I will have to use Spark 2.3 until there is an upgrade. Since the documentation says: **Hudi works with Spark-2.x**, I

[GitHub] [hudi] codejoyan commented on issue #2592: [SUPPORT] Does latest versions of Hudi (0.7.0, 0.6.0) work with Spark 2.3.0 when reading orc files?

2021-02-24 Thread GitBox
codejoyan commented on issue #2592: URL: https://github.com/apache/hudi/issues/2592#issuecomment-785121095 The below succeeds. I removed the decimal fields only and was able to save ``` scala> val inputDF = spark.read.format("csv").option("header",

[GitHub] [hudi] codejoyan commented on issue #2592: [SUPPORT] Does latest versions of Hudi (0.7.0, 0.6.0) work with Spark 2.3.0 when reading orc files?

2021-02-24 Thread GitBox
codejoyan commented on issue #2592: URL: https://github.com/apache/hudi/issues/2592#issuecomment-785036461 Sure @bvaradar . Below steps will help to reproduce. **Observation:** This is failing when the dataframe has specific datatypes. If it is string fields it succeeds