zhedoubushishi commented on pull request #1760: URL: https://github.com/apache/hudi/pull/1760#issuecomment-712391147
@bschell @vinothchandar to make clear, just wondering what is the exact goal for this pr? Do we want to make Hudi support both compile & run with spark 3 or we want to make Hudi compile with spark 2 and then run with spark3? Ideally we should make Hudi both compile and run with Spark3. But current code change cannot compile with spark 3. Run ``` mvn clean install -DskipTests -DskipITs -Dspark.version=3.0.0 -Pscala-2.12 ``` returns ``` [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.0:testCompile (default-testCompile) on project hudi-client: Compilation failure [ERROR] /Users/wenningd/workplace/Aws157Hudi/src/Aws157Hudi/hudi-client/src/test/java/org/apache/hudi/testutils/SparkDatasetTestUtils.java:[146,27] cannot find symbol [ERROR] symbol: method toRow(org.apache.spark.sql.Row) [ERROR] location: variable encoder of type org.apache.spark.sql.catalyst.encoders.ExpressionEncoder [ERROR] ``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
