Vaibhav Sinha created HUDI-1850:
-----------------------------------
Summary: Read on table fails if the first write to table failed
Key: HUDI-1850
URL: https://issues.apache.org/jira/browse/HUDI-1850
Project: Apache Hudi
Issue Type: Bug
Affects Versions: 0.8.0
Reporter: Vaibhav Sinha
Attachments: Screenshot 2021-04-24 at 7.53.22 PM.png
{code:java}
ava.util.NoSuchElementException: No value present in Option
at org.apache.hudi.common.util.Option.get(Option.java:88)
~[hudi-spark3-bundle_2.12-0.8.0.jar:0.8.0]
at
org.apache.hudi.common.table.TableSchemaResolver.getTableSchemaFromCommitMetadata(TableSchemaResolver.java:215)
~[hudi-spark3-bundle_2.12-0.8.0.jar:0.8.0]
at
org.apache.hudi.common.table.TableSchemaResolver.getTableAvroSchema(TableSchemaResolver.java:166)
~[hudi-spark3-bundle_2.12-0.8.0.jar:0.8.0]
at
org.apache.hudi.common.table.TableSchemaResolver.getTableAvroSchema(TableSchemaResolver.java:155)
~[hudi-spark3-bundle_2.12-0.8.0.jar:0.8.0]
at
org.apache.hudi.MergeOnReadSnapshotRelation.<init>(MergeOnReadSnapshotRelation.scala:65)
~[hudi-spark3-bundle_2.12-0.8.0.jar:0.8.0]
at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:99)
~[hudi-spark3-bundle_2.12-0.8.0.jar:0.8.0]
at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:63)
~[hudi-spark3-bundle_2.12-0.8.0.jar:0.8.0]
at
org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:354)
~[spark-sql_2.12-3.1.1.jar:3.1.1]
at
org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:326)
~[spark-sql_2.12-3.1.1.jar:3.1.1]
at
org.apache.spark.sql.DataFrameReader.$anonfun$load$3(DataFrameReader.scala:308)
~[spark-sql_2.12-3.1.1.jar:3.1.1]
at scala.Option.getOrElse(Option.scala:189)
~[scala-library-2.12.10.jar:?]
at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:308)
~[spark-sql_2.12-3.1.1.jar:3.1.1]
at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:240)
~[spark-sql_2.12-3.1.1.jar:3.1.1]
{code}
The screenshot shows the files that got created before the write had failed.
!Screenshot 2021-04-24 at 7.53.22 PM.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
