kingkongpoon opened a new issue #2528:
URL: https://github.com/apache/hudi/issues/2528
My Spark code ( the data is correct)
```
spark.read.format("hudi").load(basePath + "/*/*").show()
```
```
+-------------------+--------------------+------------------+----------------------+--------------------+----+-------------+---+---+---+------------------+
|_hoodie_commit_time|_hoodie_commit_seqno|_hoodie_record_key|_hoodie_partition_path|
_hoodie_file_name|uuid|partitionpath| ts| v1| t2|_hoodie_is_deleted|
+-------------------+--------------------+------------------+----------------------+--------------------+----+-------------+---+---+---+------------------+
| 20210203152814| 20210203152814_0_2| uuid:1|
1/2|2d7db568-1b83-449...| 1| 2| 21| 5a| 5a| false|
| 20210203152814| 20210203152814_1_1| uuid:4|
4/5|f25e8ffc-fc64-44b...| 4| 5| 19| 4| 4| false|
+-------------------+--------------------+------------------+----------------------+--------------------+----+-------------+---+---+---+------------------+
```
Hive( the data is correct)
```
hive> select * from member1;
OK
20210203152814 20210203152814_0_2 uuid:1 1/2
2d7db568-1b83-449a-b6d1-a85b855c56d8-0_0-26-59_20210203152814.parquet 21
5a 5a false 1 2
20210203152814 20210203152814_1_1 uuid:4 4/5
f25e8ffc-fc64-44b5-a8af-e3ce889d1d6c-0_1-26-60_20210203152814.parquet 19
4 4 false 4 5
Time taken: 0.086 seconds, Fetched: 2 row(s)
hive> show session;
```
Spark read hive by metastore( the data is wrong)
```
...
.config("hive.metastore.uris", "thrift://node1:9083")
...
spark.sql("select * from default.member1").show()
```
```
+-------------------+--------------------+------------------+----------------------+--------------------+---+---+---+------------------+----+-------------+
|_hoodie_commit_time|_hoodie_commit_seqno|_hoodie_record_key|_hoodie_partition_path|
_hoodie_file_name| ts| v1| t2|_hoodie_is_deleted|uuid|partitionpath|
+-------------------+--------------------+------------------+----------------------+--------------------+---+---+---+------------------+----+-------------+
| 20210203152205| 20210203152205_0_2| uuid:1|
1/2|2d7db568-1b83-449...| 21| 5a| 5a| false| 1| 2|
| 20210203152715| 20210203152715_0_2| uuid:1|
1/2|2d7db568-1b83-449...| 21| 5a| 5a| false| 1| 2|
| 20210203152751| 20210203152751_0_2| uuid:1|
1/2|2d7db568-1b83-449...| 21| 5a| 5a| false| 1| 2|
| 20210203152814| 20210203152814_0_2| uuid:1|
1/2|2d7db568-1b83-449...| 21| 5a| 5a| false| 1| 2|
| 20210203151223| 20210203151223_2_2| uuid:1|
1/2|2d7db568-1b83-449...| 21| 5a| 5a| false| 1| 2|
| 20210203151223| 20210203151223_1_1| uuid:4|
4/5|f25e8ffc-fc64-44b...| 19| 4| 4| false| 4| 5|
| 20210203152205| 20210203152205_1_1| uuid:4|
4/5|f25e8ffc-fc64-44b...| 19| 4| 4| false| 4| 5|
| 20210203152715| 20210203152715_1_1| uuid:4|
4/5|f25e8ffc-fc64-44b...| 19| 4| 4| false| 4| 5|
| 20210203152814| 20210203152814_1_1| uuid:4|
4/5|f25e8ffc-fc64-44b...| 19| 4| 4| false| 4| 5|
| 20210203152751| 20210203152751_1_1| uuid:4|
4/5|f25e8ffc-fc64-44b...| 19| 4| 4| false| 4| 5|
+-------------------+--------------------+------------------+----------------------+--------------------+---+---+---+------------------+----+-------------+
```
it seems that all files can be read ??
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
