vinothchandar commented on pull request #1848: URL: https://github.com/apache/hudi/pull/1848#issuecomment-669719178
@bvaradar @garyli1019 I laid out the data from the test output here https://gist.github.com/vinothchandar/28cee665c36f806b562efc88821c9061 if you notice, the compaction here succeeded ``` LocatedFileStatus{path=file:/tmp/junit4111271187227693299/dataset/.hoodie/20200805162410.commit; isDirectory=false; length=7224; replication=1; blocksize=33554432; modification_time=1596644652000; access_time=0; owner=travis; group=travis; permission=rw-r--r--; isSymlink=false}, ``` I can see marker files. (but why though, should nt they be deleted if the commit is successful, guess that a question for me) even. but no new base files. ``` LocatedFileStatus{path=file:/tmp/junit4111271187227693299/dataset/.hoodie/.temp/20200805162410/datestr=2020%252F04%252F03/4024aaba-eb81-4c3d-8571-993637dbc16d_5-794-5016_20200805162410.parquet.marker.MERGE; isDirectory=false; length=0; replication=1; blocksize=33554432; modification_time=1596644651000; access_time=0; owner=travis; group=travis; permission=rw-r--r--; isSymlink=false}, LocatedFileStatus{path=file:/tmp/junit4111271187227693299/dataset/.hoodie/.temp/20200805162410/datestr=2020%252F04%252F03/afdb1be6-9dd3-4606-9441-e1e4eb771998_0-794-5011_20200805162410.parquet.marker.MERGE; isDirectory=false; length=0; replication=1; blocksize=33554432; modification_time=1596644651000; access_time=0; owner=travis; group=travis; permission=rw-r--r--; isSymlink=false}, LocatedFileStatus{path=file:/tmp/junit4111271187227693299/dataset/.hoodie/.temp/20200805162410/datestr=2020%252F04%252F01/01fb19fe-d0cc-43d1-806d-b5e48bb806b3_3-794-5014_20200805162410.parquet.marker.MERGE; isDirectory=false; length=0; replication=1; blocksize=33554432; modification_time=1596644651000; access_time=0; owner=travis; group=travis; permission=rw-r--r--; isSymlink=false}, LocatedFileStatus{path=file:/tmp/junit4111271187227693299/dataset/.hoodie/.temp/20200805162410/datestr=2020%252F04%252F01/28ce1ffe-d00a-45fc-88f1-ec6705544c08_1-794-5012_20200805162410.parquet.marker.MERGE; isDirectory=false; length=0; replication=1; blocksize=33554432; modification_time=1596644651000; access_time=0; owner=travis; group=travis; permission=rw-r--r--; isSymlink=false}, LocatedFileStatus{path=file:/tmp/junit4111271187227693299/dataset/.hoodie/.temp/20200805162410/datestr=2020%252F04%252F02/765cbc30-12b7-4e81-afd3-c0a0f8d7a41d_2-794-5013_20200805162410.parquet.marker.MERGE; isDirectory=false; length=0; replication=1; blocksize=33554432; modification_time=1596644651000; access_time=0; owner=travis; group=travis; permission=rw-r--r--; isSymlink=false}, LocatedFileStatus{path=file:/tmp/junit4111271187227693299/dataset/.hoodie/.temp/20200805162410/datestr=2020%252F04%252F02/b93eb05a-36af-40a5-86f4-d7c3159991f4_4-794-5015_20200805162410.parquet.marker.MERGE; isDirectory=false; length=0; replication=1; blocksize=33554432; modification_time=1596644651000; access_time=0; owner=travis; group=travis; permission=rw-r--r--; isSymlink=false}, ``` seems like a legit issue to me. cannot imagine how it can happen though ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
