fx19880617 opened a new pull request #5218: Fix HDFS copy logic URL: https://github.com/apache/incubator-pinot/pull/5218 Current hdfs cp will copy all the files from src dir to dest dir as a flatten layout. This fix will ensure the dest directory could retain the same structure as src directory. For HadoopPinotFS.copy(src,dest) behavior: Before: ``` src/2014/01/01/myTable.avro src/2014/01/02/myTable.avro src/2014/01/03/myTable.avro src/2014/01/04/myTable.avro ``` => ``` dest/myTable.avro ``` New logic: ``` src/2014/01/01/myTable.avro src/2014/01/02/myTable.avro src/2014/01/03/myTable.avro src/2014/01/04/myTable.avro ``` => ``` dest/2014/01/01/myTable.avro dest/2014/01/02/myTable.avro dest/2014/01/03/myTable.avro dest/2014/01/04/myTable.avro ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
