maytasm commented on PR #13612: URL: https://github.com/apache/druid/pull/13612#issuecomment-1378316965
> LGTM. > > Can we add a test/tests where multiple files are ingested with one parquet file having a different than the other parquet file. The schema difference could be because of a column add/drop, column rename etc. You would likely need to tweak the TransformSpec in your test to handle renamed columns. @samarthjain Added an integration test with reading parquet files with multiple different schemas. ``` File 1's columns: userRenamed, continent, country, added, deleted, deltaRenamed File 2's columns: user, continentRenamed, country, added, delta File 3's columns: user, continent, countryRenamed, deleted, delta ``` We have column renamed like column `user` is renamed to `userRenamed` in File 1. We also have columns dropped/added, where column `added` is dropped in File 3 and column `deleted` is dropped in File 2. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
