Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

jonvex closed pull request #10278: [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark URL: https://github.com/apache/hudi/pull/10278 -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-2040498537 ## CI report: * 83064f1614c80f4ff518d05bf40563881ad12a5e Azure:

[PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

jonvex opened a new pull request, #10278: URL: https://github.com/apache/hudi/pull/10278 ### Change Logs - Create Spark Parquet reader inside of the reader context - Eliminate parquet reader map - Eliminate parallel implementation of setting up reader - Schema.on.read for

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

jonvex closed pull request #10278: [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark URL: https://github.com/apache/hudi/pull/10278 -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-2033098416 ## CI report: * 5d82fe635b49c83e18621b8286ba6682786b5a9a Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-2033013929 ## CI report: * bf216d4e4bd9a24d35cf45690dd46dd7bea5910b Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-2033004783 ## CI report: * bf216d4e4bd9a24d35cf45690dd46dd7bea5910b Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1979547904 ## CI report: * bf216d4e4bd9a24d35cf45690dd46dd7bea5910b Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1979388857 ## CI report: * 0e4131477b6ef94020e5e8f06848cb3d89d2a432 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1979376448 ## CI report: * 0e4131477b6ef94020e5e8f06848cb3d89d2a432 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1963037847 ## CI report: * 0e4131477b6ef94020e5e8f06848cb3d89d2a432 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1962996468 ## CI report: * c410c9ab8a8ea987b41a009a33157c387b06795a Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1962994316 ## CI report: * c410c9ab8a8ea987b41a009a33157c387b06795a Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1962992304 ## CI report: * c410c9ab8a8ea987b41a009a33157c387b06795a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1920709373 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 1dab0df80b70d0d70aabd57743d8681bce3c6ec1 UNKNOWN *

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1920569552 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * a926d67d3d519c49dcb7b8893671b312e1e5bcfd Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1920521605 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 1c6e22304b9f819aecd328fffe84394912daf763 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1920514612 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 1c6e22304b9f819aecd328fffe84394912daf763 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1920509429 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 1c6e22304b9f819aecd328fffe84394912daf763 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1920467036 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 1c6e22304b9f819aecd328fffe84394912daf763 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1920461859 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 1c6e22304b9f819aecd328fffe84394912daf763 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1920036189 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 1c6e22304b9f819aecd328fffe84394912daf763 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1919757002 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 4017aca3f1cc50f0a22d023d6c175fc0224bb2b1 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1919744970 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 4017aca3f1cc50f0a22d023d6c175fc0224bb2b1 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1919733841 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 4017aca3f1cc50f0a22d023d6c175fc0224bb2b1 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1919517087 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * a6973f9c50ba8fcc6485bc87a8107752988447eb Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1919432441 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * a6973f9c50ba8fcc6485bc87a8107752988447eb Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

jonvex commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1917113112 Azure CI all passing @yihua -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1915974411 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * dfb687aa6a2a353a93dd04d6a68eec1797103006 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

jonvex commented on code in PR #10278: URL: https://github.com/apache/hudi/pull/10278#discussion_r1470470333 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/common/table/read/TestSpark35RecordPositionMetadataColumn.scala: ## @@ -1,147 +0,0 @@ -/* Review

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1915722406 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * c95e415569c43fb60e97c4fb92b7df6fe833cf64 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1915713150 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * c95e415569c43fb60e97c4fb92b7df6fe833cf64 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1915705420 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * c95e415569c43fb60e97c4fb92b7df6fe833cf64 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1915533927 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 311548fb623934e115b27ec42bf155c484f71339 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1915463489 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 1f02516cda2e16c13c772a829f08da9095f3d357 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1915373820 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 1f02516cda2e16c13c772a829f08da9095f3d357 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1915363286 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 1f02516cda2e16c13c772a829f08da9095f3d357 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1915352131 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 1f02516cda2e16c13c772a829f08da9095f3d357 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1915273070 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 39f7d4b2e29686657f90a8dc497fb6093431f2dd Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1915260790 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 39f7d4b2e29686657f90a8dc497fb6093431f2dd Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1912868785 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 39f7d4b2e29686657f90a8dc497fb6093431f2dd Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1912836663 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 08bf472485a66fe6f4bf6dcc4e06d9bb73e4f1c5 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1912831173 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 08bf472485a66fe6f4bf6dcc4e06d9bb73e4f1c5 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1912515367 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 08bf472485a66fe6f4bf6dcc4e06d9bb73e4f1c5 Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1912446034 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * fdb71e85ea0fb072b58b2bab5bd437ec4baa89cc Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1912434268 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * fdb71e85ea0fb072b58b2bab5bd437ec4baa89cc Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1878172499 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * fdb71e85ea0fb072b58b2bab5bd437ec4baa89cc Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1878099983 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 3c22122ad33b3723ce67483e931074e7a68ad09b Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1878094940 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 3c22122ad33b3723ce67483e931074e7a68ad09b Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1877820601 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 3c22122ad33b3723ce67483e931074e7a68ad09b Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1877711212 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 321e96e848e0eac5c537ed5977c871f5f1696a7b Azure:

Re: [PR] [HUDI-7045] Create parquet readers inside the reader context and implement schema.on.read in the filegroup reader in spark [hudi]

hudi-bot commented on PR #10278: URL: https://github.com/apache/hudi/pull/10278#issuecomment-1877701158 ## CI report: * d98b47625ecada36364aa02aa1496dafd330c6a9 UNKNOWN * ab0b2127349325a3c939fe65da9d8caaac0da018 UNKNOWN * 321e96e848e0eac5c537ed5977c871f5f1696a7b Azure: