Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-12-08 Thread via GitHub
aajisaka commented on code in PR #9567: URL: https://github.com/apache/hudi/pull/9567#discussion_r1420258408 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieCopyOnWriteTableInputFormat.java: ## @@ -241,31 +246,86 @@ private List listStatusForSnapshotMode(JobConf

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-22 Thread via GitHub
nsivabalan commented on code in PR #9567: URL: https://github.com/apache/hudi/pull/9567#discussion_r1402761264 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieCopyOnWriteTableInputFormat.java: ## @@ -241,31 +246,86 @@ private List listStatusForSnapshotMode(JobConf

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-21 Thread via GitHub
codope merged PR #9567: URL: https://github.com/apache/hudi/pull/9567 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-21 Thread via GitHub
hudi-bot commented on PR #9567: URL: https://github.com/apache/hudi/pull/9567#issuecomment-1820441665 ## CI report: * 4bdf55f7a59cf71b49b3b1d0ad2100390cfbe440 Azure:

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-21 Thread via GitHub
hudi-bot commented on PR #9567: URL: https://github.com/apache/hudi/pull/9567#issuecomment-1820429742 ## CI report: * 4bdf55f7a59cf71b49b3b1d0ad2100390cfbe440 Azure:

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-20 Thread via GitHub
hudi-bot commented on PR #9567: URL: https://github.com/apache/hudi/pull/9567#issuecomment-1819061269 ## CI report: * 4bdf55f7a59cf71b49b3b1d0ad2100390cfbe440 Azure:

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-20 Thread via GitHub
hudi-bot commented on PR #9567: URL: https://github.com/apache/hudi/pull/9567#issuecomment-1818759365 ## CI report: * df459e2c9a77479fa90cca9128410e0b321983b7 Azure:

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-20 Thread via GitHub
hudi-bot commented on PR #9567: URL: https://github.com/apache/hudi/pull/9567#issuecomment-1818743398 ## CI report: * df459e2c9a77479fa90cca9128410e0b321983b7 Azure:

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-18 Thread via GitHub
aajisaka commented on PR #9567: URL: https://github.com/apache/hudi/pull/9567#issuecomment-1817451552 Thank you @codope for reviewing and rebasing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-17 Thread via GitHub
hudi-bot commented on PR #9567: URL: https://github.com/apache/hudi/pull/9567#issuecomment-1817428866 ## CI report: * df459e2c9a77479fa90cca9128410e0b321983b7 Azure:

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-17 Thread via GitHub
hudi-bot commented on PR #9567: URL: https://github.com/apache/hudi/pull/9567#issuecomment-1817408812 ## CI report: * 832a8a8ec2db4a97abc512fb80852d2470fdf527 Azure:

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-17 Thread via GitHub
hudi-bot commented on PR #9567: URL: https://github.com/apache/hudi/pull/9567#issuecomment-1817407499 ## CI report: * 832a8a8ec2db4a97abc512fb80852d2470fdf527 Azure:

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-17 Thread via GitHub
codope commented on code in PR #9567: URL: https://github.com/apache/hudi/pull/9567#discussion_r1398098171 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieCopyOnWriteTableInputFormat.java: ## @@ -241,31 +246,83 @@ private List listStatusForSnapshotMode(JobConf

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-17 Thread via GitHub
codope commented on code in PR #9567: URL: https://github.com/apache/hudi/pull/9567#discussion_r1398098171 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieCopyOnWriteTableInputFormat.java: ## @@ -241,31 +246,83 @@ private List listStatusForSnapshotMode(JobConf

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-17 Thread via GitHub
codope commented on code in PR #9567: URL: https://github.com/apache/hudi/pull/9567#discussion_r1398073060 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieCopyOnWriteTableInputFormat.java: ## @@ -241,31 +246,83 @@ private List listStatusForSnapshotMode(JobConf

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-17 Thread via GitHub
hudi-bot commented on PR #9567: URL: https://github.com/apache/hudi/pull/9567#issuecomment-1816368248 ## CI report: * 832a8a8ec2db4a97abc512fb80852d2470fdf527 Azure:

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-17 Thread via GitHub
hudi-bot commented on PR #9567: URL: https://github.com/apache/hudi/pull/9567#issuecomment-1816171455 ## CI report: * dfdb6c1c8457e96a5d827f41599f84ad36d0cfbe Azure:

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-17 Thread via GitHub
hudi-bot commented on PR #9567: URL: https://github.com/apache/hudi/pull/9567#issuecomment-1816158136 ## CI report: * bcdf9e6927f3fdceb1f8737b715810a45989c61a Azure:

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-17 Thread via GitHub
hudi-bot commented on PR #9567: URL: https://github.com/apache/hudi/pull/9567#issuecomment-1816084742 ## CI report: * bcdf9e6927f3fdceb1f8737b715810a45989c61a Azure:

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-17 Thread via GitHub
hudi-bot commented on PR #9567: URL: https://github.com/apache/hudi/pull/9567#issuecomment-1816072396 ## CI report: * bcdf9e6927f3fdceb1f8737b715810a45989c61a Azure:

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-17 Thread via GitHub
aajisaka commented on code in PR #9567: URL: https://github.com/apache/hudi/pull/9567#discussion_r1396959876 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieCopyOnWriteTableInputFormat.java: ## @@ -241,31 +246,83 @@ private List listStatusForSnapshotMode(JobConf

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-16 Thread via GitHub
hudi-bot commented on PR #9567: URL: https://github.com/apache/hudi/pull/9567#issuecomment-181450 ## CI report: * bcdf9e6927f3fdceb1f8737b715810a45989c61a Azure:

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-16 Thread via GitHub
hudi-bot commented on PR #9567: URL: https://github.com/apache/hudi/pull/9567#issuecomment-1814397987 ## CI report: * 343fd5daebfab8d1ce5b6451bb55452449c5549e Azure:

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-16 Thread via GitHub
hudi-bot commented on PR #9567: URL: https://github.com/apache/hudi/pull/9567#issuecomment-1814385060 ## CI report: * 343fd5daebfab8d1ce5b6451bb55452449c5549e Azure:

Re: [PR] [HUDI-6734] Add back HUDI-5409: Avoid file index and use fs view cache in COW input format [hudi]

2023-11-16 Thread via GitHub
codope commented on code in PR #9567: URL: https://github.com/apache/hudi/pull/9567#discussion_r1395622480 ## hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieCopyOnWriteTableInputFormat.java: ## @@ -241,31 +246,83 @@ private List listStatusForSnapshotMode(JobConf