Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2024-01-30 Thread via GitHub
steveloughran merged PR #6144: URL: https://github.com/apache/hadoop/pull/6144 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2024-01-29 Thread via GitHub
hadoop-yetus commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1915921653 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2024-01-29 Thread via GitHub
hadoop-yetus commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1915611296 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2024-01-29 Thread via GitHub
steveloughran commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1915231977 thanks. not sure what is up with docker. will rebase and force push with test run -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2024-01-29 Thread via GitHub
hadoop-yetus commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1915042017 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2024-01-29 Thread via GitHub
steveloughran commented on code in PR #6144: URL: https://github.com/apache/hadoop/pull/6144#discussion_r1469632159 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/select/ITestSelectUnsupported.java: ## @@ -0,0 +1,100 @@ +/* + * Licensed to the Apache Software

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2024-01-25 Thread via GitHub
ahmarsuhail commented on code in PR #6144: URL: https://github.com/apache/hadoop/pull/6144#discussion_r1466371581 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/select/package-info.java: ## @@ -17,7 +17,12 @@ */ /** - * Support for S3 Select. + * Was the

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2024-01-24 Thread via GitHub
steveloughran commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1908714315 @ahmarsuhail @mukund-thakur can I get this in? it'll help on test time... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2024-01-05 Thread via GitHub
hadoop-yetus commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1879075825 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2024-01-05 Thread via GitHub
steveloughran commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1878842405 rebased pr with retest. failures unrelated; the signing one has an active pr to fix, the committer one looks like my config is at fault (bucket overrides not being cut) ```

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2023-12-09 Thread via GitHub
hadoop-yetus commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1848422873 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2023-12-08 Thread via GitHub
steveloughran commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1847657341 latest change is just a rebase; not retested -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2023-11-14 Thread via GitHub
hadoop-yetus commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1809917406 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2023-10-21 Thread via GitHub
hadoop-yetus commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1773995577 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2023-10-20 Thread via GitHub
hadoop-yetus commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1772223357 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2023-10-19 Thread via GitHub
steveloughran commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1771335503 keeping but moving csv file. it's actually very useful in places; in cloudstore we use it in places like "bandwidth" to track block upload times. so it may be useful in

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2023-10-18 Thread via GitHub
steveloughran commented on code in PR #6144: URL: https://github.com/apache/hadoop/pull/6144#discussion_r1363570103 ## hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/index.md: ## @@ -35,7 +35,6 @@ full details. * [Encryption](./encryption.html) *

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2023-10-17 Thread via GitHub
ahmarsuhail commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1766391559 And agree with your comment, should cut `org.apache.hadoop.fs.s3a.select.BlockingEnumeration` and add the commit to the package-info. -- This is an automated message from the

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2023-10-17 Thread via GitHub
ahmarsuhail commented on code in PR #6144: URL: https://github.com/apache/hadoop/pull/6144#discussion_r1362087831 ## hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/index.md: ## @@ -35,7 +35,6 @@ full details. * [Encryption](./encryption.html) *

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2023-10-11 Thread via GitHub
hadoop-yetus commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1757656449 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2023-10-10 Thread via GitHub
hadoop-yetus commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1755466189 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2023-10-09 Thread via GitHub
steveloughran commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1753482819 with this PR * all s3 select code is stripped * all imports of its classes are gone * docs say this * path capability returns false * openFile with select options raise

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2023-10-09 Thread via GitHub
steveloughran commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1753472645 Tested s3 london `Dparallel-tests -DtestsThreadCount=10 -Dscale -Dprefetch` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2023-10-02 Thread via GitHub
hadoop-yetus commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1743650238 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-18830. Cut S3 Select [hadoop]

2023-10-02 Thread via GitHub
steveloughran commented on PR #6144: URL: https://github.com/apache/hadoop/pull/6144#issuecomment-1743442467 Given I wrote this it's kind of sad, but openFile() will outlive it as it has many more uses. -- This is an automated message from the Apache Git Service. To respond to the

[PR] HADOOP-18830-cut-s3-select [hadoop]

2023-10-02 Thread via GitHub
steveloughran opened a new pull request, #6144: URL: https://github.com/apache/hadoop/pull/6144 Cut out S3 Select * leave public/unstable constants alone * s3guard tool will fail with error * s3afs. path capability will fail * openFile() will fail with specific error * s3