Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-05-14 Thread via GitHub
szetszwo merged PR #6739: URL: https://github.com/apache/hadoop/pull/6739 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-05-14 Thread via GitHub
szetszwo commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2110845650 @steveloughran , thanks a lot for reviewing this! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-05-14 Thread via GitHub
szetszwo commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2110842717 > continuous-integration/jenkins/pr-head Pending — This commit is being built This has been stuck by `Windows Batch Script` for more than 22 hours. Since this passed all the

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-05-13 Thread via GitHub
hadoop-yetus commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2108804028 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-05-13 Thread via GitHub
szetszwo commented on code in PR #6739: URL: https://github.com/apache/hadoop/pull/6739#discussion_r1598897001 ## hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/crypto/TestCryptoUtils.java: ## @@ -0,0 +1,86 @@ +/* + * Licensed to the Apache Software

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-05-09 Thread via GitHub
hadoop-yetus commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2102051696 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-30 Thread via GitHub
steveloughran commented on code in PR #6739: URL: https://github.com/apache/hadoop/pull/6739#discussion_r1584770438 ## hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/crypto/TestCryptoUtils.java: ## @@ -0,0 +1,86 @@ +/* + * Licensed to the Apache Software

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-29 Thread via GitHub
hadoop-yetus commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2083295687 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-26 Thread via GitHub
steveloughran commented on code in PR #6739: URL: https://github.com/apache/hadoop/pull/6739#discussion_r1581033141 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/CryptoUtils.java: ## @@ -55,15 +58,18 @@ public static String

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-25 Thread via GitHub
hadoop-yetus commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2078071797 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-25 Thread via GitHub
szetszwo commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2077652244 Oops, just found that I accidentally changed the whitespaces in `TestCryptoCodec`. Let me revert them. -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-24 Thread via GitHub
hadoop-yetus commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2076112558 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-24 Thread via GitHub
szetszwo commented on code in PR #6739: URL: https://github.com/apache/hadoop/pull/6739#discussion_r1578474234 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/CryptoUtils.java: ## @@ -0,0 +1,81 @@ +/* + * Licensed to the Apache Software Foundation

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-24 Thread via GitHub
szetszwo commented on code in PR #6739: URL: https://github.com/apache/hadoop/pull/6739#discussion_r1578470256 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/CryptoUtils.java: ## @@ -0,0 +1,71 @@ +/* + * Licensed to the Apache Software Foundation

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-23 Thread via GitHub
hadoop-yetus commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2073325889 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-23 Thread via GitHub
steveloughran commented on code in PR #6739: URL: https://github.com/apache/hadoop/pull/6739#discussion_r1576632095 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/CryptoUtils.java: ## @@ -19,53 +19,63 @@ import

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-23 Thread via GitHub
szetszwo commented on code in PR #6739: URL: https://github.com/apache/hadoop/pull/6739#discussion_r1576476989 ## hadoop-common-project/hadoop-common/src/main/resources/core-default.xml: ## @@ -3625,7 +3625,19 @@ The switch to turn S3A auditing on or off. The JCE provider

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-23 Thread via GitHub
szetszwo commented on code in PR #6739: URL: https://github.com/apache/hadoop/pull/6739#discussion_r1576476164 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/CryptoUtils.java: ## @@ -0,0 +1,71 @@ +/* + * Licensed to the Apache Software Foundation

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-23 Thread via GitHub
hadoop-yetus commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2072565481 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| _ Prechecks

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-23 Thread via GitHub
steveloughran commented on code in PR #6739: URL: https://github.com/apache/hadoop/pull/6739#discussion_r1576126175 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/CryptoUtils.java: ## @@ -0,0 +1,71 @@ +/* + * Licensed to the Apache Software

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-22 Thread via GitHub
szetszwo commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2069920257 Let's do Alternative Approach 2 then. We could as welll add another conf to disable the existing hardcoded provider. -- This is an automated message from the Apache Git Service. To

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-22 Thread via GitHub
steveloughran commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2069888269 yeah, looks incompatible. I'd rather it supports switching, but the existing BC jar ships and everything works -- This is an automated message from the Apache Git Service. To

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-19 Thread via GitHub
ayushtkn commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2067367591 Passing by... To me Alt-1 looks functionally incompatible. As of today If my setup is working out of the box, I upgrade Hadoop, It will start giving me ``ClassNotFound``

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-19 Thread via GitHub
szetszwo commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2067272199 Let me clarify in more details: - Current code without any changes: - Force everyone to add the `bcprov-jdk18on` security provider - Current PR (remove `bcprov-jdk18on`

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-19 Thread via GitHub
szetszwo commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2067264884 > will this require changes everywhere? or will the default of bce still work? ... If we change it to use java reflection (similar to `fs.AbstractFileSystem.hdfs.impl`), then it

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-19 Thread via GitHub
steveloughran commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2067046232 will this require changes everywhere? or will the default of bce still work? as if it gives a choice, fine -just as long as it doesn't force that choice on everyone -- This is an

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-17 Thread via GitHub
szetszwo commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2061850531 @steveloughran , question to you: ```java +++ b/hadoop-common-project/hadoop-common/pom.xml @@ -375,6 +375,7 @@ org.bouncycastle bcprov-jdk18on +

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-17 Thread via GitHub
szetszwo commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2061830741 > ... Actually, I think it was minihdfs which needed it for tests, rather than the actual code Yes, there are many tests requiring `BouncyCastle`. They were not changed in the

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-17 Thread via GitHub
steveloughran commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2061803874 > hadoop-azure seems okay? The tests did not fail. we'd have to see about the integration tests. Actually, I think it was minihdfs which needed it for tests, rather than the

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-17 Thread via GitHub
szetszwo commented on code in PR #6739: URL: https://github.com/apache/hadoop/pull/6739#discussion_r1569133307 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/KeyProvider.java: ## @@ -35,7 +34,6 @@ import java.util.Map; import

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-16 Thread via GitHub
hadoop-yetus commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2060278478 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-16 Thread via GitHub
szetszwo commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2060158389 > there are downstream modules which depend on bc from hadoop common. they need to be adjusted so their poms declare explicit use. ... It make sense for the downstream modules

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-16 Thread via GitHub
szetszwo commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2060155541 > the pr cuts out all bouncy castle init. What will break? @steveloughran , thanks for looking at this! As mentioned in `core-default.xml`, could we ask admin to set

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-16 Thread via GitHub
hadoop-yetus commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2060001044 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-16 Thread via GitHub
hadoop-yetus commented on PR #6739: URL: https://github.com/apache/hadoop/pull/6739#issuecomment-2059994340 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: |

Re: [PR] HADOOP-19152. Do not hard code security providers. [hadoop]

2024-04-16 Thread via GitHub
steveloughran commented on code in PR #6739: URL: https://github.com/apache/hadoop/pull/6739#discussion_r1567940219 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/KeyProvider.java: ## @@ -35,7 +34,6 @@ import java.util.Map; import