[jira] [Comment Edited] (HADOOP-18991) Remove commons-benautils dependency from Hadoop 3
[ https://issues.apache.org/jira/browse/HADOOP-18991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17790912#comment-17790912 ] Istvan Toth edited comment on HADOOP-18991 at 11/29/23 6:35 AM: It comes down policy. If we want projects/versions that have problematic dependency handling, like Hive 3.1.3, to build with future Hadoop 3.x version out of the box then we cannot remove this dependency. Taken to the extreme, this would also mean that we cannot remove any dependencies from Hadoop in a minor version, ever. I can see how this is not an easy decision. was (Author: stoty): It comes down policy. If we want projects that have problematic dependency handling, like Hive 3.1.3, to build with future Hadoop 3.x version out of the box then we cannot remove this dependency. Taken to the extreme, this would also mean that we cannot remove any dependencies from Hadoop in a minor version, ever. I can see how this is not an easy decision. > Remove commons-benautils dependency from Hadoop 3 > - > > Key: HADOOP-18991 > URL: https://issues.apache.org/jira/browse/HADOOP-18991 > Project: Hadoop Common > Issue Type: Improvement > Components: common >Reporter: Istvan Toth >Priority: Major > > Hadoop doesn't acually use it, and it pollutes the classpath of dependent > projects. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (HADOOP-18991) Remove commons-benautils dependency from Hadoop 3
[ https://issues.apache.org/jira/browse/HADOOP-18991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17790912#comment-17790912 ] Istvan Toth edited comment on HADOOP-18991 at 11/29/23 6:30 AM: It comes down policy. If we want projects that have problematic dependency handling, like Hive 3.1.3, to build with future Hadoop version out of the box then we cannot remove this dependency. Taken to the extreme, this would also mean that we cannot remove any dependencies from Hadoop in a minor version, ever. I can see how this is not an easy decision. was (Author: stoty): It comes down policy. If we want projects that have problematic dependency handling, like Hive 3.1.3, to build with future Hadoop version out of the box then we cannot remove this dependency. Taken to the extreme, this would also mean that we cannot remove any dependencies from Hadoop, ever. I can see how this is not an easy decision. > Remove commons-benautils dependency from Hadoop 3 > - > > Key: HADOOP-18991 > URL: https://issues.apache.org/jira/browse/HADOOP-18991 > Project: Hadoop Common > Issue Type: Improvement > Components: common >Reporter: Istvan Toth >Priority: Major > > Hadoop doesn't acually use it, and it pollutes the classpath of dependent > projects. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (HADOOP-18991) Remove commons-benautils dependency from Hadoop 3
[ https://issues.apache.org/jira/browse/HADOOP-18991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17790912#comment-17790912 ] Istvan Toth edited comment on HADOOP-18991 at 11/29/23 6:30 AM: It comes down policy. If we want projects that have problematic dependency handling, like Hive 3.1.3, to build with future Hadoop 3.x version out of the box then we cannot remove this dependency. Taken to the extreme, this would also mean that we cannot remove any dependencies from Hadoop in a minor version, ever. I can see how this is not an easy decision. was (Author: stoty): It comes down policy. If we want projects that have problematic dependency handling, like Hive 3.1.3, to build with future Hadoop version out of the box then we cannot remove this dependency. Taken to the extreme, this would also mean that we cannot remove any dependencies from Hadoop in a minor version, ever. I can see how this is not an easy decision. > Remove commons-benautils dependency from Hadoop 3 > - > > Key: HADOOP-18991 > URL: https://issues.apache.org/jira/browse/HADOOP-18991 > Project: Hadoop Common > Issue Type: Improvement > Components: common >Reporter: Istvan Toth >Priority: Major > > Hadoop doesn't acually use it, and it pollutes the classpath of dependent > projects. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-18991) Remove commons-benautils dependency from Hadoop 3
[ https://issues.apache.org/jira/browse/HADOOP-18991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17790916#comment-17790916 ] Istvan Toth commented on HADOOP-18991: -- [~vjasani] Kind of. When Omid was added to Phoenix (or sometime later), then the decision was made to exlude its commons-beanutils dependency, and use Hadoop's. Knowing that the Hadoop beanutils dependency is a bug, it was a bad decision, but this is not exactly common knowledge. Maybe Omid just used an old version, and the newer one from Hadoop was chosen. (It may have even been me who added that exclusion, I didn't check) > Remove commons-benautils dependency from Hadoop 3 > - > > Key: HADOOP-18991 > URL: https://issues.apache.org/jira/browse/HADOOP-18991 > Project: Hadoop Common > Issue Type: Improvement > Components: common >Reporter: Istvan Toth >Priority: Major > > Hadoop doesn't acually use it, and it pollutes the classpath of dependent > projects. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-18991) Remove commons-benautils dependency from Hadoop 3
[ https://issues.apache.org/jira/browse/HADOOP-18991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17790912#comment-17790912 ] Istvan Toth commented on HADOOP-18991: -- It comes down policy. If we want projects that have problematic dependency handling, like Hive 3.1.3, to build with future Hadoop version out of the box then we cannot remove this dependency. Taken to the extreme, this would also mean that we cannot remove any dependencies from Hadoop, ever. I can see how this is not an easy decision. > Remove commons-benautils dependency from Hadoop 3 > - > > Key: HADOOP-18991 > URL: https://issues.apache.org/jira/browse/HADOOP-18991 > Project: Hadoop Common > Issue Type: Improvement > Components: common >Reporter: Istvan Toth >Priority: Major > > Hadoop doesn't acually use it, and it pollutes the classpath of dependent > projects. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-18991) Remove commons-benautils dependency from Hadoop 3
[ https://issues.apache.org/jira/browse/HADOOP-18991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17790905#comment-17790905 ] Istvan Toth commented on HADOOP-18991: -- Can you point to that ticket, [~ayushtkn] ? > Remove commons-benautils dependency from Hadoop 3 > - > > Key: HADOOP-18991 > URL: https://issues.apache.org/jira/browse/HADOOP-18991 > Project: Hadoop Common > Issue Type: Improvement > Components: common >Reporter: Istvan Toth >Priority: Major > > Hadoop doesn't acually use it, and it pollutes the classpath of dependent > projects. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-18991) Remove commons-benautils dependency from Hadoop 3
[ https://issues.apache.org/jira/browse/HADOOP-18991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17790903#comment-17790903 ] Istvan Toth commented on HADOOP-18991: -- Hive dependency managemet is not great. We also had to add a bunch of transitive depencies as explicit ones when removing the HBase libs from the Hive distribution. > Remove commons-benautils dependency from Hadoop 3 > - > > Key: HADOOP-18991 > URL: https://issues.apache.org/jira/browse/HADOOP-18991 > Project: Hadoop Common > Issue Type: Improvement > Components: common >Reporter: Istvan Toth >Priority: Major > > Hadoop doesn't acually use it, and it pollutes the classpath of dependent > projects. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-18992) SingleCluster.html instructions are ordered incorrectly
Istvan Toth created HADOOP-18992:
Summary: SingleCluster.html instructions are ordered incorrectly
Key: HADOOP-18992
URL: https://issues.apache.org/jira/browse/HADOOP-18992
Project: Hadoop Common
Issue Type: Bug
Components: documentation, website
Affects Versions: 3.3.6
Reporter: Istvan Toth
I was going over the pesudo distributed cluster instructions at
https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/SingleCluster.html#Pseudo-Distributed_Operation
The smoke test instructions direct you to execute a mapreduce job
{noformat}
$ bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-3.3.6.jar
grep input output 'dfs[a-z.]+'
{noformat}
but at this point Yarn hasn't been started, the instructions for that are in
the next section.
Switch the YARN setup section and the smoke test section.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-18991) Remove commons-benautils dependency from Hadoop 3
[ https://issues.apache.org/jira/browse/HADOOP-18991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17790002#comment-17790002 ] Istvan Toth commented on HADOOP-18991: -- This issues is discussed in HADOOP-16542 . > Remove commons-benautils dependency from Hadoop 3 > - > > Key: HADOOP-18991 > URL: https://issues.apache.org/jira/browse/HADOOP-18991 > Project: Hadoop Common > Issue Type: Bug > Components: common >Reporter: Istvan Toth >Priority: Major > > Hadoop doesn't acually use it, and it pollutes the classpath of dependent > projects. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-18277) Remove org.apache.hadoop.test#Whitebox Class
[ https://issues.apache.org/jira/browse/HADOOP-18277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1778#comment-1778 ] Istvan Toth commented on HADOOP-18277: -- IMO it would be prefereable not not to use org.apache.commons.beanutils.BeanUtils . It would be be better to remove it from the Hadoop dependencies. > Remove org.apache.hadoop.test#Whitebox Class > > > Key: HADOOP-18277 > URL: https://issues.apache.org/jira/browse/HADOOP-18277 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Shilun Fan >Assignee: Shilun Fan >Priority: Minor > > org.apache.hadoop.test#Whitebox is marked as deprecated, I personally feel > that this is unnecessary, which leads to a large number of junit test code > appearing deprecated, and a large number of Warnings appear in the > compilation, I checked the code and think the deprecated mark is unreasonable. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-18991) Remove commons-benautils dependency from Hadoop 3
Istvan Toth created HADOOP-18991: Summary: Remove commons-benautils dependency from Hadoop 3 Key: HADOOP-18991 URL: https://issues.apache.org/jira/browse/HADOOP-18991 Project: Hadoop Common Issue Type: Bug Components: common Reporter: Istvan Toth Hadoop doesn't acually use it, and it pollutes the classpath of dependent projects. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
