[jira] [Resolved] (HADOOP-9522) web interfaces are not logged until after opening

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-9522.
--
Resolution: Won't Fix

> web interfaces are not logged until after opening
> -
>
> Key: HADOOP-9522
> URL: https://issues.apache.org/jira/browse/HADOOP-9522
> Project: Hadoop Common
>  Issue Type: Improvement
>Affects Versions: 2.0.4-alpha
>Reporter: Allen Wittenauer
>Priority: Major
>
> If one mis-configures certain interfaces (in my case 
> yarn.resourcemanager.webapp.address), neither Hadoop nor jetty throws any 
> errors that the interface doesn't exist. Worse yet, the system appears to be 
> hung. It would be better if we logged what hostname:port we were attempting 
> to open before we opened it.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-10878) Hadoop servlets need ACLs

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-10878.
---
Resolution: Won't Fix

> Hadoop servlets need ACLs
> -
>
> Key: HADOOP-10878
> URL: https://issues.apache.org/jira/browse/HADOOP-10878
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: metrics, security
>Reporter: Allen Wittenauer
>Priority: Major
>  Labels: newbie
>
> As far as I'm aware, once a user gets past the HTTP-level authentication, all 
> servlets available on that port are available to the user.  This is a 
> security hole as there is some information and services that we don't want 
> every user to be able to access or only want them to access from certain 
> locations.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-9874) hadoop.security.logger output goes to both logs

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-9874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-9874.
--
Resolution: Won't Fix

> hadoop.security.logger output goes to both logs
> ---
>
> Key: HADOOP-9874
> URL: https://issues.apache.org/jira/browse/HADOOP-9874
> Project: Hadoop Common
>  Issue Type: Bug
>Affects Versions: 2.1.0-beta
>Reporter: Allen Wittenauer
>Priority: Major
>
> Setting hadoop.security.logger (for SecurityLogger messages) to non-null 
> sends authentication information to the other log as specified.  However, 
> that logging information also goes to the main log.   It should only go to 
> one log, not both.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-11027) HADOOP_SECURE_COMMAND catch-all

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-11027.
---
Resolution: Won't Fix

> HADOOP_SECURE_COMMAND catch-all
> ---
>
> Key: HADOOP-11027
> URL: https://issues.apache.org/jira/browse/HADOOP-11027
> Project: Hadoop Common
>  Issue Type: Bug
>Reporter: Allen Wittenauer
>Assignee: Andras Bokor
>Priority: Minor
>
> Enabling HADOOP_SECURE_COMMAND to override jsvc doesn't work.  Here's a list 
> of issues!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-11131) getUsersForNetgroupCommand doesn't work for OS X

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-11131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-11131.
---
Resolution: Won't Fix

> getUsersForNetgroupCommand doesn't work for OS X
> 
>
> Key: HADOOP-11131
> URL: https://issues.apache.org/jira/browse/HADOOP-11131
> Project: Hadoop Common
>  Issue Type: Bug
>Reporter: Allen Wittenauer
>Priority: Major
>
> Apple doesn't ship getent, which this command assumes.  We should use dscl 
> instead.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-11137) put up guard rails around pid and log file handling

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-11137.
---
Resolution: Won't Fix

> put up guard rails around pid and log file handling
> ---
>
> Key: HADOOP-11137
> URL: https://issues.apache.org/jira/browse/HADOOP-11137
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: scripts, security
>Reporter: Allen Wittenauer
>Priority: Major
>  Labels: newbie, scripts, security
>
> We should do a better job of protecting against symlink attacks in the pid 
> and log file handling code:
> a) Change the default location to have a user or id.str component
> b) Check to make sure a pid file is actually a pid file (single line, nothing 
> but numbers)
> ... maybe other stuff?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-11121) native libraries guide is extremely out of date

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-11121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-11121.
---
Resolution: Won't Fix

> native libraries guide is extremely out of date
> ---
>
> Key: HADOOP-11121
> URL: https://issues.apache.org/jira/browse/HADOOP-11121
> Project: Hadoop Common
>  Issue Type: Bug
>Reporter: Allen Wittenauer
>Priority: Minor
>  Labels: documentation, newbie
>
> The native libraries guide says a few things that hasn't been true for a very 
> long time:
> * RHEL 4
> * autotools instead of cmake
> * The pre-built 32-bit i386-Linux native hadoop library is available as part 
> of the hadoop distribution and is located in the lib/native directory. 
> ... and probably more.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-11696) update compatibility documentation to reflect only API changes matter

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-11696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-11696.
---
Resolution: Won't Fix

> update compatibility documentation to reflect only API changes matter
> -
>
> Key: HADOOP-11696
> URL: https://issues.apache.org/jira/browse/HADOOP-11696
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: documentation
>Affects Versions: 2.7.0
>Reporter: Allen Wittenauer
>Priority: Major
>
> Given the changes file generated by processing JIRA and current discussion in 
> common-dev, we should update the compatibility documents to reflect reality.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-11689) Code reduction: ShellBasedIdMapping vs. ShellBasedUnixGroupsMapping

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-11689.
---
Resolution: Won't Fix

> Code reduction: ShellBasedIdMapping vs. ShellBasedUnixGroupsMapping
> ---
>
> Key: HADOOP-11689
> URL: https://issues.apache.org/jira/browse/HADOOP-11689
> Project: Hadoop Common
>  Issue Type: Improvement
>Reporter: Allen Wittenauer
>Priority: Major
>
> There seems to be an opportunity at code reduction/simplification here.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-11690) Groups vs. IdMappingServiceProvider

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-11690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-11690.
---
Resolution: Won't Fix

> Groups vs. IdMappingServiceProvider
> ---
>
> Key: HADOOP-11690
> URL: https://issues.apache.org/jira/browse/HADOOP-11690
> Project: Hadoop Common
>  Issue Type: Improvement
>Reporter: Allen Wittenauer
>Priority: Major
>
> There appears to be an opportunity of code reduction by re-implementing 
> Groups to use the IdMappingServiceProvider.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-11964) determine-flaky-tests makes invalid test assumptions

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-11964.
---
Resolution: Won't Fix

> determine-flaky-tests makes invalid test assumptions
> 
>
> Key: HADOOP-11964
> URL: https://issues.apache.org/jira/browse/HADOOP-11964
> Project: Hadoop Common
>  Issue Type: Test
>Reporter: Allen Wittenauer
>Assignee: Yongjun Zhang
>Priority: Minor
>
> When running determine-flaky-tests against precommit-hadoop-build, it throws 
> a lot of errors because it assumes that every job is actually running Java 
> tests.  There should be some way to make it not do that or at least fix its 
> assumptions.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-12389) allow self-impersonation

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-12389.
---
  Resolution: Won't Fix
Target Version/s:   (was: )

> allow self-impersonation
> 
>
> Key: HADOOP-12389
> URL: https://issues.apache.org/jira/browse/HADOOP-12389
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: security
>Affects Versions: 3.0.0-alpha1
>Reporter: Allen Wittenauer
>Priority: Major
>
> This is kind of dumb:
> org.apache.hadoop.security.authorize.AuthorizationException: User: aw is not 
> allowed to impersonate aw
> Users should be able to impersonate themselves in secure and non-secure cases 
> automatically, for free.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-12558) distcp documentation is woefully out of date

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-12558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-12558.
---
Resolution: Won't Fix

> distcp documentation is woefully out of date
> 
>
> Key: HADOOP-12558
> URL: https://issues.apache.org/jira/browse/HADOOP-12558
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: documentation, tools/distcp
>Affects Versions: 3.0.0-alpha1
>Reporter: Allen Wittenauer
>Priority: Major
>
> There are a ton of distcp tune-ables that have zero documentation outside of 
> the source code.  This should be fixed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-12578) Update hadoop_env_checks.sh to track changes from boot2docker to docker-machine

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-12578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-12578.
---
Resolution: Won't Fix

> Update hadoop_env_checks.sh to track changes from boot2docker to 
> docker-machine
> ---
>
> Key: HADOOP-12578
> URL: https://issues.apache.org/jira/browse/HADOOP-12578
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: build
>Reporter: Allen Wittenauer
>Priority: Major
>
> boot2docker on OS X appears to be deprecated.  We should rewrite the 
> instructions, scripts, etc, to use docker-machine.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-12606) OS X native unit tests fail due to libjvm link errors

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-12606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-12606.
---
Resolution: Won't Fix

> OS X native unit tests fail due to libjvm link errors
> -
>
> Key: HADOOP-12606
> URL: https://issues.apache.org/jira/browse/HADOOP-12606
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: native
>Reporter: Allen Wittenauer
>Priority: Blocker
>
> Some of the native code unit tests fail when linked against libhadoop.so due 
> to @rpath not being defined properly on OS X.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-12650) Document all of the secret env vars

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-12650.
---
Resolution: Won't Fix

> Document all of the secret env vars
> ---
>
> Key: HADOOP-12650
> URL: https://issues.apache.org/jira/browse/HADOOP-12650
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: scripts
>Affects Versions: 3.0.0-alpha1
>Reporter: Allen Wittenauer
>Priority: Blocker
>
> Over the years, developers have added all kinds of magical environment 
> variables in the Java code without any concern or thought about either a) 
> documenting them or b) whether they are already used by something else.  We 
> need to update at least hadoop-env.sh to contain a list of these env vars so 
> that end users know that they are either private/unsafe and/or how they can 
> be used.
> Just one of many examples: HADOOP_JAAS_DEBUG.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-12865) hadoop-datajoin should be documented or dropped

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-12865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-12865.
---
  Resolution: Won't Fix
Target Version/s:   (was: )

> hadoop-datajoin should be documented or dropped
> ---
>
> Key: HADOOP-12865
> URL: https://issues.apache.org/jira/browse/HADOOP-12865
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: tools
>Affects Versions: 3.0.0-alpha1
>Reporter: Allen Wittenauer
>Priority: Minor
>
> hadoop-tools's datajoin is meant to be an example (I think), but it doesn't 
> actually appear to be documented anywhere so that people can see it or use it.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-12867) clean up how rumen and sls are executed

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-12867.
---
  Resolution: Won't Fix
Target Version/s:   (was: )

> clean up how rumen and sls are executed
> ---
>
> Key: HADOOP-12867
> URL: https://issues.apache.org/jira/browse/HADOOP-12867
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: tools
>Affects Versions: 3.0.0-alpha1
>Reporter: Allen Wittenauer
>Priority: Major
>
> sls and rumen commands are buried where no one can see them. this should be 
> fixed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-13250) jdiff and dependency reports aren't linked in site web pages

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-13250.
---
Resolution: Won't Fix

> jdiff and dependency reports aren't linked in site web pages
> 
>
> Key: HADOOP-13250
> URL: https://issues.apache.org/jira/browse/HADOOP-13250
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: build, documentation
>Affects Versions: 3.0.0-alpha1
>Reporter: Allen Wittenauer
>Assignee: Vinod Kumar Vavilapalli
>Priority: Major
>
> Even though they are in the site tar ball (after HADOOP-13245), they aren't 
> actually reachable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-13495) create-release should allow a user-supplied Dockerfile

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-13495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-13495.
---
Resolution: Won't Fix

> create-release should allow a user-supplied Dockerfile
> --
>
> Key: HADOOP-13495
> URL: https://issues.apache.org/jira/browse/HADOOP-13495
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: build
>Reporter: Allen Wittenauer
>Priority: Major
>
> For non-ASF builds, it'd be handy to supply a custom Dockerfile to 
> create-release.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-13490) create-release should not fail rat checks unless --asfrelease is used

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-13490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-13490.
---
Resolution: Won't Fix

> create-release should not fail rat checks unless --asfrelease is used
> -
>
> Key: HADOOP-13490
> URL: https://issues.apache.org/jira/browse/HADOOP-13490
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: build
>Reporter: Allen Wittenauer
>Priority: Major
>
> If someone is using create-release to build where the ASF isn't the target 
> destination, there isn't much reason to fail out if RAT errors.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-13957) prevent bad PATHs

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-13957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-13957.
---
Resolution: Won't Fix

> prevent bad PATHs
> -
>
> Key: HADOOP-13957
> URL: https://issues.apache.org/jira/browse/HADOOP-13957
> Project: Hadoop Common
>  Issue Type: New Feature
>  Components: security
>Affects Versions: 3.0.0-alpha2
>Reporter: Allen Wittenauer
>Priority: Major
>
> Apache Hadoop daemons should fail to start if the shell PATH contains world 
> writable directories or '.' (cwd).  Doing so would close an attack vector on 
> misconfigured systems.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-14011) fix the remaining shelldoc errors

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-14011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-14011.
---
Resolution: Won't Fix

> fix the remaining shelldoc errors
> -
>
> Key: HADOOP-14011
> URL: https://issues.apache.org/jira/browse/HADOOP-14011
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: build, documentation, test
>Reporter: Allen Wittenauer
>Priority: Major
>
> There aren't that many shelldoc errors, and many of them (e.g., 
> dev-support/bin/*) can be set to be ignored once Apache Yetus 0.4.0 is in use.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-14016) add license and notice verifaction to create-release

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-14016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-14016.
---
Resolution: Won't Fix

> add license and notice verifaction to create-release
> 
>
> Key: HADOOP-14016
> URL: https://issues.apache.org/jira/browse/HADOOP-14016
> Project: Hadoop Common
>  Issue Type: New Feature
>  Components: build
>Reporter: Allen Wittenauer
>Priority: Major
>
> We should add some trival license and notice jar verification to 
> create-release.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-14378) Upgrade to maven-site-plugin 3.6

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-14378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-14378.
---
Resolution: Won't Fix

> Upgrade to maven-site-plugin 3.6
> 
>
> Key: HADOOP-14378
> URL: https://issues.apache.org/jira/browse/HADOOP-14378
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: build, documentation
>Affects Versions: 3.0.0-alpha4
>Reporter: Allen Wittenauer
>Priority: Major
>
> We use releasedocmaker to generate changes and releasenotes from JIRA.  Some 
> of the characters used in JIRA are technically legal in markdown but for some 
> reason cause problems when passed through to maven-site-plugin 3.6.  
> Experiments have shown that maven-site-plugin seems to handle a lot of these 
> situations better.  Let's upgrade it.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-14664) TestCodec's sequenceFileCodecTest doesn't use correct directory

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-14664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-14664.
---
Resolution: Won't Fix

> TestCodec's sequenceFileCodecTest doesn't use correct directory
> ---
>
> Key: HADOOP-14664
> URL: https://issues.apache.org/jira/browse/HADOOP-14664
> Project: Hadoop Common
>  Issue Type: Test
>  Components: build, test
>Affects Versions: 3.0.0-beta1
>Reporter: Allen Wittenauer
>Priority: Major
>
> While playing with OpenClover (HADOOP-14663), it doesn't appear that 
> sequenceFileCodecTest in TestCodec.java is properly setting the working 
> directory for the test files, resulting in test data running around in places 
> it shouldn't.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-15617) Reduce node.js and npm package loading in the Dockerfile

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-15617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-15617.
---
Resolution: Won't Fix

> Reduce node.js and npm package loading in the Dockerfile
> 
>
> Key: HADOOP-15617
> URL: https://issues.apache.org/jira/browse/HADOOP-15617
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: build
>Reporter: Allen Wittenauer
>Priority: Major
>
> {code}
> RUN apt-get -y install nodejs && \
> ln -s /usr/bin/nodejs /usr/bin/node && \
> apt-get -y install npm && \
> npm install npm@latest -g && \
> npm install -g bower && \
> npm install -g ember-cli
> {code}
> should get reduced to
> {code}
> RUN apt-get -y install nodejs && \
> ln -s /usr/bin/nodejs /usr/bin/node && \
> apt-get -y install npm && \
> npm install npm@latest -g
> {code}
> The locally installed versions of bower and ember-cli aren't being used 
> anymore.  Removing these cuts the docker build time significantly.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-15309) default maven in path under start-build-env.sh is the wrong one

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-15309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-15309.
---
Resolution: Won't Fix

> default maven in path under start-build-env.sh is the wrong one
> ---
>
> Key: HADOOP-15309
> URL: https://issues.apache.org/jira/browse/HADOOP-15309
> Project: Hadoop Common
>  Issue Type: Bug
>  Components: build
>Reporter: Allen Wittenauer
>Priority: Trivial
>
> PATH points to /usr/bin/mvn, should be /opt/maven/bin/mvn



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-14009) dev-support/bin should use hadoop-functions.sh

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-14009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-14009.
---
Resolution: Won't Fix

> dev-support/bin should use hadoop-functions.sh
> --
>
> Key: HADOOP-14009
> URL: https://issues.apache.org/jira/browse/HADOOP-14009
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: build, test
>Reporter: Allen Wittenauer
>Assignee: Allen Wittenauer
>Priority: Major
>
> We can dedupe some code by bouncing off of the in-tree hadoop-function.sh 
> versions of things.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-14224) add dnsutils to Dockerfile to aid in debugging maven repo failures

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-14224.
---
Resolution: Won't Fix

> add dnsutils to Dockerfile to aid in debugging maven repo failures
> --
>
> Key: HADOOP-14224
> URL: https://issues.apache.org/jira/browse/HADOOP-14224
> Project: Hadoop Common
>  Issue Type: Improvement
>  Components: build
>Affects Versions: 3.0.0-alpha4
>Reporter: Allen Wittenauer
>Assignee: Allen Wittenauer
>Priority: Trivial
>
> It would be useful to have dig to troubleshoot if the Docker-local resolver 
> is working correctly.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Resolved] (HADOOP-14724) Get a daily QBT run for Windows

2018-09-01 Thread Allen Wittenauer (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-14724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer resolved HADOOP-14724.
---
Resolution: Fixed

Was fixed for quite a while, now appears to be broken again. Oh well.

> Get a daily QBT run for Windows
> ---
>
> Key: HADOOP-14724
> URL: https://issues.apache.org/jira/browse/HADOOP-14724
> Project: Hadoop Common
>  Issue Type: Test
>  Components: test
>Affects Versions: 3.0.0-beta1
>Reporter: Allen Wittenauer
>Assignee: Allen Wittenauer
>Priority: Major
>
> We used to have Windows as part of our testing infrastructure.  Let's get it 
> back up and running now that the ASF has more boxes (and who knows what the 
> status of the hadoop-win-1 box is)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org