Re: ${!var} In Scripts

> On Mar 4, 2019, at 10:00 AM, Daniel Templeton wrote: > > Do you want to file a JIRA for it, or shall I? Given I haven’t done any Hadoop work in months and months … - To unsubscribe, e-mail:

Re: ${!var} In Scripts

> On Mar 4, 2019, at 9:33 AM, Daniel Templeton wrote: > > Thanks! That's not even close to what the docs suggest it does--no idea > what's up with that. It does. Here’s the paragraph: "If the first character of parameter is an exclamation point (!), a level of variable

Re: ${!var} In Scripts

> On Mar 1, 2019, at 3:04 PM, Daniel Templeton wrote: > > There are a bunch of uses of the bash syntax, "${!var}", in the Hadoop > scripts. Can anyone explain to me what that syntax was supposed to achieve? #!/usr/bin/env bash j="hi" m="bye" k=j echo ${!k} k=m echo ${!k}

[jira] [Resolved] (HADOOP-16035) Jenkinsfile for Hadoop

[ https://issues.apache.org/jira/browse/HADOOP-16035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-16035. --- Resolution: Fixed Fix Version/s: 3.3.0 > Jenkinsfile for Had

[jira] [Created] (HADOOP-16035) test yetus master

Allen Wittenauer created HADOOP-16035: - Summary: test yetus master Key: HADOOP-16035 URL: https://issues.apache.org/jira/browse/HADOOP-16035 Project: Hadoop Common Issue Type

[jira] [Resolved] (HADOOP-11688) Implement a native library version of IdMappingServiceProvider

[ https://issues.apache.org/jira/browse/HADOOP-11688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11688. --- Resolution: Won't Fix > Implement a native library vers

[jira] [Resolved] (HADOOP-9522) web interfaces are not logged until after opening

[ https://issues.apache.org/jira/browse/HADOOP-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-9522. -- Resolution: Won't Fix > web interfaces are not logged until after open

[jira] [Resolved] (HADOOP-10878) Hadoop servlets need ACLs

[ https://issues.apache.org/jira/browse/HADOOP-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-10878. --- Resolution: Won't Fix > Hadoop servlets need A

[jira] [Resolved] (HADOOP-9874) hadoop.security.logger output goes to both logs

[ https://issues.apache.org/jira/browse/HADOOP-9874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-9874. -- Resolution: Won't Fix > hadoop.security.logger output goes to both l

[jira] [Resolved] (HADOOP-11027) HADOOP_SECURE_COMMAND catch-all

[ https://issues.apache.org/jira/browse/HADOOP-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11027. --- Resolution: Won't Fix > HADOOP_SECURE_COMMAND catch-

[jira] [Resolved] (HADOOP-11131) getUsersForNetgroupCommand doesn't work for OS X

[ https://issues.apache.org/jira/browse/HADOOP-11131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11131. --- Resolution: Won't Fix > getUsersForNetgroupCommand doesn't work for O

[jira] [Resolved] (HADOOP-11137) put up guard rails around pid and log file handling

[ https://issues.apache.org/jira/browse/HADOOP-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11137. --- Resolution: Won't Fix > put up guard rails around pid and log file handl

[jira] [Resolved] (HADOOP-11121) native libraries guide is extremely out of date

[ https://issues.apache.org/jira/browse/HADOOP-11121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11121. --- Resolution: Won't Fix > native libraries guide is extremely out of d

[jira] [Resolved] (HADOOP-11696) update compatibility documentation to reflect only API changes matter

[ https://issues.apache.org/jira/browse/HADOOP-11696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11696. --- Resolution: Won't Fix > update compatibility documentation to reflect only

[jira] [Resolved] (HADOOP-11689) Code reduction: ShellBasedIdMapping vs. ShellBasedUnixGroupsMapping

[ https://issues.apache.org/jira/browse/HADOOP-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11689. --- Resolution: Won't Fix > Code reduction: ShellBasedIdMapping

[jira] [Resolved] (HADOOP-11690) Groups vs. IdMappingServiceProvider

[ https://issues.apache.org/jira/browse/HADOOP-11690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11690. --- Resolution: Won't Fix > Groups vs. IdMappingServiceProvi

[jira] [Resolved] (HADOOP-11964) determine-flaky-tests makes invalid test assumptions

[ https://issues.apache.org/jira/browse/HADOOP-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-11964. --- Resolution: Won't Fix > determine-flaky-tests makes invalid test assumpti

[jira] [Resolved] (HADOOP-12389) allow self-impersonation

[ https://issues.apache.org/jira/browse/HADOOP-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-12389. --- Resolution: Won't Fix Target Version/s: (was: ) > allow s

[jira] [Resolved] (HADOOP-12558) distcp documentation is woefully out of date

[ https://issues.apache.org/jira/browse/HADOOP-12558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-12558. --- Resolution: Won't Fix > distcp documentation is woefully out of d

[jira] [Resolved] (HADOOP-12578) Update hadoop_env_checks.sh to track changes from boot2docker to docker-machine

[ https://issues.apache.org/jira/browse/HADOOP-12578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-12578. --- Resolution: Won't Fix > Update hadoop_env_checks.sh to track changes f

[jira] [Resolved] (HADOOP-12606) OS X native unit tests fail due to libjvm link errors

[ https://issues.apache.org/jira/browse/HADOOP-12606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-12606. --- Resolution: Won't Fix > OS X native unit tests fail due to libjvm link err

[jira] [Resolved] (HADOOP-12650) Document all of the secret env vars

[ https://issues.apache.org/jira/browse/HADOOP-12650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-12650. --- Resolution: Won't Fix > Document all of the secret env v

[jira] [Resolved] (HADOOP-12865) hadoop-datajoin should be documented or dropped

[ https://issues.apache.org/jira/browse/HADOOP-12865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-12865. --- Resolution: Won't Fix Target Version/s: (was: ) > hadoop-dataj

[jira] [Resolved] (HADOOP-12867) clean up how rumen and sls are executed

[ https://issues.apache.org/jira/browse/HADOOP-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-12867. --- Resolution: Won't Fix Target Version/s: (was: ) > clean up how ru

[jira] [Resolved] (HADOOP-13250) jdiff and dependency reports aren't linked in site web pages

[ https://issues.apache.org/jira/browse/HADOOP-13250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-13250. --- Resolution: Won't Fix > jdiff and dependency reports aren't linked in site

[jira] [Resolved] (HADOOP-13495) create-release should allow a user-supplied Dockerfile

[ https://issues.apache.org/jira/browse/HADOOP-13495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-13495. --- Resolution: Won't Fix > create-release should allow a user-supplied Dockerf

[jira] [Resolved] (HADOOP-13490) create-release should not fail rat checks unless --asfrelease is used

[ https://issues.apache.org/jira/browse/HADOOP-13490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-13490. --- Resolution: Won't Fix > create-release should not fail rat checks unl

[jira] [Resolved] (HADOOP-13957) prevent bad PATHs

[ https://issues.apache.org/jira/browse/HADOOP-13957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-13957. --- Resolution: Won't Fix > prevent bad PA

[jira] [Resolved] (HADOOP-14011) fix the remaining shelldoc errors

[ https://issues.apache.org/jira/browse/HADOOP-14011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14011. --- Resolution: Won't Fix > fix the remaining shelldoc err

[jira] [Resolved] (HADOOP-14016) add license and notice verifaction to create-release

[ https://issues.apache.org/jira/browse/HADOOP-14016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14016. --- Resolution: Won't Fix > add license and notice verifaction to create-rele

[jira] [Resolved] (HADOOP-14378) Upgrade to maven-site-plugin 3.6

[ https://issues.apache.org/jira/browse/HADOOP-14378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14378. --- Resolution: Won't Fix > Upgrade to maven-site-plugin

[jira] [Resolved] (HADOOP-14664) TestCodec's sequenceFileCodecTest doesn't use correct directory

[ https://issues.apache.org/jira/browse/HADOOP-14664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14664. --- Resolution: Won't Fix > TestCodec's sequenceFileCodecTest doesn't use corr

[jira] [Resolved] (HADOOP-15617) Reduce node.js and npm package loading in the Dockerfile

[ https://issues.apache.org/jira/browse/HADOOP-15617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-15617. --- Resolution: Won't Fix > Reduce node.js and npm package loading in the Dockerf

[jira] [Resolved] (HADOOP-15309) default maven in path under start-build-env.sh is the wrong one

[ https://issues.apache.org/jira/browse/HADOOP-15309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-15309. --- Resolution: Won't Fix > default maven in path under start-build-env

[jira] [Resolved] (HADOOP-14009) dev-support/bin should use hadoop-functions.sh

[ https://issues.apache.org/jira/browse/HADOOP-14009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14009. --- Resolution: Won't Fix > dev-support/bin should use hadoop-functions

[jira] [Resolved] (HADOOP-14224) add dnsutils to Dockerfile to aid in debugging maven repo failures

[ https://issues.apache.org/jira/browse/HADOOP-14224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14224. --- Resolution: Won't Fix > add dnsutils to Dockerfile to aid in debugging maven r

[jira] [Resolved] (HADOOP-14724) Get a daily QBT run for Windows

[ https://issues.apache.org/jira/browse/HADOOP-14724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14724. --- Resolution: Fixed Was fixed for quite a while, now appears to be broken again. Oh

Re: Checkstyle shows false positive report

> On Aug 15, 2018, at 4:49 AM, Kitti Nánási > wrote: > > Hi All, > > We noticed that the checkstyle run by the pre commit job started to show > false positive reports, so I created HADOOP-15665 > . > > Until that is fixed, keep in mind to

Re: [DISCUSS] Alpha Release of Ozone

> On Aug 8, 2018, at 12:56 PM, Anu Engineer wrote: > >> Has anyone verified that a Hadoop release doesn't have _any_ of the extra >> ozone bits that are sprinkled outside the maven modules? > As far as I know that is the state, we have had multiple Hadoop releases > after ozone has been

Re: [DISCUSS] Alpha Release of Ozone

Given that there are some Ozone components spread out past the core maven modules, is the plan to release a Hadoop Trunk + Ozone tar ball or is more work going to go into segregating the Ozone components prior to release? Has anyone verified that a Hadoop release doesn't have _any_ of the

[jira] [Resolved] (HADOOP-15653) Please add OWASP Dependency Check to the build (pom.xml)

[ https://issues.apache.org/jira/browse/HADOOP-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-15653. --- Resolution: Implemented Closing this as implemented. > Please add OW

[jira] [Created] (HADOOP-15647) dependency checker test

Allen Wittenauer created HADOOP-15647: - Summary: dependency checker test Key: HADOOP-15647 URL: https://issues.apache.org/jira/browse/HADOOP-15647 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-15617) Reduce node.js and npm package loading in the Dockerfile

Allen Wittenauer created HADOOP-15617: - Summary: Reduce node.js and npm package loading in the Dockerfile Key: HADOOP-15617 URL: https://issues.apache.org/jira/browse/HADOOP-15617 Project: Hadoop

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

> On Jun 7, 2018, at 11:47 AM, Steve Loughran wrote: > > Actually, Yongjun has been really good at helping me get set up for a 2.7.7 > release, including "things you need to do to get GPG working in the docker > image” *shrugs* I use a different release script after some changes broke

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

> On Jun 7, 2018, at 3:46 AM, Lokesh Jain wrote: > > Hi Yongjun > > I followed Nanda’s steps and I see the same issues as reported by Nanda. This situation is looking like an excellent opportunity for PMC members to mentor people on how the build works since it’s apparent that three days

Re: Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

> On May 15, 2018, at 10:16 AM, Chris Douglas wrote: > > They've been failing for a long time. It can't install bats, and > that's fatal? -C The bats error is new and causes the build to fail enough that it produces the email output. For the past few months, it

Re: Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

FYI: I’m going to disable the branch-2 nightly jobs. - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Re: [NOTIFICATION] Hadoop trunk rebased

Did the patch that fixes the mountain of maven warnings get missed? > On Apr 26, 2018, at 11:52 PM, Akira Ajisaka wrote: > > + common-dev and mapreduce-dev > > On 2018/04/27 6:23, Owen O'Malley wrote: >> As we discussed in hdfs-dev@hadoop, I did a force push to Hadoop's

Fwd: Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

For my part of the HDFS bug bash, I’ve gotten the ASF Windows build working again. Starting tomorrow, results will be sent to the *-dev lists. A few notes: * It only runs the unit tests. There’s not much point in running the other Yetus plugins since those are covered by the Linux

[jira] [Created] (HADOOP-15309) default maven in path under start-build-env.sh is the wrong one

Allen Wittenauer created HADOOP-15309: - Summary: default maven in path under start-build-env.sh is the wrong one Key: HADOOP-15309 URL: https://issues.apache.org/jira/browse/HADOOP-15309 Project

[jira] [Created] (HADOOP-15279) increase maven heap size recommendations

Allen Wittenauer created HADOOP-15279: - Summary: increase maven heap size recommendations Key: HADOOP-15279 URL: https://issues.apache.org/jira/browse/HADOOP-15279 Project: Hadoop Common

[jira] [Resolved] (HADOOP-9085) start namenode failure,bacause pid of namenode pid file is other process pid or thread id before start namenode

[ https://issues.apache.org/jira/browse/HADOOP-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-9085. -- Resolution: Duplicate Target Version/s: 2.0.2-alpha, 2.0.1-alpha (was: 2.0.1

Switched PreCommit-Admin over to Apache Yetus

bcc: bui...@apache.org, d...@hbase.apache.org, d...@hive.apache.org, common-dev@hadoop.apache.org, d...@phoenix.apache.org, d...@oozie.apache.org (These are all of the projects that had pending issues. This is not all of the groups that actually rely upon this code...) The

Re: PreCommit-Admin fails to fetch issue list from jira

> On Jan 16, 2018, at 1:41 PM, Vihang Karajgaonkar wrote: > > yes, thats correct. I had created > https://issues.apache.org/jira/browse/INFRA-15849 to get that fixed. But > looks like based on the comment there we need to modify that job to use REST > instead of SOAP?

Re: PreCommit-Admin fails to fetch issue list from jira

> On Jan 16, 2018, at 1:27 PM, Vihang Karajgaonkar wrote: > > Hive pre-commit jobs are broken as well since the JIRA upgrade. Did you have > to make any changes to hadoop-precommit job to make it work? Any pointers > will help us fix ours as well. Until

Re: PreCommit-Admin fails to fetch issue list from jira

FWIW, the new JIRA has broken a few things thus far. Akira fixed an issue with test-patch and I’ve got a fix for precommit-admin as part of YETUS-594. As soon as it and YETUS-592 gets a review+commit, I’ll start the 0.7.0 release process. Also, as a reminder, Apache Yetus uses +1’s from

Re: [ANNOUNCE] Apache Hadoop 3.0.0 GA is released

It’s significantly more concerning that 3.0.0-beta1 doesn’t show up here: http://hadoop.apache.org/docs/r3.0.0/hadoop-project-dist/hadoop-common/release/index.html It looks like they are missing from the source tag too. I wonder what else is missing. > On Dec 18, 2017, at 11:15 AM, Andrew

Re: Same jenkins build running on 2 patches.

> On Dec 1, 2017, at 1:36 PM, Jason Lowe wrote: > I thought the admin precommit build was kicking off the project-specific > precommit build with an attachment ID argument so the project precommit can > be consistent with the admin precommit build on what triggered the

Re: Same jenkins build running on 2 patches.

> On Dec 1, 2017, at 12:18 PM, Rushabh Shah wrote: > Can someone explain me what happened ? Yetus downloaded the patch to make sure it applied before bothering to do anything else to make sure it wasn’t going to burn cycles on the build boxes for no reason. Docker

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

> On Nov 30, 2017, at 1:07 AM, Rohith Sharma K S > wrote: > > > >. If ATSv1 isn’t replaced by ATSv2, then why is it marked deprecated? > Ideally it should not be. Can you point out where it is marked as deprecated? > If it is in historyserver daemon start, that

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

> On Nov 21, 2017, at 2:16 PM, Vinod Kumar Vavilapalli > wrote: > >>> - $HADOOP_YARN_HOME/sbin/yarn-daemon.sh start historyserver doesn't even >>> work. Not just deprecated in favor of timelineserver as was advertised. >> >> This works for me in trunk and the bash

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

The original release script and instructions broke the build up into three or so steps. When I rewrote it, I kept that same model. It’s probably time to re-think that. In particular, it should probably be one big step that even does the maven deploy. There’s really no harm in doing

[jira] [Resolved] (HADOOP-7410) Mavenize common RPM/DEB

[ https://issues.apache.org/jira/browse/HADOOP-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-7410. -- Resolution: Won't Fix > Mavenize common RPM/

Re: [DISCUSSION] Merging HDFS-7240 Object Store (Ozone) to trunk

> On Nov 3, 2017, at 12:08 PM, Stack wrote: > > On Sat, Oct 28, 2017 at 2:00 PM, Konstantin Shvachko > wrote: > >> It is an interesting question whether Ozone should be a part of Hadoop. > > I don't see a direct answer to this question. Is there one?

[jira] [Created] (HADOOP-15010) hadoop-resourceestimator's assembly buries it

Allen Wittenauer created HADOOP-15010: - Summary: hadoop-resourceestimator's assembly buries it Key: HADOOP-15010 URL: https://issues.apache.org/jira/browse/HADOOP-15010 Project: Hadoop Common

[jira] [Created] (HADOOP-15009) hadoop-resourceestimator's shell scripts are a mess

Allen Wittenauer created HADOOP-15009: - Summary: hadoop-resourceestimator's shell scripts are a mess Key: HADOOP-15009 URL: https://issues.apache.org/jira/browse/HADOOP-15009 Project: Hadoop

[jira] [Created] (HADOOP-14977) Xenial dockerfile needs ant

Allen Wittenauer created HADOOP-14977: - Summary: Xenial dockerfile needs ant Key: HADOOP-14977 URL: https://issues.apache.org/jira/browse/HADOOP-14977 Project: Hadoop Common Issue Type

Re: Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

> On Oct 24, 2017, at 4:10 PM, Andrew Wang wrote: > > FWIW we've been running branch-3.0 unit tests successfully internally, though > we have separate jobs for Common, HDFS, YARN, and MR. The failures here are > probably a property of running everything in the same

Re: Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

omments and it >> even cannot tell which daemons/components of HDFS consumes unexpected high >> memory. Don't sounds like a solid bug report to me. >> >> >> >> Thanks,? >> >> >> Junping >> >> >> _

Re: Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

> On Oct 23, 2017, at 12:50 PM, Allen Wittenauer <a...@effectivemachines.com> > wrote: > > > > With no other information or access to go on, my current hunch is that one of > the HDFS unit tests is ballooning in memory size. The easiest way to kill a &g

Re: Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

est > failures/timeout. > > Thanks, > Subru > > On Mon, Oct 23, 2017 at 11:26 AM, Vrushali C <vrushalic2...@gmail.com> wrote: > Hi Allen, > > I have filed https://issues.apache.org/jira/browse/YARN-7380 for the > timeline service findbugs warnings.

Re: Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

I’m really confused why this causes the Yahoo! QA boxes to go catatonic (!?!) during the run. As in, never come back online, probably in a kernel panic. It’s pretty consistently in hadoop-hdfs, so something is going wrong there… is branch-2 hdfs behaving badly? Someone needs to run the

Re: Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

To whoever set this up: There was a job config problem where the Jenkins branch parameter wasn’t passed to Yetus. Therefore both of these reports have been against trunk. I’ve fixed this job (as well as the other jobs) to honor that parameter. I’ve kicked off a new run with these changes.

[jira] [Resolved] (HADOOP-14961) Docker failed to build yetus/hadoop:0de40f0: Oracle JDK 8 is NOT installed

[ https://issues.apache.org/jira/browse/HADOOP-14961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14961. --- Resolution: Fixed > Docker failed to build yetus/hadoop:0de40f0: Oracle JD

[jira] [Created] (HADOOP-14945) create-release should work on jenkins

Allen Wittenauer created HADOOP-14945: - Summary: create-release should work on jenkins Key: HADOOP-14945 URL: https://issues.apache.org/jira/browse/HADOOP-14945 Project: Hadoop Common

YARN native services Re: 2017-10-06 Hadoop 3 release status update

> On Oct 6, 2017, at 5:51 PM, Eric Yang wrote: > yarn application -deploy –f spec.json > yarn application -stop > yarn application -restart > yarn application -remove > > and > > yarn application –list will display both application list from RM as well as > docker

Re: 2017-10-06 Hadoop 3 release status update

> On Oct 6, 2017, at 1:31 PM, Andrew Wang wrote: > > - Still waiting on Allen to review YARN native services feature. Fake news. I’m still -1 on it, at least prior to a patch that posted late yesterday. I’ll probably have a chance to play with it

[jira] [Created] (HADOOP-14908) CrossOriginFilter should trigger regex on more input

Allen Wittenauer created HADOOP-14908: - Summary: CrossOriginFilter should trigger regex on more input Key: HADOOP-14908 URL: https://issues.apache.org/jira/browse/HADOOP-14908 Project: Hadoop

[jira] [Resolved] (HADOOP-14874) Secure NFS and DataNode related environment variable need to be added as hadoop_deprecate_envvar in hdfs_config.sh

[ https://issues.apache.org/jira/browse/HADOOP-14874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14874. --- Resolution: Invalid I'm going to close this as invalid since deprecation warnings

Re: Trunk fails

> On Sep 19, 2017, at 6:48 AM, Brahma Reddy Battula > wrote: > > Can we run "mvn install" and "compile" for all the modules after applying the > patch(we can skip shadeclients) We need to get over this idea that precommit is going to find all problems

Re: qbt is failiing///RE: Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

> On Sep 19, 2017, at 6:35 AM, Brahma Reddy Battula > wrote: > > qbt is failing from two days with following errors, any idea on this..? Nothing to be too concerned about. This is what it looks like when a build server gets bounced or crashed.

[jira] [Created] (HADOOP-14873) CentOS 6.6 + gcc 4.4 + cmake 3.1 don't get C99

Allen Wittenauer created HADOOP-14873: - Summary: CentOS 6.6 + gcc 4.4 + cmake 3.1 don't get C99 Key: HADOOP-14873 URL: https://issues.apache.org/jira/browse/HADOOP-14873 Project: Hadoop Common

Re: [DISCUSS] Can we make our precommit test robust to dependency changes while staying usable?

> On Sep 14, 2017, at 11:01 AM, Sean Busbey wrote: > >> Committers MUST check the qbt output after a commit. They MUST make sure > their commit didn’t break something new. > > How do we make this easier / more likely to happen? > > For example, I don't see any notice on

Re: [DISCUSS] Can we make our precommit test robust to dependency changes while staying usable?

> On Sep 14, 2017, at 8:03 AM, Sean Busbey wrote: > > * HADOOP-14654 updated commons-httplient to a new patch release in > hadoop-project > * Precommit checked the modules that changed (i.e. not many) > * nightly had Azure support break due to a change in behavior.

Re: [VOTE] Merge yarn-native-services branch into trunk

> On Sep 8, 2017, at 9:25 AM, Jian He wrote: > > Hi Allen, > The documentations are committed. Please check QuickStart.md and others in > the same folder. > YarnCommands.md doc is updated to include new commands. > DNS default port is also documented. > Would you like to

Patch testing on Windows [BETA]

I’m a little hesitant to share this because it’s really Not Quite Ready for primetime, but I figured others might want to play with it early anyway. https://builds.apache.org/view/H-L/view/Hadoop/job/Precommit-hadoop-win/ Will let you test patches on

Fwd: Moving Java Forward Faster

> Begin forwarded message: > > From: "Rory O'Donnell" > Subject: Moving Java Forward Faster > Date: September 7, 2017 at 2:12:45 AM PDT > To: "strub...@yahoo.de >> Mark Struberg" > Cc: rory.odonn...@oracle.com, abdul.kolarku...@oracle.com, >

Re: [VOTE] Merge yarn-native-services branch into trunk

> On Sep 5, 2017, at 6:23 PM, Jian He wrote: > >> If it doesn’t have all the bells and whistles, then it shouldn’t be on >> port 53 by default. > Sure, I’ll change the default port to not use 53 and document it. >> *how* is it getting launched on a privileged

Re: why the doxia-snapshot dependency

> On Sep 6, 2017, at 9:53 AM, Steve Loughran wrote: > > Well, it turns out not to like depth-4 MD tags, of the form : DOXIA-533 > , though that looks like a long-standing issue, not a regression Yup. > workaround: don't use level4 titles. And do check

Re: why the doxia-snapshot dependency

> On Sep 6, 2017, at 7:20 AM, Steve Loughran wrote: > > > Every morning my laptop downloads the doxia 1.8 snapshot for its build > > …. > This implies that the build isn't reproducible, which isn't that bad for a > short-lived dev branch, but not what we want for

Re: [VOTE] Merge yarn-native-services branch into trunk

> On Sep 5, 2017, at 3:12 PM, Gour Saha wrote: > > 2) Lots of markdown problems in the NativeServicesDiscovery.md document. > This includes things like Œyarnsite.xml¹ (missing a dash.) > > The md patch uploaded to YARN-5244 had some special chars. I fixed those > in

Re: [VOTE] Merge yarn-native-services branch into trunk

> On Sep 5, 2017, at 2:53 PM, Jian He wrote: > >> Based on the documentation, this doesn’t appear to be a fully function DNS >> server as an admin would expect (e.g., BIND, Knot, whatever). Where’s >> forwarding? How do I setup notify? Are secondaries even supported?

Re: [VOTE] Merge yarn-native-services branch into trunk

> On Aug 31, 2017, at 8:33 PM, Jian He wrote: > I would like to call a vote for merging yarn-native-services to trunk. 1) Did I miss it or is there no actual end-user documentation on how to use this? I see

[jira] [Created] (HADOOP-14836) multiple versions of maven-clean-plugin in use

Allen Wittenauer created HADOOP-14836: - Summary: multiple versions of maven-clean-plugin in use Key: HADOOP-14836 URL: https://issues.apache.org/jira/browse/HADOOP-14836 Project: Hadoop Common

[jira] [Created] (HADOOP-14835) mvn site build throws SAX errors

Allen Wittenauer created HADOOP-14835: - Summary: mvn site build throws SAX errors Key: HADOOP-14835 URL: https://issues.apache.org/jira/browse/HADOOP-14835 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-14830) Write some non-Docker-based instructions on how to build on Mac OS X

Allen Wittenauer created HADOOP-14830: - Summary: Write some non-Docker-based instructions on how to build on Mac OS X Key: HADOOP-14830 URL: https://issues.apache.org/jira/browse/HADOOP-14830

YARN javadoc failures Re: [DISCUSS] Branches and versions for Hadoop 3

> On Aug 28, 2017, at 9:58 AM, Allen Wittenauer <a...@effectivemachines.com> > wrote: > The automation only goes so far. At least while investigating Yetus > bugs, I've seen more than enough blatant and purposeful ignored errors and > warnings that I'm not convinced

[jira] [Resolved] (HADOOP-14817) shelldocs fails mvn site

[ https://issues.apache.org/jira/browse/HADOOP-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-14817. --- Resolution: Fixed > shelldocs fails mvn s

Re: native folder not found in hadoop-common build on Ubuntu

Just to close the loop on this a bit ... Windows always triggers the 'native-win' profile because winutils is currently required to actually use Apache Hadoop on that platform. On other platforms, the 'native' profile is optional since their is enough support in the JDK to at least

[jira] [Created] (HADOOP-14817) shelldocs fails mvn site

Allen Wittenauer created HADOOP-14817: - Summary: shelldocs fails mvn site Key: HADOOP-14817 URL: https://issues.apache.org/jira/browse/HADOOP-14817 Project: Hadoop Common Issue Type: Bug

  1   2   3   4   5   6   7   8   9   10   >