Re: Updates on migration to git

2014-08-25 Thread Arpit Gupta
some of this info is here https://git-wip-us.apache.org/ On Mon, Aug 25, 2014 at 3:45 PM, Karthik Kambatla ka...@cloudera.com wrote: Thanks for bringing these points up, Zhijie. By the way, a revised How-to-commit wiki is at: https://wiki.apache.org/hadoop/HowToCommitWithGit . Please feel

[jira] [Created] (HADOOP-10343) Change info to debug log in LossyRetryInvocationHandler

2014-02-13 Thread Arpit Gupta (JIRA)
Arpit Gupta created HADOOP-10343: Summary: Change info to debug log in LossyRetryInvocationHandler Key: HADOOP-10343 URL: https://issues.apache.org/jira/browse/HADOOP-10343 Project: Hadoop Common

Re: Logistics for releasing 2.4

2014-01-22 Thread Arpit Gupta
There are a couple of minor doc changes if they can be included in the next release that will be great. https://issues.apache.org/jira/browse/HADOOP-10050 https://issues.apache.org/jira/browse/HADOOP-10065 Thanks -- Arpit Gupta Hortonworks Inc. http://hortonworks.com/ On Jan 22, 2014, at 6:09

[jira] [Created] (HADOOP-10215) Cannot create hftp filesystem when using a proxy user ugi on a secure cluster

2014-01-08 Thread Arpit Gupta (JIRA)
Arpit Gupta created HADOOP-10215: Summary: Cannot create hftp filesystem when using a proxy user ugi on a secure cluster Key: HADOOP-10215 URL: https://issues.apache.org/jira/browse/HADOOP-10215

[jira] [Created] (HADOOP-10065) Fix namenode format documentation

2013-10-23 Thread Arpit Gupta (JIRA)
Arpit Gupta created HADOOP-10065: Summary: Fix namenode format documentation Key: HADOOP-10065 URL: https://issues.apache.org/jira/browse/HADOOP-10065 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-10050) Update single node and cluster install instructions to work with latest bits

2013-10-15 Thread Arpit Gupta (JIRA)
Arpit Gupta created HADOOP-10050: Summary: Update single node and cluster install instructions to work with latest bits Key: HADOOP-10050 URL: https://issues.apache.org/jira/browse/HADOOP-10050

Re: [VOTE] Release Apache Hadoop 2.2.0

2013-10-10 Thread Arpit Gupta
+1 (non binding) Ran secure and non secure multi node clusters and tested HA and RM recovery tests. -- Arpit Gupta Hortonworks Inc. http://hortonworks.com/ On Oct 7, 2013, at 12:00 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.2.0

[jira] [Created] (HADOOP-10012) Secure Oozie jobs with delegation token renewal exception in HA setup

2013-10-01 Thread Arpit Gupta (JIRA)
Arpit Gupta created HADOOP-10012: Summary: Secure Oozie jobs with delegation token renewal exception in HA setup Key: HADOOP-10012 URL: https://issues.apache.org/jira/browse/HADOOP-10012 Project

[jira] [Created] (HADOOP-9886) Turn warning message in RetryInvocationHandler to a debub

2013-08-19 Thread Arpit Gupta (JIRA)
Arpit Gupta created HADOOP-9886: --- Summary: Turn warning message in RetryInvocationHandler to a debub Key: HADOOP-9886 URL: https://issues.apache.org/jira/browse/HADOOP-9886 Project: Hadoop Common

Re: Heads up: branch-2.1-beta

2013-06-12 Thread Arpit Gupta
We are running into an issue where link to the AM leads to a 500 https://issues.apache.org/jira/browse/YARN-800 We should fix this before we release 2.1.0 beta. -- Arpit Gupta Hortonworks Inc. http://hortonworks.com/ On Jun 10, 2013, at 4:49 AM, Arun C Murthy a...@hortonworks.com wrote

Re: [PROPOSAL] change in bylaws to remove Release Plan vote

2013-05-21 Thread Arpit Gupta
+1 -- Arpit Gupta Hortonworks Inc. http://hortonworks.com/ On May 21, 2013, at 2:10 PM, Matt Foley ma...@apache.org wrote: Hi all, This has been a side topic in several email threads recently. Currently we have an ambiguity. We have a tradition in the dev community that any committer can

Re: [VOTE] Plan to create release candidate for 0.23.8

2013-05-20 Thread Arpit Gupta
+1 -- Arpit Gupta Hortonworks Inc. http://hortonworks.com/ On May 17, 2013, at 2:10 PM, Thomas Graves tgra...@yahoo-inc.com wrote: Hello all, We've had a few critical issues come up in 0.23.7 that I think warrants a 0.23.8 release. The main one is MAPREDUCE-5211. There are a couple

[jira] [Created] (HADOOP-9379) capture the ulimit info after printing the log to the console

2013-03-07 Thread Arpit Gupta (JIRA)
Arpit Gupta created HADOOP-9379: --- Summary: capture the ulimit info after printing the log to the console Key: HADOOP-9379 URL: https://issues.apache.org/jira/browse/HADOOP-9379 Project: Hadoop Common

Re: Snappy build warning

2013-03-07 Thread Arpit Gupta
Snappy libraries needs to be available on your system for hadoop to use them during the build. If you are on a centos based system epel repositories have the snappy and snappy-devel rpm's which need to be installed before you build hadoop. -- Arpit Gupta Hortonworks Inc. http://hortonworks.com

Re: [VOTE] Hadoop 1.1.2-rc5 release candidate vote

2013-02-14 Thread Arpit Gupta
+1 non binding Deployed on multi node clusters with secure and non secure setup and ran full system tests. No new regressions were found. -- Arpit Gupta Hortonworks Inc. http://hortonworks.com/ On Jan 31, 2013, at 7:13 PM, Matt Foley ma...@apache.org wrote: (resending with modified Subject

[jira] [Created] (HADOOP-9253) Capture ulimit info in the logs at service start time

2013-01-26 Thread Arpit Gupta (JIRA)
Arpit Gupta created HADOOP-9253: --- Summary: Capture ulimit info in the logs at service start time Key: HADOOP-9253 URL: https://issues.apache.org/jira/browse/HADOOP-9253 Project: Hadoop Common

[jira] [Resolved] (HADOOP-9251) mvn eclipse:eclipse fails on trunk

2013-01-25 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Gupta resolved HADOOP-9251. - Resolution: Invalid mvn eclipse:eclipse fails on trunk

[jira] [Created] (HADOOP-9115) Deadlock in configuration when writing configuration to hdfs

2012-12-04 Thread Arpit Gupta (JIRA)
Arpit Gupta created HADOOP-9115: --- Summary: Deadlock in configuration when writing configuration to hdfs Key: HADOOP-9115 URL: https://issues.apache.org/jira/browse/HADOOP-9115 Project: Hadoop Common

Re: [VOTE] Hadoop Release 1.1.1

2012-11-26 Thread Arpit Gupta
+1, non binding ran system tests on secure and non secure clusters and no new regressions were found. -- Arpit Gupta Hortonworks Inc. http://hortonworks.com/ On Nov 20, 2012, at 2:07 PM, Matt Foley ma...@apache.org wrote: Hello, Hadoop-1.1.1-rc0 is now available for evaluation and vote

[jira] [Resolved] (HADOOP-8888) add the ability to suppress the deprecated warnings when using hadoop cli

2012-10-16 Thread Arpit Gupta (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Gupta resolved HADOOP-. - Resolution: Won't Fix add the ability to suppress the deprecated warnings when using

[jira] [Created] (HADOOP-8917) add LOCALE.US to toLowerCase in SecurityUtil.replacePattern

2012-10-11 Thread Arpit Gupta (JIRA)
Arpit Gupta created HADOOP-8917: --- Summary: add LOCALE.US to toLowerCase in SecurityUtil.replacePattern Key: HADOOP-8917 URL: https://issues.apache.org/jira/browse/HADOOP-8917 Project: Hadoop Common

Re: [VOTE] Hadoop-1.1.0 release candidate 5

2012-10-09 Thread Arpit Gupta
+1 (non-binding) ran tests on multi node secure and un secure clusters and everything worked as expected. -- Arpit Gupta Hortonworks Inc. http://hortonworks.com/ On Oct 5, 2012, at 2:31 PM, Matt Foley ma...@apache.org wrote: Here at long last is a votable release candidate for Hadoop 1.1.0

Re: [VOTE] Hadoop-1.0.4-rc0

2012-10-05 Thread Arpit Gupta
+1 (non binding) ran regression tests and no issues were found. -- Arpit Gupta Hortonworks Inc. http://hortonworks.com/ On Oct 4, 2012, at 1:59 PM, Matt Foley ma...@apache.org wrote: Hi, There has been a request from several PMC members for a maintenance release of hadoop-1.0. Please

[jira] [Created] (HADOOP-8888) add the ability to suppress the deprecated warnings when using hadoop cli

2012-10-05 Thread Arpit Gupta (JIRA)
Arpit Gupta created HADOOP-: --- Summary: add the ability to suppress the deprecated warnings when using hadoop cli Key: HADOOP- URL: https://issues.apache.org/jira/browse/HADOOP- Project

[jira] [Created] (HADOOP-8882) uppercase namenode host name causes fsck to fail when useKsslAuth is on

2012-10-04 Thread Arpit Gupta (JIRA)
Arpit Gupta created HADOOP-8882: --- Summary: uppercase namenode host name causes fsck to fail when useKsslAuth is on Key: HADOOP-8882 URL: https://issues.apache.org/jira/browse/HADOOP-8882 Project

[jira] [Created] (HADOOP-8878) uppercase hostname causes hadoop dfs calls with webhdfs filesystem to fail

2012-10-03 Thread Arpit Gupta (JIRA)
Arpit Gupta created HADOOP-8878: --- Summary: uppercase hostname causes hadoop dfs calls with webhdfs filesystem to fail Key: HADOOP-8878 URL: https://issues.apache.org/jira/browse/HADOOP-8878 Project

Re: 答复: regarding _HOST token replacement in security hadoop

2012-07-27 Thread Arpit Gupta
or not? In org.apache.hadoop.hdfs.server.namenode.NameNode.loginAsNameNodeUser(), it use socAddr.getHostName() to get _HOST, But in org.apache.hadoop.security.SecurityUtil.replacePattern(), in getLocalHostName(), it use getCanonicalHostName() to get _HOST Meanwhile I will check what you said. Thank you~ -邮件原件- 发件人: Arpit Gupta [mailto:ar...@hortonworks.com

Re: regarding _HOST token replacement in security hadoop

2012-07-26 Thread Arpit Gupta
you need to use HTTP/_h...@site.com as that is the principal needed by spnego. So you would need create the HTTP/_HOST principal and add it to the same keytab (/home/hdfs/keytab/nn.service.keytab). -- Arpit Gupta Hortonworks Inc. http://hortonworks.com/ On Jul 26, 2012, at 6:54 PM, Wangwenli

Re: [VOTE] Hadoop-1.0.3-rc1

2012-05-15 Thread Arpit Gupta
+1 (non binding) ran system tests on secure and non secure deploys and found no regression issues. -- Arpit Gupta Hortonworks Inc. http://hortonworks.com/ On May 8, 2012, at 6:25 PM, Matt Foley wrote: Hi all, release Candidate for Hadoop-1.0.3 is now available for vote, at http

Re: Problem in installing hive

2012-04-01 Thread Arpit Gupta
Make sure you are on hive 0.8.1 that has the fix for this issue. -- Arpit Gupta Hortonworks Inc. http://hortonworks.com/ On Apr 1, 2012, at 11:54 AM, Ranjan Banerjee wrote: Hello, I am trying to install hive. However I am facing the following problem. After following all the procedures

[jira] [Created] (HADOOP-8185) Update namenode -format documentation and add -nonInteractive and -force

2012-03-19 Thread Arpit Gupta (Created) (JIRA)
Issue Type: Improvement Reporter: Arpit Gupta Assignee: Arpit Gupta documentation changes related to HDFS-3094 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org

[jira] [Created] (HADOOP-8171) add -force option to namenode -format command

2012-03-14 Thread Arpit Gupta (Created) (JIRA)
, 1.0.2 Reporter: Arpit Gupta Assignee: Arpit Gupta Currently the bin/hadoop namenode -format prompts the user for a Y/N to setup the directories in the local file system. We should add a -force option which when present the user is not prompted. -- This message

[jira] [Created] (HADOOP-8132) 64bit secure datanodes do not start as the jsvc path is wrong

2012-03-01 Thread Arpit Gupta (Created) (JIRA)
Affects Versions: 1.0.1 Reporter: Arpit Gupta Assignee: Arpit Gupta 64bit secure datanodes were looking for /usr/libexec/../libexec/jsvc. instead of /usr/libexec/../libexec/jsvc.amd64 -- This message is automatically generated by JIRA. If you think it was sent incorrectly

[jira] [Created] (HADOOP-8106) hadoop-config.sh script defaults to /usr/etc/hadoop rather than /etc/hadoop for the default location of the conf dir

2012-02-23 Thread Arpit Gupta (Created) (JIRA)
://issues.apache.org/jira/browse/HADOOP-8106 Project: Hadoop Common Issue Type: Bug Affects Versions: 1.0.0, 0.24.0 Reporter: Arpit Gupta Assignee: Arpit Gupta -- This message is automatically generated by JIRA. If you think it was sent

Re: [VOTE] Hadoop-1.0.1 Release Candidate 1

2012-02-21 Thread Arpit Gupta
+1 (non binding) tested on secure and non secure clusters and no regressions were found.On Feb 14, 2012, at 2:29 PM, Matt Foley wrote:Hi all,Hadoop-1.0.1-rc1 is now available at http://people.apache.org/~mattf/hadoop-1.0.1-rc1/Please download it, test it, and vote on whether to accept it as

[jira] [Created] (HADOOP-8000) fetchdt command not available in bin/hadoop

2012-01-27 Thread Arpit Gupta (Created) (JIRA)
Reporter: Arpit Gupta Assignee: Arpit Gupta fetchdt command needs to be added to bin/hadoop to allow for backwards compatibility. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https

[jira] [Created] (HADOOP-8002) SecurityUtil acquired token message should be a debug rather than info

2012-01-27 Thread Arpit Gupta (Created) (JIRA)
Issue Type: Bug Affects Versions: 0.24.0, 0.23.1 Reporter: Arpit Gupta Assignee: Arpit Gupta -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure

[jira] [Created] (HADOOP-7867) jobtracker ui issues

2011-11-28 Thread Arpit Gupta (Created) (JIRA)
jobtracker ui issues Key: HADOOP-7867 URL: https://issues.apache.org/jira/browse/HADOOP-7867 Project: Hadoop Common Issue Type: Bug Affects Versions: 1.0.0 Reporter: Arpit Gupta Jobtracker UI in 1.0.0

[jira] [Created] (HADOOP-7848) hadoop rpm does not set the correct ownership and permission for the task-controller

2011-11-21 Thread Arpit Gupta (Created) (JIRA)
: Hadoop Common Issue Type: Bug Affects Versions: 0.20.205.0 Reporter: Arpit Gupta Assignee: Giridharan Kesavan currently the hadoop rpm installs the task-controller binary with the permission -rwxr-xr-x 1 root root 39434 Oct 7 06:26 /usr/bin/task-controller

[jira] [Created] (HADOOP-7849) hadoop rpm overwrites the existing /etc/hadoop/hadoop-env.sh

2011-11-21 Thread Arpit Gupta (Created) (JIRA)
Affects Versions: 0.20.205.0 Reporter: Arpit Gupta Assignee: Giridharan Kesavan The following steps were used to deploy 1. Create /etc/hadoop dir 2. create a file hadoop-env.sh in the above dir 3. install the hadoop rpm (rpm -ivh hadoop-0.20.205.0-1.amd64.rpm) The following

[jira] [Created] (HADOOP-7850) hadoop rpm does not create the appropriate link for the native files

2011-11-21 Thread Arpit Gupta (Created) (JIRA)
Type: Bug Affects Versions: 0.20.205.0 Reporter: Arpit Gupta Assignee: Giridharan Kesavan hadoop rpm installs the following files /usr/lib/libhadoop.so /usr/lib/libhadoop.so.1.0.0 From the size it looks like the libhadoop.so.1.0.0 points to the 64 bit native files ls

[jira] [Created] (HADOOP-7812) http call when no authorization is sent throws a 401 with no error resonse

2011-11-09 Thread Arpit Gupta (Created) (JIRA)
Issue Type: Improvement Affects Versions: 0.20.205.0 Reporter: Arpit Gupta Currently if you make an http call to the namenode and do not send any authorization returns 401 as expected but no response content. I would be nice if we could return some error response stating

[jira] [Created] (HADOOP-7784) secure datanodes fail to come up stating jscv not found

2011-10-31 Thread Arpit Gupta (Created) (JIRA)
Versions: 0.20.205.1 Reporter: Arpit Gupta building 205.1 and trying to startup a secure dn leads to the following /usr/libexec/../bin/hadoop: line 386: /usr/libexec/../libexec/jsvc.amd64: No such file or directory /usr/libexec/../bin/hadoop: line 386: exec: /usr/libexec/../libexec

[jira] [Created] (HADOOP-7751) rpm version is not being picked from the -Dversion option in 205

2011-10-15 Thread Arpit Gupta (Created) (JIRA)
Components: build Affects Versions: 0.20.205.0 Reporter: Arpit Gupta Assignee: Eric Yang ran ant build -Dversion=0.20.205.1 and the rpm generated is the following hadoop-0.20.205.0-1.amd64.rpm Where as the tar.gz has the correct value hadoop-0.20.205.1

Re: [VOTE] 0.20.205.0 Release Candidate 2

2011-10-12 Thread Arpit Gupta
Deployed to a cluster of 20 servers, with security and append features enabled. Passed our internal test suite. Looks good! +1 (non binding) -- Arpit ar...@hortonworks.com On Oct 7, 2011, at 5:10 PM, Matt Foley wrote: Many thanks to the community members who tried out RC1, and found

[jira] [Created] (HADOOP-7732) 204 java docs missing hdfs package

2011-10-10 Thread Arpit Gupta (Created) (JIRA)
: 0.20.204.0, 0.20.205.0 Reporter: Arpit Gupta the following link http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/hdfs/package-summary.html leads to a 404 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your

[jira] [Created] (HADOOP-7720) improve the hadoop-setup-conf.sh to read in the hbase and setup the configs

2011-10-04 Thread Arpit Gupta (Created) (JIRA)
Issue Type: Improvement Components: conf Reporter: Arpit Gupta Assignee: Arpit Gupta Read in the hbase user in the script to set the auth to local mapping appropriately in hadoop so hbase can write. If the value is not sent default to 'hbase

[jira] [Created] (HADOOP-7721) kerberos.principal expects the full hostname and does not replace _HOST with the hostname

2011-10-04 Thread Arpit Gupta (Created) (JIRA)
Project: Hadoop Common Issue Type: Bug Reporter: Arpit Gupta -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa

[jira] [Created] (HADOOP-7715) see log4j Error when running mr jobs and certain dfs calls

2011-10-03 Thread Arpit Gupta (Created) (JIRA)
Components: conf Reporter: Arpit Gupta Fix For: 0.20.205.1 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more

[jira] [Created] (HADOOP-7707) improve config generator to allow users to specify proxy user, turn append on or off, turn webhdfs on or off

2011-09-30 Thread Arpit Gupta (Created) (JIRA)
://issues.apache.org/jira/browse/HADOOP-7707 Project: Hadoop Common Issue Type: Improvement Components: conf Affects Versions: 0.20.205.1 Reporter: Arpit Gupta -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact

[jira] [Created] (HADOOP-7708) config generator does not update the properties file if on exists already

2011-09-30 Thread Arpit Gupta (Created) (JIRA)
Issue Type: Bug Components: conf Affects Versions: 0.20.205.1 Reporter: Arpit Gupta We are copying configs to the hadoop conf dir but are not using the -f option. This leads to conf file not getting replaced in case the file exists and thus the user never gets

[jira] [Created] (HADOOP-7710) create a script to setup application in order to create root directories for application such hbase, hcat, hive etc

2011-09-30 Thread Arpit Gupta (Created) (JIRA)
://issues.apache.org/jira/browse/HADOOP-7710 Project: Hadoop Common Issue Type: Improvement Affects Versions: 0.20.205.1 Reporter: Arpit Gupta -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA

[jira] [Created] (HADOOP-7683) hdfs-site.xml template has properties that are not used in 20

2011-09-26 Thread Arpit Gupta (JIRA)
Reporter: Arpit Gupta Assignee: Arpit Gupta Priority: Minor properties dfs.namenode.http-address and dfs.namenode.https-address should be removed -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com

[jira] [Created] (HADOOP-7633) log4j.properties should be added to the hadoop conf on deploy

2011-09-13 Thread Arpit Gupta (JIRA)
Components: conf Reporter: Arpit Gupta Fix For: 0.20.205.0 currently the log4j properties are not present in the hadoop conf dir. We should add them so that log rotation happens appropriately and also define other logs that hadoop can generate for example the audit