Hadoop-Mapreduce-trunk - Build # 1857 - Failure

2014-08-08 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1857/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 35048 lines...]

Tests run: 280, Failures: 1, Errors: 0, Skipped: 0

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] hadoop-mapreduce-client ... SUCCESS [  2.541 s]
[INFO] hadoop-mapreduce-client-core .. SUCCESS [ 57.130 s]
[INFO] hadoop-mapreduce-client-common  SUCCESS [ 27.127 s]
[INFO] hadoop-mapreduce-client-shuffle ... SUCCESS [  4.373 s]
[INFO] hadoop-mapreduce-client-app ... FAILURE [08:28 min]
[INFO] hadoop-mapreduce-client-hs  SKIPPED
[INFO] hadoop-mapreduce-client-jobclient . SKIPPED
[INFO] hadoop-mapreduce-client-hs-plugins  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] hadoop-mapreduce .. SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 10:00 min
[INFO] Finished at: 2014-08-08T15:20:50+00:00
[INFO] Final Memory: 31M/686M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test) on 
project hadoop-mapreduce-client-app: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire-reports
 for the individual test results.
[ERROR] - [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn goals -rf :hadoop-mapreduce-client-app
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Sending artifact delta relative to Hadoop-Mapreduce-trunk #1856
Archived 2 artifacts
Archive block size is 32768
Received 0 blocks and 16976034 bytes
Compression is 0.0%
Took 17 sec
Updating HDFS-6728
Updating HDFS-6772
Updating YARN-2008
Updating HADOOP-10771
Updating HADOOP-10929
Updating HDFS-6740
Updating YARN-2352
Updating HADOOP-10876
Updating MAPREDUCE-6021
Updating YARN-2288
Updating HDFS-6781
Updating HDFS-6722
Email was triggered for: Failure
Sending email for trigger: Failure



###
## FAILED TESTS (if any) 
##
No tests ran.

[jira] [Created] (MAPREDUCE-6029) TestCommitterEventHandler fails in trunk

2014-08-08 Thread Ted Yu (JIRA)
Ted Yu created MAPREDUCE-6029:
-

 Summary: TestCommitterEventHandler fails in trunk
 Key: MAPREDUCE-6029
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6029
 Project: Hadoop Map/Reduce
  Issue Type: Bug
Reporter: Ted Yu


From https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1857/console :
{code}
Running org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.429 sec  
FAILURE! - in 
org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler
testFailure(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler)
  Time elapsed: 1.198 sec   FAILURE!
java.lang.AssertionError: null
at org.junit.Assert.fail(Assert.java:86)
at org.junit.Assert.assertTrue(Assert.java:41)
at org.junit.Assert.assertNotNull(Assert.java:621)
at org.junit.Assert.assertNotNull(Assert.java:631)
at 
org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testFailure(TestCommitterEventHandler.java:314)
{code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[jira] [Resolved] (MAPREDUCE-6008) Update distcp docs to include new option that suppresses preservation of RAW.* namespace extended attributes

2014-08-08 Thread Andrew Wang (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrew Wang resolved MAPREDUCE-6008.


Resolution: Not a Problem

We took care of the docs in parent JIRA, no need for this one.

 Update distcp docs to include new option that suppresses preservation of 
 RAW.* namespace extended attributes
 

 Key: MAPREDUCE-6008
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6008
 Project: Hadoop Map/Reduce
  Issue Type: Sub-task
  Components: distcp
Affects Versions: fs-encryption
Reporter: Charles Lamb
Assignee: Charles Lamb

 Update the docs to include this new option.



--
This message was sent by Atlassian JIRA
(v6.2#6252)


Re: [DISCUSS] Migrate from svn to git for source control?

2014-08-08 Thread Karthik Kambatla
Thanks Steve. Including that in the proposal.

By the way, from our project bylaws (http://hadoop.apache.org/bylaws.html),
I can't tell what kind of a vote this would be.


On Thu, Aug 7, 2014 at 1:22 AM, Steve Loughran ste...@hortonworks.com
wrote:

 On 6 August 2014 22:16, Karthik Kambatla ka...@cloudera.com wrote:

  3. Force-push on feature-branches is allowed. Before pulling in a
 feature,
  the feature-branch should be rebased on latest trunk and the changes
  applied to trunk through git rebase --onto or git cherry-pick
  commit-range.
 

 I'd add to this process the requirement to tag any feature branch before a
 rebase, with some standard naming like

 tag_feature_JIRA-2454_2014-08-07_rebase

 Why? it keeps the state of the branch before the rebase in case you ever
 want it back again. Without the tag: lost data. Once the feature is merged
 in you can rm the tags, but until then they give you a log of what changes
 went on, and make it possible to switch back to the pre-rebase version.

 Without those tags you do lose history of the development.

 --
 CONFIDENTIALITY NOTICE
 NOTICE: This message is intended for the use of the individual or entity to
 which it is addressed and may contain information that is confidential,
 privileged and exempt from disclosure under applicable law. If the reader
 of this message is not the intended recipient, you are hereby notified that
 any printing, copying, dissemination, distribution, disclosure or
 forwarding of this communication is strictly prohibited. If you have
 received this communication in error, please contact the sender immediately
 and delete it from your system. Thank You.



Re: [DISCUSS] Migrate from svn to git for source control?

2014-08-08 Thread Alejandro Abdelnur
funny, i'd treat it as a merge vote.


On Fri, Aug 8, 2014 at 11:44 AM, Karthik Kambatla ka...@cloudera.com
wrote:

 Thanks Steve. Including that in the proposal.

 By the way, from our project bylaws (http://hadoop.apache.org/bylaws.html
 ),
 I can't tell what kind of a vote this would be.


 On Thu, Aug 7, 2014 at 1:22 AM, Steve Loughran ste...@hortonworks.com
 wrote:

  On 6 August 2014 22:16, Karthik Kambatla ka...@cloudera.com wrote:
 
   3. Force-push on feature-branches is allowed. Before pulling in a
  feature,
   the feature-branch should be rebased on latest trunk and the changes
   applied to trunk through git rebase --onto or git cherry-pick
   commit-range.
  
 
  I'd add to this process the requirement to tag any feature branch before
 a
  rebase, with some standard naming like
 
  tag_feature_JIRA-2454_2014-08-07_rebase
 
  Why? it keeps the state of the branch before the rebase in case you ever
  want it back again. Without the tag: lost data. Once the feature is
 merged
  in you can rm the tags, but until then they give you a log of what
 changes
  went on, and make it possible to switch back to the pre-rebase version.
 
  Without those tags you do lose history of the development.
 
  --
  CONFIDENTIALITY NOTICE
  NOTICE: This message is intended for the use of the individual or entity
 to
  which it is addressed and may contain information that is confidential,
  privileged and exempt from disclosure under applicable law. If the reader
  of this message is not the intended recipient, you are hereby notified
 that
  any printing, copying, dissemination, distribution, disclosure or
  forwarding of this communication is strictly prohibited. If you have
  received this communication in error, please contact the sender
 immediately
  and delete it from your system. Thank You.
 




-- 
Alejandro


Re: [DISCUSS] Migrate from svn to git for source control?

2014-08-08 Thread Andrew Wang
In the bylaws, I see this under PMC responsibilities:

* Maintaining the project's shared resources, including the codebase
repository, mailing lists, websites.

This seems to indicate that the repo (i.e. svn or git) is managed by the
PMC. Of the available PMC vote actions, the closest seems to be Adoption
of New Codebase:

When the codebase for an existing, released product is to be replaced with
an alternative codebase. If such a vote fails to gain approval, the
existing code base will continue.
This also covers the creation of new sub-projects within the project
Lazy 2/3 majority of PMC members

This would be my recommendation for the vote, but I'll defer to more
experienced PMC members.

Thanks,
Andrew


On Fri, Aug 8, 2014 at 1:18 PM, Alejandro Abdelnur t...@cloudera.com
wrote:

 funny, i'd treat it as a merge vote.


 On Fri, Aug 8, 2014 at 11:44 AM, Karthik Kambatla ka...@cloudera.com
 wrote:

  Thanks Steve. Including that in the proposal.
 
  By the way, from our project bylaws (
 http://hadoop.apache.org/bylaws.html
  ),
  I can't tell what kind of a vote this would be.
 
 
  On Thu, Aug 7, 2014 at 1:22 AM, Steve Loughran ste...@hortonworks.com
  wrote:
 
   On 6 August 2014 22:16, Karthik Kambatla ka...@cloudera.com wrote:
  
3. Force-push on feature-branches is allowed. Before pulling in a
   feature,
the feature-branch should be rebased on latest trunk and the changes
applied to trunk through git rebase --onto or git cherry-pick
commit-range.
   
  
   I'd add to this process the requirement to tag any feature branch
 before
  a
   rebase, with some standard naming like
  
   tag_feature_JIRA-2454_2014-08-07_rebase
  
   Why? it keeps the state of the branch before the rebase in case you
 ever
   want it back again. Without the tag: lost data. Once the feature is
  merged
   in you can rm the tags, but until then they give you a log of what
  changes
   went on, and make it possible to switch back to the pre-rebase version.
  
   Without those tags you do lose history of the development.
  
   --
   CONFIDENTIALITY NOTICE
   NOTICE: This message is intended for the use of the individual or
 entity
  to
   which it is addressed and may contain information that is confidential,
   privileged and exempt from disclosure under applicable law. If the
 reader
   of this message is not the intended recipient, you are hereby notified
  that
   any printing, copying, dissemination, distribution, disclosure or
   forwarding of this communication is strictly prohibited. If you have
   received this communication in error, please contact the sender
  immediately
   and delete it from your system. Thank You.
  
 



 --
 Alejandro



[jira] [Resolved] (MAPREDUCE-6028) java.lang.ArithmeticException: / by zero

2014-08-08 Thread Ravi Prakash (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravi Prakash resolved MAPREDUCE-6028.
-

Resolution: Invalid

 java.lang.ArithmeticException: / by zero
 

 Key: MAPREDUCE-6028
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6028
 Project: Hadoop Map/Reduce
  Issue Type: Bug
Affects Versions: 1.2.1
 Environment: hadoop version:1.2.1
Reporter: eagle

 Run any sql through hive with following 
 error message:
 2014-08-07 10:22:28,061 INFO org.apache.hadoop.mapred.TaskInProgress: Error 
 from attempt_201407251033_24476_m_02_0: Error initializing 
 attempt_201407251033_24476_m_02_0:
 java.lang.ArithmeticException: / by zero
 and after restart hadoop cluster,the problem resolved。how to find the root 
 casue for the problem? thks。



--
This message was sent by Atlassian JIRA
(v6.2#6252)


[VOTE] Migration from subversion to git for version control

2014-08-08 Thread Karthik Kambatla
I have put together this proposal based on recent discussion on this topic.

Please vote on the proposal. The vote runs for 7 days.

   1. Migrate from subversion to git for version control.
   2. Force-push to be disabled on trunk and branch-* branches. Applying
   changes from any of trunk/branch-* to any of branch-* should be through
   git cherry-pick -x.
   3. Force-push on feature-branches is allowed. Before pulling in a
   feature, the feature-branch should be rebased on latest trunk and the
   changes applied to trunk through git rebase --onto or git cherry-pick
   commit-range.
   4. Every time a feature branch is rebased on trunk, a tag that
   identifies the state before the rebase needs to be created (e.g.
   tag_feature_JIRA-2454_2014-08-07_rebase). These tags can be deleted once
   the feature is pulled into trunk and the tags are no longer useful.
   5. The relevance/use of tags stay the same after the migration.

Thanks
Karthik

PS: Per Andrew Wang, this should be a Adoption of New Codebase kind of
vote and will be Lazy 2/3 majority of PMC members.


Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

2014-08-08 Thread Zhijie Shen
+1 non-binding

+ downloaded the source, built the tarball from it successfully
+ verified the dates of CHANGES.txt
+ ran a couple of MR example jobs successfully
+ ran DS jobs successfully
+ verified the applications' history was accessible from the timeline server
+ verified the DS jobs published the right entities and the events to the
timeline server

On Thu, Aug 7, 2014 at 6:28 PM, Andrew Wang andrew.w...@cloudera.com
wrote:

 +1 binding

 * verified mds
 * built tarball from source
 * checked the CHANGES.txt files, they have dates
 * ran apache-rat:check
 * ran pseudo cluster from the resulting tarball, ran teragen, sort,
 validate on uncached and cached files



 On Thu, Aug 7, 2014 at 8:58 AM, Masatake Iwasaki 
 iwasak...@oss.nttdata.co.jp wrote:

  +1 (non-binding)
 
  + verified MD5 for tarball and source tarball
  + built from source tarball
  + ran example jobs such as
nutchindexing, wordcount, dfsioe, hivebench, kmeans, pagerank, bayes,
  sort, terasort
with HiBench on the cluster with 3 slave nodes.
 
 
 
  (8/6/14, 13:59), Karthik Kambatla wrote:
 
  Hi folks,
 
  I have put together a release candidate (rc2) for Hadoop 2.5.0.
 
  The RC is available at:
 http://people.apache.org/~kasha/hadoop-2.5.0-RC2/
  The RC tag in svn is here:
  https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.5.0-rc2/
  The maven artifacts are staged at:
 
 https://repository.apache.org/content/repositories/orgapachehadoop-1009/
 
  You can find my public key at:
  http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS
 
  Please try the release and vote. The vote will run for the now usual 5
  days.
 
  Thanks
 
 
 




-- 
Zhijie Shen
Hortonworks Inc.
http://hortonworks.com/

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.