Re: [jira] [Commented] (MAPREDUCE-3283) mapred classpath CLI does not display the complete classpath

2015-01-12 Thread Mohammad Affan Zafar 
Hey I want to contribute to apache hadoop. But unable to build after
downloading source code from github.
Can somebody help me in starting to contribute hadoop.

Thanks
Affan

On Tue, Jan 13, 2015 at 12:13 AM, Varun Saxena (JIRA) j...@apache.org
wrote:


 [
 https://issues.apache.org/jira/browse/MAPREDUCE-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14273922#comment-14273922
 ]

 Varun Saxena commented on MAPREDUCE-3283:
 -

 Kindly review

  mapred classpath CLI does not display the complete classpath
  
 
  Key: MAPREDUCE-3283
  URL:
 https://issues.apache.org/jira/browse/MAPREDUCE-3283
  Project: Hadoop Map/Reduce
   Issue Type: Bug
   Components: scripts
 Affects Versions: 0.23.0, 2.6.0
 Reporter: Ramya Sunil
 Assignee: Varun Saxena
 Priority: Minor
   Labels: newbie
  Attachments: MAPREDUCE-3283.001.patch, MAPREDUCE-3283.002.patch
 
 
  bin/yarn classpath does not display the complete classpath. Below is how
 the classpath looks like:
  {noformat}
 
 $HADOOP_CONF_DIR:$HADOOP_CONF_DIR::$TOOLS_JAR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:
  $HADOOP_MAPRED_HOME/bin/../modules/*:$HADOOP_MAPRED_HOME/bin/../lib/*
  {noformat}
  * has to be substituted with the actual jars. Also, $HADOOP_CONF_DIR
 appears twice in the classpath



 --
 This message was sent by Atlassian JIRA
 (v6.3.4#6332)

[jira] [Updated] (MAPREDUCE-6192) Create unit test to automatically compare MR related classes and mapred-default.xml

2015-01-12 Thread Ray Chiang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ray Chiang updated MAPREDUCE-6192:
--
Attachment: MAPREDUCE-6192.001.patch

Upload initial unit test.

 Create unit test to automatically compare MR related classes and 
 mapred-default.xml
 ---

 Key: MAPREDUCE-6192
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6192
 Project: Hadoop Map/Reduce
  Issue Type: Improvement
Affects Versions: 2.6.0
Reporter: Ray Chiang
Assignee: Ray Chiang
Priority: Minor
  Labels: supportability
 Attachments: MAPREDUCE-6192.001.patch


 Create a unit test that will automatically compare the fields in the various 
 MapReduce related classes and mapred-default.xml. It should throw an error if 
 a property is missing in either the class or the file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (MAPREDUCE-6215) Map is not cleared in SortedMapWritable.readFields(DataInput in)

2015-01-12 Thread Ahmed Radwan (JIRA) 
Ahmed Radwan created MAPREDUCE-6215:
---

 Summary: Map is not cleared in 
SortedMapWritable.readFields(DataInput in)
 Key: MAPREDUCE-6215
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6215
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv1, mrv2
Affects Versions: trunk
Reporter: Ahmed Radwan


The readFields(DataInput in) in SortedMapWritable doesn't reset the internally 
used SortedMap. If this Writable object is reused then entries will get 
accumulated in the map with every call of readFields().

I have seen this behavior when using SequenceFileInputFormat. See  
SequenceFileRecordReader.java and SequenceFile.Reader.

 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (MAPREDUCE-6215) Map is not cleared in SortedMapWritable.readFields(DataInput in)

2015-01-12 Thread Ahmed Radwan (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ahmed Radwan updated MAPREDUCE-6215:

Attachment: apache-sortedMapWritable.patch

This small attached patch should solve this issue where the map is cleared at 
the beginning of readFields() which guarantees older entries from previous 
calls are removed before new entries are added to the map.

 Map is not cleared in SortedMapWritable.readFields(DataInput in)
 

 Key: MAPREDUCE-6215
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6215
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: mrv1, mrv2
Affects Versions: trunk
Reporter: Ahmed Radwan
 Attachments: apache-sortedMapWritable.patch


 The readFields(DataInput in) in SortedMapWritable doesn't reset the 
 internally used SortedMap. If this Writable object is reused then entries 
 will get accumulated in the map with every call of readFields().
 I have seen this behavior when using SequenceFileInputFormat. See  
 SequenceFileRecordReader.java and SequenceFile.Reader.
  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (MAPREDUCE-3283) mapred classpath CLI does not display the complete classpath

2015-01-12 Thread Varun Saxena (JIRA) 

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14273922#comment-14273922
 ] 

Varun Saxena commented on MAPREDUCE-3283:
-

Kindly review

 mapred classpath CLI does not display the complete classpath
 

 Key: MAPREDUCE-3283
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3283
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: scripts
Affects Versions: 0.23.0, 2.6.0
Reporter: Ramya Sunil
Assignee: Varun Saxena
Priority: Minor
  Labels: newbie
 Attachments: MAPREDUCE-3283.001.patch, MAPREDUCE-3283.002.patch


 bin/yarn classpath does not display the complete classpath. Below is how the 
 classpath looks like:
 {noformat}
 $HADOOP_CONF_DIR:$HADOOP_CONF_DIR::$TOOLS_JAR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:
 $HADOOP_MAPRED_HOME/bin/../modules/*:$HADOOP_MAPRED_HOME/bin/../lib/*
 {noformat}
 * has to be substituted with the actual jars. Also, $HADOOP_CONF_DIR 
 appears twice in the classpath



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)