[jira] [Resolved] (MAPREDUCE-4694) Inconsistency in reduce input record counters between the stable and evolving APIs

2017-03-08 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4694. Resolution: Won't Fix Assignee: (was: Harsh J) This bug's existed for over 5 years

[jira] [Resolved] (MAPREDUCE-2584) Check for serializers early, and give out more information regarding missing serializers

2016-10-26 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-2584. Resolution: Not A Problem Target Version/s: (was: 2.0.0-alpha) This may

[jira] [Resolved] (MAPREDUCE-6199) AbstractCounters are not reset completely on deserialization

2016-04-27 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-6199. Resolution: Fixed Uh sorry, the commit message timeline is confusing on this. This is indeed

[jira] [Resolved] (MAPREDUCE-6286) A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly.

2016-04-27 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-6286. Resolution: Fixed Uh sorry, the commit message timeline is confusing on this. This is indeed

[jira] [Reopened] (MAPREDUCE-6286) A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly.

2016-04-27 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened MAPREDUCE-6286: Reopening this to set the right resolution state. Since the fix was reverted and never added back

[jira] [Reopened] (MAPREDUCE-6199) AbstractCounters are not reset completely on deserialization

2016-04-27 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened MAPREDUCE-6199: This was reverted and never added back. Reopening to set the right state as it isn't "

[jira] [Reopened] (MAPREDUCE-2398) MRBench: setting the baseDir parameter has no effect

2016-04-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened MAPREDUCE-2398: > MRBench: setting the baseDir parameter has no eff

[jira] [Reopened] (MAPREDUCE-2398) MRBench: setting the baseDir parameter has no effect

2016-04-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened MAPREDUCE-2398: Assignee: Wilfred Spiegelenburg > MRBench: setting the baseDir parameter has no eff

[jira] [Resolved] (MAPREDUCE-2398) MRBench: setting the baseDir parameter has no effect

2016-04-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-2398. Resolution: Fixed > MRBench: setting the baseDir parameter has no eff

[jira] [Resolved] (MAPREDUCE-2398) MRBench: setting the baseDir parameter has no effect

2016-04-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-2398. Resolution: Later (Trying a resolve to reset the IN-PROGRESS state as there seems

[jira] [Resolved] (MAPREDUCE-4045) RM UI -> Applications -> Application Master Link -> Job Link -> New Maps/Reduces leads to circular redirect error

2016-03-03 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4045. Resolution: Duplicate Fix Version/s: MAPREDUCE-3706 > RM UI -> Applic

[jira] [Resolved] (MAPREDUCE-6592) MR ApplicationMaster is not supposed to resolve rack locality! It should ask RM or NN about the topology

2015-12-29 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-6592. Resolution: Duplicate Assignee: Harsh J Dupe of YARN-435 > MR ApplicationMas

Re: Cannot connect to git.apache.org

2015-07-18 Thread Harsh J
Ted's URL fetches you a mirrored repository from GitHub.com instead, which is absolutely fine to use as an alternate. There might have been an infrastructure issue when you were attempting to access the original Apache git repository. In trying the regular Apache git repository now, it appears to

[jira] [Created] (MAPREDUCE-6383) Pi job (QuasiMonteCarlo) should not try to read the results file if its job fails

2015-06-03 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-6383: -- Summary: Pi job (QuasiMonteCarlo) should not try to read the results file if its job fails Key: MAPREDUCE-6383 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6383

[jira] [Resolved] (MAPREDUCE-6179) Running any MapReduce jobs is throwing Heap Error

2015-06-03 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-6179. Resolution: Invalid Please use user@ mailing lists for general questions. The JIRA

[jira] [Created] (MAPREDUCE-6325) Support use of ephemeral client ports for shuffle/etc.

2015-04-21 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-6325: -- Summary: Support use of ephemeral client ports for shuffle/etc. Key: MAPREDUCE-6325 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6325 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-4931) Add user-APIs for classpath precedence control

2015-03-25 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4931. Resolution: Not a Problem Target Version/s: (was: 3.0.0) Closing out

[jira] [Resolved] (MAPREDUCE-5556) mapred docs have incorrect classpath

2015-03-18 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-5556. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Harsh J Hadoop Flags

[jira] [Resolved] (MAPREDUCE-3536) consider whether the same instance of a ServiceStateChangeListener should be allowed to listen to events

2015-03-18 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-3536. Resolution: Duplicate consider whether the same instance of a ServiceStateChangeListener

[jira] [Resolved] (MAPREDUCE-2397) Allow user to sort jobs in different sections (Completed, Failed, etc.) by the various columns available

2015-03-17 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-2397. Resolution: Won't Fix MR2 has this feature already. Allow user to sort jobs in different

[jira] [Resolved] (MAPREDUCE-2557) Counters don't reset state when readFields() called

2015-03-17 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-2557. Resolution: Duplicate This should be resolved via MAPREDUCE-6199 (which adds in a reset API

[jira] [Resolved] (MAPREDUCE-1557) MapReduce teragen example should print correct error message for invalid inputs. Currently throws ArrayIndexOutOfBoundsException .

2015-03-17 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-1557. Resolution: Duplicate MapReduce teragen example should print correct error message

[jira] [Resolved] (MAPREDUCE-6145) No space in an error output message

2015-03-17 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-6145. Resolution: Not a Problem @Avinash - I suggest emailing u...@hadoop.apache.org for general

[jira] [Resolved] (MAPREDUCE-6276) Error in encrypted shuffle

2015-03-17 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-6276. Resolution: Invalid Please use the community lists/forums for user-level issues. The JIRA

[jira] [Resolved] (MAPREDUCE-2561) Typo in a comment in TaskInProgress.java

2015-03-16 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-2561. Resolution: Not a Problem Resolving as this has gone stale. If there's a substantial amount

[jira] [Resolved] (MAPREDUCE-6039) mapreduce.v2.hs.webapp.dao.TestJobInfo is using old name of job history file

2015-03-16 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-6039. Resolution: Not a Problem Resolving per Jason's earlier comment. Separate JIRA can be filed

[jira] [Resolved] (MAPREDUCE-1096) Add getNames method to VerticaRecord to retrieve input column names

2015-03-16 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-1096. Resolution: Not a Problem The vertica contrib connector does not exist anymore in the current

[jira] [Resolved] (MAPREDUCE-410) JobTracker TaskInitialization failure on cygwin

2015-03-16 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-410. --- Resolution: Cannot Reproduce This has gone stale. Checkout the windows support in branch-1-win

Re: MR Code example with Kerberos Authentication

2015-02-23 Thread Harsh J
-- Harsh J

Re: Using hadoop with other distributed filesystems

2014-12-17 Thread Harsh J
: Exiting with status 1 I really appreciate if any one help about these problems. Thanks in advance, -- Behrooz -- Harsh J

[jira] [Created] (MAPREDUCE-6194) Bubble up final exception in failures during creation of output collectors

2014-12-13 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-6194: -- Summary: Bubble up final exception in failures during creation of output collectors Key: MAPREDUCE-6194 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6194 Project

[jira] [Resolved] (MAPREDUCE-1587) NPE in JobClient querying an (empty) queue

2014-07-20 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-1587. Resolution: Cannot Reproduce No longer an issue with recent releases (for the described

Re: How to process part of a file in Hadoop?

2014-02-07 Thread Harsh J
-9941506562* -- Harsh J

Re: how to set org.apache.hadoop classpath?

2014-01-27 Thread Harsh J
received this communication in error,please immediately notify the sender by return e-mail, and delete the original message and all copies from your system. Thank you. --- -- Harsh J

[jira] [Resolved] (MAPREDUCE-5705) mapreduce.task.io.sort.mb hardcoded cap at 2047

2014-01-04 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-5705. Resolution: Duplicate What Gera said. Also, please see MAPREDUCE-4866. Marking this one

Re: About block splitting, input split and TextInputFormat in MapReduce

2013-10-19 Thread Harsh J
== 1.01 SPLIT_SLOP, so it just becomes one input splits!!) Thank you for reading my very long question! -- Harsh J

[jira] [Created] (MAPREDUCE-5492) Suppress expected log output stated on MAPREDUCE-5

2013-09-03 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-5492: -- Summary: Suppress expected log output stated on MAPREDUCE-5 Key: MAPREDUCE-5492 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5492 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-102) NPE in tracker expiry thread.

2013-09-03 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-102. --- Resolution: Not A Problem Not a problem anymore on any of the recent stable releases - and we've

[jira] [Resolved] (MAPREDUCE-104) Not able to refresh file cache

2013-09-03 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-104. --- Resolution: Cannot Reproduce This has gone stale. I tried running a test as described by Hairong

[jira] [Resolved] (MAPREDUCE-113) [mapred] Job submission to an invalid queue should fail.

2013-09-03 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-113. --- Resolution: Not A Problem Looks like we already have this immediate-failure (regardless of ACLs

Re: Abstraction layer to support both YARN and Mesos

2013-07-26 Thread Harsh J
MRv2's code base is tightly coupled with YARN currently. Thoughts? - Tsuyoshi -- Harsh J

Re: I wrote a scheduler. How to compile and put it to action?

2013-07-08 Thread Harsh J
. Sincerely, Sreejith R P. S: I had asked another question recently. I got very good answers. I was so busy I couldn't even thank them. Special thanks to Kun Ling -- Harsh J

[jira] [Created] (MAPREDUCE-5288) ResourceEstimator#getEstimatedTotalMapOutputSize suffers from divide by zero issues

2013-06-01 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-5288: -- Summary: ResourceEstimator#getEstimatedTotalMapOutputSize suffers from divide by zero issues Key: MAPREDUCE-5288 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5288

Re: How to handle multiline record for inputsplit?

2013-05-21 Thread Harsh J
. Thanks in advance. DR -- Harsh J

Re: [VOTE] Plan to create release candidate for 0.23.8

2013-05-17 Thread Harsh J
-- Harsh J

Re: which mapreduce project to work on?

2013-05-15 Thread Harsh J
, that some reduce work begin before all maps ends their job. The very first question is which project from svn is more adequate to work on/develop? Second, is there a possibility to implement such a thing and if yes which classes/packages should I look in? thanks, Elma -- Harsh J

Re: JVM vs container memory configs

2013-05-05 Thread Harsh J
should be left on top of mapred.child.java.opts (or other similar JVM opts) for the container memory itself? I would like to have separated java option settings for map/reduce parts. Something like mapred.map.child.java.opts mapred.reduce.child.java.opts. -- Harsh J

Re: JVM vs container memory configs

2013-05-05 Thread Harsh J
While I think work should be done to make the numbers nearby, we should ideally raise the JVM heap value than lower the memory.mb resource request of MR tasks. Otherwise, with YARN, users will start seeing more containers per node than before. Also good to raise heap plus the sort buffer memory

Re: Versions - Confusion

2013-05-01 Thread Harsh J
,* *National Institute of Technology,* *Tiruchirappalli - 620015.* *+91-9941506562* -- Harsh J

Re: Build failed for Hadoop-1.0.4

2013-04-29 Thread Harsh J
, I build one of the Hadoop version(I don't remember which one but was successful in building with ant but now I got this error, file missing. Regards thoihen Regards thoihen -- Harsh J

Re: MapTask.java -sort part

2013-04-23 Thread Harsh J
); *in sortAndSpill method but no changes seen in result. I have expected to get unsorted keys as mapper output but was not like that. My question is did i perform right action to disable sort or something else needs to be done ? Samaneh -- Harsh J

Re: MapTask.java -sort part

2013-04-23 Thread Harsh J
is appropriate version for me ? Samaneh On Tue, Apr 23, 2013 at 10:01 AM, Harsh J ha...@cloudera.com wrote: Note that the Reducer also does a merge sort over the acquired map data; but am not sure if you looked there as well. Mariappan's pointed JIRA (MAPREDUCE-4807) is already available

Re: JobConf and MiniMapRedCluster

2013-04-18 Thread Harsh J
from some light googling that, at some point ** some version of JobConf was deprecated, and that maybe again it was undeprecated or maybe moved** Will have to look into this more formally to really determine what's going on. On Apr 18, 2013, at 1:16 AM, Harsh J ha...@cloudera.com

Re: JobConf and MiniMapRedCluster

2013-04-17 Thread Harsh J
a JIRA? -- Jay Vyas http://jayunit100.blogspot.com -- Harsh J

Re: JobConf and MiniMapRedCluster

2013-04-17 Thread Harsh J
updates if this makes sense :) Would love to bring the minimrcluster class up to date! On Apr 18, 2013, at 12:49 AM, Harsh J ha...@cloudera.com wrote: Why do you imagine a test case would need the Configured and Tool interfaces, which are more useful for actual client apps? Because

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-16 Thread Harsh J
Hortonworks Inc. http://hortonworks.com/ -- Harsh J

Re: [VOTE] Release Apache Hadoop 0.23.7

2013-04-16 Thread Harsh J
in svn is here: http://svn.apache.org/viewvc/hadoop/common/tags/release-0.23.7-rc0/ The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the usual 7 days. thanks, Tom Graves -- Harsh J

[jira] [Resolved] (MAPREDUCE-5100) jobconf_history.jsp is not showing job configs in case of retired jobs

2013-04-12 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-5100. Resolution: Cannot Reproduce Fix Version/s: 1.3.0 Tried on branch-1 and an earlier

[jira] [Resolved] (MAPREDUCE-5106) mapreduce.jobtracker.split.metainfo.maxsize can be set at job level

2013-03-27 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-5106. Resolution: Not A Problem Looking at branch-1's implementation (JobInProgress

Re: Help on submitting a patch for an unassigned bug

2013-03-26 Thread Harsh J
but couldn't find related to assigning the bug or may be I missed out somewhere. Thanks in advance. Regards, Niranjan -- Harsh J

[jira] [Reopened] (MAPREDUCE-1380) Adaptive Scheduler

2013-03-25 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened MAPREDUCE-1380: Unsure why this was resolved as fixed. Its not been committed anywhere, so reopening

Re: shuffling one intermediate pair to more than one reducer

2013-03-24 Thread Harsh J
Thank you. -- Thanx and Regards Vikas Jadhav -- Harsh J

Re: In the constructor of JobInProgress, why is it safe to call FileSyste.closeAllForUGI().

2013-03-22 Thread Harsh J
more 2013-03-21 21:04:56,979 INFO org.apache.hadoop.hdfs.DFSClient: read.type=dfs block=blk_972265969568196888_2183 src=/home/ec2-user/Hadoop/tmp/mapred/staging/ec2-user/.staging/job_201303212104_0005/job.splitmetainfo Xiao Yu -- Harsh J

[jira] [Resolved] (MAPREDUCE-1849) Implement a FlumeJava-like library for operations over parallel collections using Hadoop MapReduce

2013-03-22 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-1849. Resolution: Implemented Crunch is now a top level Apache project (Apache Crunch): http

Re: Why In-memory Mapoutput is necessary in ReduceCopier

2013-03-17 Thread Harsh J
, Ling Kun -- http://www.lingcc.com -- http://www.lingcc.com -- Harsh J

Re: [Vote] Merge branch-trunk-win to trunk

2013-02-27 Thread Harsh J
and precommit build is clean. 2. Start a discussion on adding Jenkins precommit builds on windows and how to integrate that with the existing commit process. Let me know if you have any questions. Regards, Suresh -- http://hortonworks.com/download/ -- Harsh J

Re: mapreduce.jobtracker.address vs. yarn.resourcemanager.address

2013-02-10 Thread Harsh J
that not sound right to you Harsh? Was there a conclusion on: may I deprecate it, or is there a larger decision being waited on? -Sandy On Fri, Feb 8, 2013 at 9:35 PM, Harsh J ha...@cloudera.com wrote: Yes, there isn't a classic version of mapreduce.framework.name now either. Its mostly being used

Re: pre-historic record IO stuff, is this used anywhere?

2013-02-08 Thread Harsh J
-- Alejandro -- Harsh J

Re: API incompatibility between Hadoop 1.0 and Hadoop 2.0

2013-02-08 Thread Harsh J
, Is there a documented list of API incompatibility between version 1.0 and version 2.0 of APIs. -- Have a Nice Day! Lohit -- Harsh J

Re: mapreduce.jobtracker.address vs. yarn.resourcemanager.address

2013-02-08 Thread Harsh J
deprecate these configs. Thanks, +Vinod On Feb 8, 2013, at 2:15 PM, Sandy Ryza wrote: Is there a reason why mapreduce.jobtracker.address is not deprecated to yarn.resourcemanager.address? thanks, Sandy -- Alejandro -- Harsh J

Re: API incompatibility between Hadoop 1.0 and Hadoop 2.0

2013-02-08 Thread Harsh J
with. For example JobContext was class in 1.0 while Interface in 2.0. So, user has to change code. I was more interested in such cases (if it was documented) 2013/2/8 Harsh J ha...@cloudera.com Hey Lohit, It may not be exactly in the form you're looking for, but take a look at Dave's API Evolution page

[jira] [Created] (MAPREDUCE-4931) Add user-APIs for classpath precedence control

2013-01-10 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-4931: -- Summary: Add user-APIs for classpath precedence control Key: MAPREDUCE-4931 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4931 Project: Hadoop Map/Reduce

Re: running Combiner for all the task on the node.

2013-01-02 Thread Harsh J
,* *National Institute of Technology,* *Tiruchirappalli - 620015.* *+91-9941506562* -- Harsh J

Re: How to compile the JobTracker.java

2012-12-17 Thread Harsh J
Rodrigo Kepe* Graduando em Ciência da Computação - UFPR Analista de Desenvolvimento na Siemens Enterprise. -- Harsh J

Re: Fate of skipping-bad-records feature (MAPREDUCE-4840)

2012-12-03 Thread Harsh J
not aware of anyone working on this. I did attempt it myself once, pre-MR2 days, but we wound up deciding it is unsuitable to support this ourselves. -- Harsh J

[jira] [Resolved] (MAPREDUCE-4183) Clean up yarn-common

2012-12-01 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4183. Resolution: Won't Fix Patches were too broad and have gone stale. Will address these forms

[jira] [Reopened] (MAPREDUCE-4182) Remove an used import from TestDistributedShell

2012-12-01 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened MAPREDUCE-4182: Remove an used import from TestDistributedShell

[jira] [Resolved] (MAPREDUCE-4176) Clean up hadoop-mapreduce-client-hs

2012-12-01 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4176. Resolution: Won't Fix Patches were too broad and have gone stale. Will address these forms

[jira] [Resolved] (MAPREDUCE-4173) Clean up hadoop-mapreduce-client-app

2012-12-01 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4173. Resolution: Won't Fix Patches were too broad and have gone stale. Will address these forms

[jira] [Resolved] (MAPREDUCE-4172) Clean up java warnings in the hadoop-mapreduce-project sub projects

2012-12-01 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4172. Resolution: Won't Fix Patches were too broad and have gone stale. Will address these forms

Re: Shuffle phase: fine-grained control of data flow

2012-11-07 Thread Harsh J
to choose reduce nodes does not help reduce network traffic. If JobTracker is fully aware of locations of every map output, why not take advantage of this topology knowledge? So, is there anyone who knows where to develop such codes upon? Many thanks. Regards. -- Jiwei -- Harsh J

[jira] [Resolved] (MAPREDUCE-4773) MultipleOutput with different output path for each

2012-11-06 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4773. Resolution: Not A Problem Good to know. In future, please use the user-lists when you have

[jira] [Created] (MAPREDUCE-4694) Inconsistency in reduce record and counters between the stable and evolving APIs

2012-10-01 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-4694: -- Summary: Inconsistency in reduce record and counters between the stable and evolving APIs Key: MAPREDUCE-4694 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4694

[jira] [Created] (MAPREDUCE-4695) Fix LocalRunner on trunk after MAPREDUCE-3223 broke it

2012-10-01 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-4695: -- Summary: Fix LocalRunner on trunk after MAPREDUCE-3223 broke it Key: MAPREDUCE-4695 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4695 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-4692) Investigate and remove MR1 JTConfig and its constants use in the MR project on trunk

2012-09-28 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-4692: -- Summary: Investigate and remove MR1 JTConfig and its constants use in the MR project on trunk Key: MAPREDUCE-4692 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4692

[jira] [Resolved] (MAPREDUCE-4690) remove deprecated properties in the default configurations

2012-09-27 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4690. Resolution: Duplicate Fix Version/s: (was: 3.0.0) Hi, please see MAPREDUCE-3223

Re: I want join of you

2012-09-27 Thread Harsh J
Welcome to the development community, Lamosi! Take a look at http://wiki.apache.org/hadoop/HowToContribute to get started. On Fri, Sep 28, 2012 at 7:00 AM, Lamosi lamosi2...@gmail.com wrote: Because I want to learn someting about hadoop, so I want to subscribe to the list,tank you. -- Harsh

Re: More than one RM in YARN?

2012-09-19 Thread Harsh J
? Bikas -Original Message- From: Harsh J [mailto:ha...@cloudera.com] Sent: Tuesday, September 18, 2012 9:37 PM To: mapreduce-dev@hadoop.apache.org Subject: Re: More than one RM in YARN? Chris, Not yet, it is coming: https://issues.apache.org/jira/browse/MAPREDUCE-4326 should go in first

Re: Where does the MapReduce framework direct the DataNode to perform I/O on behalf of a job?

2012-08-23 Thread Harsh J
the DataNode, which only sees generic requests made by the DFSClient. So, what I'd like to know is how requests originating from the TaskTracker make their way to the DataNode. Any help would be appreciated. Adrian -- Harsh J

[jira] [Created] (MAPREDUCE-4574) Fix TotalOrderParitioner to work with non-WritableComparable key types

2012-08-22 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-4574: -- Summary: Fix TotalOrderParitioner to work with non-WritableComparable key types Key: MAPREDUCE-4574 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4574 Project

Re: Significance of file.out.index during Shuffle Phase ?

2012-08-19 Thread Harsh J
. During the executions of MapReduce, I see that *file.out* is created on Map nodes, so my question is how does a reducer know what part of file.out to fetch? Is the *file.out.index* play any role? Any help is appreciated .Thanks --With Regards Pavan Kulkarni -- Harsh J

Re: MAPREDUCE-4068

2012-08-12 Thread Harsh J
turned to be bad design pattern? -- Harsh J

[jira] [Resolved] (MAPREDUCE-4415) Backport the Job.getInstance methods from MAPREDUCE-1505 to branch-1

2012-07-24 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-4415. Resolution: Fixed Backport the Job.getInstance methods from MAPREDUCE-1505 to branch-1

[jira] [Resolved] (MAPREDUCE-2076) Showing inputsplit filename/offset inside the webui or tasklog

2012-07-24 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-2076. Resolution: Duplicate Dupe of MAPREDUCE-3678 presently, closing out. Showing

[jira] [Created] (MAPREDUCE-4454) MR does not audit-log the job kill operations

2012-07-18 Thread Harsh J (JIRA)
Harsh J created MAPREDUCE-4454: -- Summary: MR does not audit-log the job kill operations Key: MAPREDUCE-4454 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4454 Project: Hadoop Map/Reduce

Re: [jira] [Reopened] (MAPREDUCE-4422) YARN_APPLICATION_CLASSPATH needs a documented default value in YarnConfiguration

2012-07-13 Thread Harsh J
://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira -- Harsh J

[jira] [Resolved] (MAPREDUCE-1720) 'Killed' jobs and 'Failed' jobs should be displayed seperately in JobTracker UI

2012-07-13 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-1720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-1720. Resolution: Not A Problem Target Version/s: (was: 0.22.0) Given that the UI does

Re: status update

2012-07-11 Thread Harsh J
Hey Miomir, Commented. On Wed, Jul 11, 2012 at 1:05 PM, mio...@internet.is wrote: Hi everyone, Could someone update the status of MAPREDUCE-2825. Class TestRackAwareTaskPlacement doesn't seem to exist anymore? Miomir Boljanovic -- Harsh J

[jira] [Resolved] (MAPREDUCE-2825) Factor out commonly used code in mapred testcases

2012-07-11 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved MAPREDUCE-2825. Resolution: Not A Problem Miomir, This issue has gone stale over the past few years

[jira] [Reopened] (MAPREDUCE-4253) Tests for mapreduce-client-core are lying under mapreduce-client-jobclient

2012-07-11 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened MAPREDUCE-4253: Reopening to locate and commit the missed 12 files. Tests for mapreduce-client

  1   2   3   >