Re: Branch merges and 3.0.0-beta1 scope

2017-08-22 Thread Ray Chiang
On 8/22/17 3:20 AM, Steve Loughran wrote: On 21 Aug 2017, at 22:22, Vinod Kumar Vavilapalli wrote: Steve, You can be strict & ruthless about the timelines. Anything that doesn’t get in by mid-September, as was originally planned, can move to the next release - whether it is feature work on

Re: [DISCUSS] A final minor release off branch-2?

2017-11-15 Thread Ray Chiang
On 11/15/17 10:34 AM, Andrew Wang wrote: Hi Junping, On Wed, Nov 15, 2017 at 1:37 AM, Junping Du wrote: 3. Beside incompatibilities, there is also possible to have performance regressions (lower throughput, higher latency, slower job running, bigger memory footprint or even memory leaking, etc

Re: Removal of unused properties

2015-04-09 Thread Ray Chiang
We have done this before where the properties were documented in the .xml file, but didn't exist anywhere in the Configuration files or the rest of the code. HDFS-7566 (committed) YARN-2460 (committed) MAPREDUCE-6057 (pending) -Ray On Thu, Apr 9, 2015 at 4:33 AM, Akira AJISAKA wrote: > Hi Folk

Question about org.apache.hadoop.yarn.webapp.Dispatcher

2015-04-29 Thread Ray Chiang
In Dispatcher#service(), I see this comment: // TODO: support args converted from /path/:arg1/... dest.action.invoke(controller, (Object[]) null); Right now, I've made some changes in MAPREDUCE-6222 that seems to trigger exceptions at this TODO. Can someone give me a clearer idea abo

New unit tests for *-default.xml verification

2015-05-12 Thread Ray Chiang
I was going to update the Wiki with the information, but it seems to be down for me at the moment. A few people have already bumped into some issues, so I'm informing via the *-dev lists for now. In trunk, there are three new unit tests: TestMapreduceConfigFields (MAPREDUCE-6192) TestYar

Re: Newcomer developer seeking to copntribute

2015-07-13 Thread Ray Chiang
Welcome aboard. I'd recommend reading the HowToContribute wiki for understanding the contribution process. For other tips on getting started, there is the "newbie" label in JIRA, but it's an imperfect sorting. I recommend doing the following: 1) Look at unit test JIRAs, both open and closed. T

[jira] [Created] (MAPREDUCE-6901) Remove DistributedCache from trunk

2017-06-16 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6901: - Summary: Remove DistributedCache from trunk Key: MAPREDUCE-6901 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6901 Project: Hadoop Map/Reduce Issue

[jira] [Created] (MAPREDUCE-6902) [Umbrella] API related cleanup for Hadoop 3

2017-06-16 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6902: - Summary: [Umbrella] API related cleanup for Hadoop 3 Key: MAPREDUCE-6902 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6902 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-6340) Remove .xml and documentation references to dfs.webhdfs.enabled

2015-04-27 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6340: - Summary: Remove .xml and documentation references to dfs.webhdfs.enabled Key: MAPREDUCE-6340 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6340 Project

[jira] [Created] (MAPREDUCE-6349) Fix typo in property org.apache.hadoop.mapreduce.lib.chain.Chain.REDUCER_INPUT_VALUE_CLASS

2015-05-01 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6349: - Summary: Fix typo in property org.apache.hadoop.mapreduce.lib.chain.Chain.REDUCER_INPUT_VALUE_CLASS Key: MAPREDUCE-6349 URL: https://issues.apache.org/jira/browse/MAPREDUCE

[jira] [Created] (MAPREDUCE-6358) Document missing properties in mapred-default.xml

2015-05-06 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6358: - Summary: Document missing properties in mapred-default.xml Key: MAPREDUCE-6358 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6358 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-6376) Fix long load times of .jhist file in JobHistoryServer

2015-05-28 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6376: - Summary: Fix long load times of .jhist file in JobHistoryServer Key: MAPREDUCE-6376 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6376 Project: Hadoop Map

[jira] [Created] (MAPREDUCE-6388) Remove deprecation warnings from JobHistoryServer classes

2015-06-05 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6388: - Summary: Remove deprecation warnings from JobHistoryServer classes Key: MAPREDUCE-6388 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6388 Project: Hadoop Map

[jira] [Created] (MAPREDUCE-6394) Avoid copying counters in task reports for Job History Server

2015-06-10 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6394: - Summary: Avoid copying counters in task reports for Job History Server Key: MAPREDUCE-6394 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6394 Project

[jira] [Created] (MAPREDUCE-6406) Update FileOutputCommitter.FILEOUTPUTCOMMITTER_ALGORITHM_VERSION_DEFAULT to match mapred-default.xml

2015-06-18 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6406: - Summary: Update FileOutputCommitter.FILEOUTPUTCOMMITTER_ALGORITHM_VERSION_DEFAULT to match mapred-default.xml Key: MAPREDUCE-6406 URL: https://issues.apache.org/jira/browse

[jira] [Created] (MAPREDUCE-6421) Fix Findbugs pre-patch warning in org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.reduceNodeLabelExpression

2015-06-29 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6421: - Summary: Fix Findbugs pre-patch warning in org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator.reduceNodeLabelExpression Key: MAPREDUCE-6421 URL: https

[jira] [Created] (MAPREDUCE-6432) Fix typos in hadoop-mapreduce-project module

2015-07-10 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6432: - Summary: Fix typos in hadoop-mapreduce-project module Key: MAPREDUCE-6432 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6432 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-6613) Change mapreduce.jobhistory.jhist.format default from json to binary

2016-01-21 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6613: - Summary: Change mapreduce.jobhistory.jhist.format default from json to binary Key: MAPREDUCE-6613 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6613 Project

[jira] [Created] (MAPREDUCE-6622) Add capability to set JHS job cache to a task-based limit

2016-01-28 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6622: - Summary: Add capability to set JHS job cache to a task-based limit Key: MAPREDUCE-6622 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6622 Project: Hadoop Map

[jira] [Created] (MAPREDUCE-6685) LocalDistributedCacheManager can have overlapping filenames

2016-04-26 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6685: - Summary: LocalDistributedCacheManager can have overlapping filenames Key: MAPREDUCE-6685 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6685 Project: Hadoop

[jira] [Reopened] (MAPREDUCE-6685) LocalDistributedCacheManager can have overlapping filenames

2016-05-31 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang reopened MAPREDUCE-6685: --- > LocalDistributedCacheManager can have overlapping filena

[jira] [Resolved] (MAPREDUCE-6685) LocalDistributedCacheManager can have overlapping filenames

2016-05-31 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang resolved MAPREDUCE-6685. --- Resolution: Duplicate Target Version/s: (was: ) Properly closing as duplicate

[jira] [Created] (MAPREDUCE-6051) Fix typos in log messages

2014-08-25 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6051: - Summary: Fix typos in log messages Key: MAPREDUCE-6051 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6051 Project: Hadoop Map/Reduce Issue Type

[jira] [Created] (MAPREDUCE-6057) Remove obsolete entries from mapred-default.xml

2014-08-27 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6057: - Summary: Remove obsolete entries from mapred-default.xml Key: MAPREDUCE-6057 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6057 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-6061) Fix MR_CLIENT_TO_AM_IPC_MAX_RETRIES_ON_TIMEOUTS property in MRJobConfig

2014-08-28 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6061: - Summary: Fix MR_CLIENT_TO_AM_IPC_MAX_RETRIES_ON_TIMEOUTS property in MRJobConfig Key: MAPREDUCE-6061 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6061

[jira] [Created] (MAPREDUCE-6192) Create unit test to automatically compare MR related classes and mapred-default.xml

2014-12-12 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6192: - Summary: Create unit test to automatically compare MR related classes and mapred-default.xml Key: MAPREDUCE-6192 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6192

[jira] [Created] (MAPREDUCE-6196) Fix BigDecimal ArithmeticException in PiEstimator

2014-12-15 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6196: - Summary: Fix BigDecimal ArithmeticException in PiEstimator Key: MAPREDUCE-6196 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6196 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-6253) Update use of Iterator to Iterable

2015-02-11 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6253: - Summary: Update use of Iterator to Iterable Key: MAPREDUCE-6253 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6253 Project: Hadoop Map/Reduce Issue

[jira] [Created] (MAPREDUCE-6254) Update use of Iterator to Iterable

2015-02-11 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6254: - Summary: Update use of Iterator to Iterable Key: MAPREDUCE-6254 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6254 Project: Hadoop Map/Reduce Issue

[jira] [Created] (MAPREDUCE-6266) Job#getTrackingURL should consistently return a proper URL

2015-02-26 Thread Ray Chiang (JIRA)
Ray Chiang created MAPREDUCE-6266: - Summary: Job#getTrackingURL should consistently return a proper URL Key: MAPREDUCE-6266 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6266 Project: Hadoop