+1
Thanks
- Tsuyoshi
On Thu, May 14, 2020 at 19:42 Rakesh Radhakrishnan
wrote:
> +1
>
> Thanks,
> Rakesh
>
> On Wed, May 13, 2020 at 1:23 PM Elek, Marton wrote:
>
> >
> >
> > I would like to start a discussion to make a separate Apache project for
> > Ozone
> >
> >
> >
> > ### HISTORY [1]
> >
Thanks Viany for starting discussion.
+1
hadoop-thirdparty's release is required for 3.3.0 release because the
package includes shaded protobuf which 3.3.0 branch will depend on.
The plan sounds reasonable to me.
- Tsuyoshi
On Sat, Feb 22, 2020 at 6:31 AM Ayush Saxena wrote:
>
> Thanx Vinay
ion time by using syntax = "proto2""...
- Tsuyoshi
On Wed, Mar 29, 2017 at 9:13 AM, Tsuyoshi Ozawa <oz...@apache.org> wrote:
>> Stack mentioned a compatibility mode that uses the proto2 semantics.
>
> We can define protobuf's version by using syntax = "proto2" or
> Stack mentioned a compatibility mode that uses the proto2 semantics.
We can define protobuf's version by using syntax = "proto2" or syntax
= "proto3" in proto files with proto3 compiler. I think this is what
Stack mentioned as compatibility mode.
Forwarding to common-dev, hdfs-dev, mapreduce-dev too.
Thanks
- Tsuyoshi
2017年3月27日(月) 21:16 Tsuyoshi Ozawa <oz...@apache.org>:
> Dear Hadoop developers,
>
> After shaded client, introduced by HADOOP-11804, is merged,
> we can more easily update some dependency with min
> Chiwan Park reported Hadoop incompatibility by the change of HADOOP-11252.
> Now, HADOOP-13579 is committed to branch-2.6 and branch-2.7.
complement: HADOOP-13579 fixes the problem of incompatibility by HADOOP-11252.
Thanks,
- Tsuyoshi
On Fri, Sep 9, 2016 at 2:42 PM, Tsuyoshi Oza
Hi developers,
Chiwan Park reported Hadoop incompatibility by the change of HADOOP-11252.
Now, HADOOP-13579 is committed to branch-2.6 and branch-2.7.
Should we release 2.6.5 and 2.7.4 soon?
Thanks,
- Tsuyoshi
-
To
ess of
configuring yarn.app.mapreduce.am.env and mapreduce.admin.user.env...
does anyone hit same error?
This was because of completely my wrong configuration. Please ignore this.
Best,
- Tsuyoshi
On Sat, Sep 3, 2016 at 1:53 AM, Tsuyoshi Ozawa <oz...@apache.org> wrote:
> Thank
I'm sorry, very big typo I did... s/hardly/very hard/
Best
- Tsuyoshi
On Sat, Sep 3, 2016 at 1:53 AM, Tsuyoshi Ozawa <oz...@apache.org> wrote:
> Thanks for making this forward hardly, Andrew!
>
> In fact, I hit an error similar to Eric's one regardless of
> configuring yarn.ap
Thanks for making this forward hardly, Andrew!
In fact, I hit an error similar to Eric's one regardless of
configuring yarn.app.mapreduce.am.env and mapreduce.admin.user.env...
does anyone hit same error?
2016-09-02 16:49:35,223 INFO mapreduce.Job: The url to track the job:
n a 2.7.x.
>
> Best,
> Andrew
>
> On Tue, Jul 26, 2016 at 11:13 PM, Tsuyoshi Ozawa <oz...@apache.org> wrote:
>>
>> > Andrew: I bet many would assume it's the release date, like how Ubuntu
>> > releases are numbered.
>>
>> Good point. Maybe I
> Andrew: I bet many would assume it's the release date, like how Ubuntu
releases are numbered.
Good point. Maybe I confuse you because of lack of explanation.
I assume that "branch-cut off timing" mean the timing of freezing branch
like when starting the release vote. It's because that the
Hi developers,
I'd like to discuss how to make an advance towards dependency
management in Apache Hadoop trunk code since there has been lots work
about updating dependencies in parallel. Summarizing recent works and
activities as follows:
0) Currently, we have merged minimum update dependencies
rade work Tsuyoshi!
>
> On Thu, Jun 30, 2016 at 12:03 PM, Tsuyoshi Ozawa <oz...@apache.org> wrote:
>>
>> Thanks, Andrew.
>>
>> Based on discussion here, I would like to merge it into *trunk* if
>> there are no objection tomorrow.
>>
>> Thanks,
&g
in trunk.
>
> On Wed, Jun 29, 2016 at 12:27 PM, Tsuyoshi Ozawa <oz...@apache.org> wrote:
>>
>> I forgot to mention about importance point: it's a blocker issue to
>> compile Hadoop with JDK8. Hence, we need to merge it on both client
>> side and server slide anyway.
>
I forgot to mention about importance point: it's a blocker issue to
compile Hadoop with JDK8. Hence, we need to merge it on both client
side and server slide anyway.
Thanks,
- Tsuyoshi
On Wed, Jun 29, 2016 at 12:24 PM, Tsuyoshi Ozawa <oz...@apache.org> wrote:
> Thanks Vinod, Sang
; Assuming classpath isolation gets in, it is reasonable to bump up our
>> > dependencies like Jetty / Guice to the latest stable versions.
>> >
>> > Thanks
>> > +Vinod
>> >
>> >> On Jun 27, 2016, at 6:01 AM, Tsuyoshi Ozawa <oz...@apache.org> w
No objections here?
- Tsuyoshi
On Mon, Jun 27, 2016 at 6:01 AM, Tsuyoshi Ozawa <oz...@apache.org> wrote:
> Hi developers,
>
> I will plan to upgrade Google Guice dependency on trunk. The change
> also includes asm and cglib upgrade.
> I checked following points:
>
> *
Hi developers,
I will plan to upgrade Google Guice dependency on trunk. The change
also includes asm and cglib upgrade.
I checked following points:
* Both HDFS and YARN UIs work well.
* All webIU-related tests pass as described on HADOOP-12064.
* Ran mapreduce job, and it works well.
hith Sharma K S
>
>
> -Original Message-
> From: Tsuyoshi Ozawa [mailto:oz...@apache.org]
> Sent: 27 June 2016 16:10
> To: common-...@hadoop.apache.org; yarn-...@hadoop.apache.org;
> mapreduce-dev@hadoop.apache.org
> Subject: Failure to submit job on trunk hadoop cluster
Hi,
Have anyone tried to submit jobs on trunk cluster?
I failed to launch jobs by class not found error with following error
messages. Should I change environment variables to setup from
branch-2's one? I'm using the same configuration as Hadoop 2 can run.
$ hadoop jar
Hi Asanjar,
Thanks for your contribution! I'm ashamed to say, but I don't know how
to change the build machine.
Adding "to" Allen, who is a PMC of Yetus project. Hey Allen, do you
know how to add Power based Jenkins slave(s) to Apache Hadoop CI?
Thanks,
- Tsuyoshi
On Wed, May 18, 2016 at 11:18
> Before cutting 3.0.0-alpha RC, I'd like to drop JDK7 support in trunk.
Sounds good. To do so, we need to check the blockers of 3.0.0-alpha
RC, especially upgrading all dependencies which use refractions at
first.
Thanks,
- Tsuyoshi
On Tue, May 10, 2016 at 8:32 AM, Akira AJISAKA
Hi developers,
We’ve worked on upgrading jersey(HADOOP-9613) for a years. It's
essential change to support complication with JDK8. It’s almost there.
One concern to merge this to trunk is incompatibility. After the
release of Jersey 1.13, the root element whose content is empty
collection is
Hi,
I created slack channel for Hadoop community unofficially and experimentally:
https://hadoopdev.slack.com/
I know that there is IRC channel and it's good to log. However, Slack
is very also good tool to join easily and have a communication
interactively. It will be also useful to join
Hi Robert,
Thank you for taking the issue. Does the Jenkins slave have enough disk space?
- Tsuyoshi
On Wed, Feb 24, 2016 at 9:06 AM, Robert Kanter wrote:
> Hi all,
>
> I was trying to manually kick off a the PreCommit-MAPREDUCE job for
> MAPREDUCE-6622 because it wasn't
Tsuyoshi Ozawa created MAPREDUCE-6641:
-
Summary: TestTaskAttempt fails in trunk
Key: MAPREDUCE-6641
URL: https://issues.apache.org/jira/browse/MAPREDUCE-6641
Project: Hadoop Map/Reduce
Thanks Karthik and Dustin for pinging me. Yeah, I'll take a look at the tickets.
Thanks,
- Tsuyoshi
On Thu, Feb 18, 2016 at 9:57 PM, Dustin Cote wrote:
> Thanks Karthik! Yes, I will try reaching out to Tsuyoshi directly on these
> two. I appreciate the nudge in the right
[
https://issues.apache.org/jira/browse/MAPREDUCE-6341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tsuyoshi Ozawa resolved MAPREDUCE-6341.
---
Resolution: Fixed
Committed addendum patch to trunk, branch-2, branch-2.8. Thanks
+1(binding)
- Verified signatures.
- Ran tests for Apache Tez with the artifacts. All tests passed.
- Ran local cluster and ran some examples on it.
- Tsuyoshi
On Wed, Feb 10, 2016 at 2:18 AM, Sunil Govind wrote:
> +1 (non-binding) with one note,
>
> - Installed tar
+1 (binding)
- Verified checksum.
- Built from source code.
- Ran some tests and mr examples.
Thanks,
- Tsuyoshi
On Fri, Jan 15, 2016 at 1:57 PM, Vinod Kumar Vavilapalli
wrote:
> Hi all,
>
> I've created an updated release candidate RC2 for Apache Hadoop 2.7.2.
>
> As
Hi Vinod,
thank you for the clarification.
> - Pull these 16 tickets into 2.7.2 and roll a new RC
> > What do people think? Do folks expect “any fix in 2.6.3 to be there in all
> > releases that get out after 2.6.3 release date (December 16th)”?
I personally prefer to pull these tickets into
+1
- downloaded src and bin tar balls and verified signatures.
- built Tez and Spark with 2.7.2 artifacts and JDK7.
- ran tests of Tez with 2.7.2 artifacts, it passed.
FYI: YARN-4348, reported by Jian, is one of critical issues of 2.7.2
release.It's better to release 2.7.3 as soon as possible
+1 (binding)
- verified checksums
- built Spark and Tez with -Dhadoop.version=2.6.3. About Tez, ran
tests and all of them passed.
Thanks,
- Tsuyoshi
On Thu, Dec 17, 2015 at 1:30 AM, Sangjin Lee wrote:
> +1 (non-binding)
>
> - downloaded source and binary and verified the
Hi Junping,
Thank you for starting the voting.
I cannot access the tar.gz file because of permission error. Could you
check the permission to access the files?
> Forbidden
> You don't have permission to access
> /~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz on this server.
Thanks,
Thank you for starting discussion, Steve. It sounds good to me. I'll
check the test failures.
- Tsuyoshi
On Sun, Nov 22, 2015 at 9:21 PM, Steve Loughran wrote:
>
> Jenkins is pretty much dead in the water these days; a test run that works is
> a rare miracle rather
fixes as
> > quickly as possible, and they don't bear the same risk of regressions or
> > incompatibilities as code changes.
> >
> > --Chris Nauroth
> >
> >
> >
> >
> > On 7/16/15, 12:38 AM, "Tsuyoshi Ozawa" <oz...@apache.org <jav
Done.
- Tsuyoshi
On Wed, Oct 21, 2015 at 8:53 PM, Tsuyoshi Ozawa <oz...@apache.org> wrote:
> Thanks for your notification, Sangjin. I'll backport YARN-3798 soon.
>
> - Tsuyoshi
>
> On Wed, Oct 21, 2015 at 10:09 AM, Sangjin Lee <sj...@apache.org> wrote:
>> If you
Thanks for your notification, Sangjin. I'll backport YARN-3798 soon.
- Tsuyoshi
On Wed, Oct 21, 2015 at 10:09 AM, Sangjin Lee wrote:
> If you have backported bugfixes to 2.7.2, please take a moment to consider
> if it is relevant (and important) for 2.6.x too, and if so
> We should target source-level support of JDK 8 too, around which you outlined
> a bunch of issues around dependencies. I also found a bunch of issues around
> generating documentation, site etc. I propose that we track them under the
> umbrella JIRA and make progress there first.
OK. I will
t;>
>> > On 7 Oct 2015, at 22:39, Elliott Clark <ecl...@apache.org> wrote:
>> >
>> > On Mon, Oct 5, 2015 at 5:35 PM, Tsuyoshi Ozawa <oz...@apache.org> wrote:
>> >
>> >> Do you have any concern about this? I’ve not
>> >> tested with HBas
Tue, Oct 6, 2015 at 9:35 AM, Tsuyoshi Ozawa <oz...@apache.org> wrote:
> Hi commiters and users of Hadoop stack,
>
> I’ll share the current status of JDK-8 support here. We can take a
> two-step approach to support JDK-8 - runtime-level support and
> source-level support.
>
&
+1 (non-binding)
1. Built from source.
2. Verified signature of bin tar ball and source tar ball.
3. Running some examples.
4. Running Spark on YARN with spark-shell. It works well.
I think 4 verifies compatibility is preserved.
Thanks everyone for working to release 2.6.1.
Thanks,
- Tsuyoshi
Hi,
thank you for starting the discussion about 2.7.2 release.
The focus obviously is to have blocker issues [2], bug-fixes and *no*
features / improvements.
I've committed YARN-3170, which is an improvement of documentation. I
thought documentation pages which can be fit into branch-2.7 can
+1, thanks Allen and Andrew for taking lots effort!
Is there any possibility that, we can restrict someone from editing the
issue in jira once its marked as closed after release?
Vinay's comment looks considerable for us to me. What do you think?
- Tsuyoshi
On Wed, Jul 8, 2015 at 3:57 PM,
Thank you for starting voting, Vinod.
I tried to untar the tarball, but the command exited with an error. Is
binary tarball broken?
$ tar xzvf hadoop-2.7.1-RC0.tar.gz
...
hadoop-2.7.1/share/hadoop/httpfs/tomcat/webapps/webhdfs/WEB-INF/lib/hadoop-common-2.7.1.jar
gzip: stdin: unexpected end of
(GNU tar) 1.23
uname -a
Linux a.com 2.6.32-504.el6.x86_64 #1 SMP Wed Oct 15 04:27:16 UTC 2014
x86_64 x86_64 x86_64 GNU/Linux
I was able to expand the tarball.
Can you use another machine ?
Cheers
On Fri, Jul 3, 2015 at 9:53 AM, Tsuyoshi Ozawa oz...@apache.org wrote:
Thank you
Hey Akira, could you target the issues to 2.7.1?
Thanks,
- Tsuyoshi
On Wed, Apr 15, 2015 at 2:51 PM, Akira AJISAKA
ajisa...@oss.nttdata.co.jp wrote:
+0 (non-binding)
- Downloaded source
- Built from source
- Ran a pseudo-distributed cluster
- Read documents downloaded from binary tarball
+1 (non-binding)
- Verified checksums on source and binary tar ball.
- Built from source and launched single cluster.
- Checked to launch some jobs successfully.
- Killing application via RM UI.
Thanks,
- Tsuyoshi
On Mon, Apr 13, 2015 at 7:43 AM, Junping Du j...@hortonworks.com wrote:
+1.
Hi Allen,
Thank you for the great suggestion. Let's do this!
Thanks,
- Tsuyoshi
On Fri, Mar 20, 2015 at 2:34 AM, Allen Wittenauer a...@altiscale.com wrote:
Hi folks,
There are ~6,000 Hadoop JIRA issues that have gone unaddressed,
including ~900 with patches waiting to be reviewed.
[
https://issues.apache.org/jira/browse/MAPREDUCE-6268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tsuyoshi Ozawa resolved MAPREDUCE-6268.
---
Resolution: Fixed
Fix Version/s: 2.7.0
Target Version/s: 2.7.0
Allen and Steve,
Should we mark HADOOP-11602 as a blocker issue?
Thanks,
- Tsuyoshi
On Mon, Mar 2, 2015 at 4:58 AM, Arun Murthy a...@hortonworks.com wrote:
Sounds good, thanks for the help Vinod!
Arun
From: Vinod Kumar Vavilapalli
Sent: Sunday,
Hi hadoop developers,
Last 2 weeks, a bug of JDK about TimSort, related to Collections#sort,
is reported. How can we deal with this problem?
http://envisage-project.eu/timsort-specification-and-verification/
https://bugs.openjdk.java.net/browse/JDK-8072909
The bug causes
for stability.
Thanks,
- Tsuyoshi
On Thu, Feb 26, 2015 at 5:04 PM, Tsuyoshi Ozawa oz...@apache.org wrote:
Hi hadoop developers,
Last 2 weeks, a bug of JDK about TimSort, related to Collections#sort,
is reported. How can we deal with this problem?
http://envisage-project.eu/timsort
Please remove the output directory you specified:
hdfs dfs -rm -r wordcountout
Thanks,
- Tsuyoshi
On Thu, Dec 11, 2014 at 7:25 AM, Nada Saif nada.sa...@gmail.com wrote:
Hi Tsuyoshi,
I doubled check ,the wordcoutout folder is empty!?
Regards
On Thu, Dec 11, 2014 at 12:20 AM, Tsuyoshi
+0(non-binding)
HDFS-6833 is critical issue for us - could you help us to merge it into 2.6?
Thanks,
- Tsuyoshi
On Sat, Nov 15, 2014 at 1:03 PM, Hitesh Shah hit...@apache.org wrote:
+1 (binding)
Built Hadoop from source, compiled Tez against the hadoop jars pushed to
staging repo and ran a
with replication
factor 3), we should perhaps target this into 2.6.1 and not block this
release. Thoughts?
On Mon, Nov 17, 2014 at 4:17 AM, Tsuyoshi OZAWA ozawa.tsuyo...@gmail.com
wrote:
+0(non-binding)
HDFS-6833 is critical issue for us - could you help us to merge it into
2.6?
Thanks
Hi Arun,
Could you confirm the link and permission to the files is correct? I
got a following error:
Forbidden
You don't have permission to access
/~acmurthy/hadoop-2.6.0-rc0/hadoop-2.6.0-src.tar.gz on this server.
On Tue, Nov 11, 2014 at 11:52 AM, Arun C Murthy a...@hortonworks.com wrote:
Tsuyoshi OZAWA created MAPREDUCE-6120:
-
Summary: TestPipeApplication fails on trunk
Key: MAPREDUCE-6120
URL: https://issues.apache.org/jira/browse/MAPREDUCE-6120
Project: Hadoop Map/Reduce
Tsuyoshi OZAWA created MAPREDUCE-6079:
-
Summary: Renaming JobImpl#username to reporterUserName
Key: MAPREDUCE-6079
URL: https://issues.apache.org/jira/browse/MAPREDUCE-6079
Project: Hadoop Map
Tsuyoshi OZAWA created MAPREDUCE-6073:
-
Summary: Description of
mapreduce.job.speculative.slowtaskthreshold in mapred-default should be moved
into description tags
Key: MAPREDUCE-6073
URL: https
Hi,
How about using REST APIs to get the information instead of hacking
MapReduce itself if you're using Hadoop 2?
http://hadoop.apache.org/docs/r2.4.1/hadoop-yarn/hadoop-yarn-site/WebServicesIntro.html
Thanks,
- Tsuyoshi
On Tue, Aug 19, 2014 at 3:28 AM, Chris Hinshaw chris.hins...@gmail.com
Hi,
Thanks Karthik for preparing new tar ball.
Verified MD5, SHA1, SHA224, SHA256, SHA384, SHA512 checksums.
It looks good to me.
Thanks,
- Tsuyoshi
On Tue, Aug 19, 2014 at 4:42 AM, Karthik Kambatla ka...@cloudera.com wrote:
Hi devs
Tsuyoshi just brought it to my notice that the published
,
signature and checksum are untouched.
On Mon, Aug 11, 2014 at 1:03 PM, Tsuyoshi OZAWA ozawa.tsuyo...@gmail.com
wrote:
Thank you for dealing with this problem, Karthik. It sounds reasonable
to me to update binary tarball without modifying source code.
+1(non-binding) to continue the voting
-1 (non-binding).
* Downloaded source and verified signature.
* Built from source.
* Ran tests and some MR jobs.
* Ran RM-HA with manual failover mode.
- Documents are missing.
Good catch, Akira. As he mentioned, the documents including javadocs
are missing from the binary tar ball. We should
+1(non-binding)
Thanks,
- Tsuyoshi
On Sat, Aug 9, 2014 at 11:57 AM, Karthik Kambatla ka...@cloudera.com wrote:
I have put together this proposal based on recent discussion on this topic.
Please vote on the proposal. The vote runs for 7 days.
1. Migrate from subversion to git for version
the source.
Thanks
Karthik
On Mon, Aug 11, 2014 at 5:51 AM, Tsuyoshi OZAWA ozawa.tsuyo...@gmail.com
wrote:
-1 (non-binding).
* Downloaded source and verified signature.
* Built from source.
* Ran tests and some MR jobs.
* Ran RM-HA with manual failover mode.
- Documents are missing
Thank you for great suggestion, Karthik. +1(non-binding) to use git.
I'm also using private git repository.
Additionally, I have one question. Will we accept github-based
development like Apache Spark? IHMO, it allow us to leverage Hadoop
development, because the cost of sending pull request is
definitely opens up the possibility for better review workflows, but we can
discuss that on a different thread.
A few different people have also mentioned Gerrit, so that'd be in the
running along with Github (and I guess ReviewBoard).
Thanks,
Andrew
On Mon, Aug 4, 2014 at 4:17 PM, Tsuyoshi
+1 for Karthik's suggestion.
- Tsuyoshi
On Wed, Jul 23, 2014 at 6:54 AM, Karthik Kambatla ka...@cloudera.com wrote:
Hi devs
As you might have noticed, we have several classes and methods in them that
are not annotated at all. This is seldom intentional. Avoiding incompatible
changes to all
Hi Wangda,
The following link is same link as Karthik mentioned:
+1(non-binding)
On Wed, Jun 25, 2014 at 1:55 AM, Hitesh Shah hit...@apache.org wrote:
+1 (binding)
— Hitesh
On Jun 24, 2014, at 1:53 AM, Arun C Murthy a...@hortonworks.com wrote:
Folks,
As discussed, I'd like to call a vote on changing our by-laws to change
release votes from 7 days to
IMHO, I'd like to +1 to include YARN-1492 and work-preserving restart
in 2.6. I believe they are good improvement, but they are
work-in-progress and it takes a bit time to be done.
Thanks,
- Tsuyoshi
On Tue, Jun 24, 2014 at 7:13 AM, Jian He j...@hortonworks.com wrote:
Just found the roadmap
IMHO, it's useful to release 2.5 as intermediate release. The working
items which are not ready for 2.5 will be target for 2.6, right?
Thanks,
- Tsuyoshi
On Tue, Jun 10, 2014 at 5:03 PM, dlmar...@comcast.net wrote:
Arun,
Any possibility of getting HDFS-6376 committed and backported into
Hi Karthik,
Some tests with servers like MiniCluster or ZK can never end because
of unexpected busy loop or something if the tests don't have timeouts.
It can blocks the other jobs of Jenkins server. Therefore, IMHO, we
should add timeouts when we write tests with them.
Thanks,
- Tsuyoshi
On
Hi,
+1 for 2.4.1 release(non-binding).
There are some critical issues including YARN-1861 and YARN-1929 about
RM-HA. IMO, we should include the fixes.
One question is whether we can include RM-HA phase 2(YARN-556) in 2.5
by mid-May. It's still work-in-progress.
Thanks,
- Tsuyoshi
On Mon, Apr
Hi Arun,
I apologize for the late response.
If the problems are recognized correctly, +1 for the release(non-binding).
* Ran examples on pseudo distributed cluster.
* Ran tests.
* Built from source.
Let's fix the problems at the target version(2.4.1).
Thanks,
- Tsuyoshi
On Wed, Apr 9, 2014
Azurry, can you file the RM-failover related bug as a JIRA? I'm going
to reproduce it in my local.
Thanks,
- Tsuyoshi
On Fri, Apr 4, 2014 at 7:47 AM, Azuryy azury...@gmail.com wrote:
Did you tested RM failover on Hive? There is bug.
Sent from my iPhone5s
On 2014年4月4日, at 2:12, Xuan Gong
Hi,
Ran tests and confirmed that some tests(TestSymlinkLocalFSFileSystem) fail.
The log of the test failure is as follows:
https://gist.github.com/oza/9965197
Should we fix or disable the feature?
Thanks,
- Tsuyoshi
On Mon, Mar 31, 2014 at 6:22 PM, Arun C Murthy a...@hortonworks.com wrote:
+1 (non-binding)
* Built from source.
* Ran a pseudo-cluster with manual RM HA.
* Ran a few MR examples as tests.
Thanks, Tsuyoshi
On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy a...@hortonworks.com wrote:
Folks,
I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to
Hi Pramod,
In addition to shuffle plugin related parts, please check out how
spill works in MapTask.java and how reducer fetches MapOutputs from
mappers.
Thanks, Tsuyoshi
On Mon, Feb 10, 2014 at 2:54 AM, Pramod Biligiri
pramodbilig...@gmail.com wrote:
Hi,
I'm beginning to look at the code for
Hi Pramod,
Now PUMA benchmarks are available at the following site:
https://sites.google.com/site/farazahmad/pumabenchmarks
Thanks, Tsuyoshi
On Mon, Feb 10, 2014 at 2:46 AM, Pramod Biligiri
pramodbilig...@gmail.com wrote:
Hi Tian,
Thanks for that link to PUMA. It's proving useful for us in
Tsuyoshi OZAWA created MAPREDUCE-5755:
-
Summary: MapTask.MapOutputBuffer#compare/swap should have
@Override annotations
Key: MAPREDUCE-5755
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5755
Tsuyoshi OZAWA created MAPREDUCE-5623:
-
Summary: NonAggregatingLogHandler can throw
RejectedExecutionException
Key: MAPREDUCE-5623
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5623
Hi Mohammad,
IIUC, 2.2.0 is the latest released version. branch-2.2 is the latest
branch under development.
On Fri, Nov 8, 2013 at 11:52 AM, Mohammad Islam misla...@yahoo.com wrote:
Hi,
I could not find out any release tag for 2.2.0.
Which branch should I use instead for latest released
# Have stable1/stable2 links:
http://hadoop.apache.org/docs/stable1 - hadoop-1.x
http://hadoop.apache.org/docs/stable2 - hadoop-2.x
+1, would also make:
current - stable2(since v2 is the latest)
stable - stable1 (for compatibility)
+1, Eli's proposal looks good to me.
-
I don't have Windows environment, but one user who tried 2.2.0 release
on Windows reported that released tar ball doesn't contain
winutil.exe and cannot run any commands.
Thanks, Tsuyoshi
On Tue, Oct 15, 2013 at 10:38 PM, Tsuyoshi OZAWA
ozawa.tsuyo...@gmail.com wrote:
Congrats!
On Tue, Oct 15
Filed the problems as https://issues.apache.org/jira/browse/HADOOP-10051.
On Wed, Oct 16, 2013 at 12:00 AM, Tsuyoshi OZAWA
ozawa.tsuyo...@gmail.com wrote:
I don't have Windows environment, but one user who tried 2.2.0 release
on Windows reported that released tar ball doesn't contain
Hi Anh,
How about using ChainMapper? Is the helpful for you?
http://hadoop.apache.org/docs/current/api/org/apache/hadoop/mapred/lib/ChainMapper.html
Thanks, Tsuyoshi
On Wed, Oct 16, 2013 at 1:16 AM, Anh Pham pham3...@gmail.com wrote:
(Please correct me if I am wrong) So the original chain is:
Congrats!
On Tue, Oct 15, 2013 at 9:45 PM, Mattmann, Chris A (398J)
chris.a.mattm...@jpl.nasa.gov wrote:
Congrats bros!
++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
+1 (non-binding)
- Verified md5 checksums and signature.
- Build from source, and run some example MR jobs in single node setup.
On Sun, Oct 13, 2013 at 7:42 PM, Siddharth Seth ss...@apache.org wrote:
+1 (binding)
Verified checksums and signature. Built from source and ran some simple MR
and
Thanks for sharing! We also need to update Wiki or some documents, don't we?
http://wiki.apache.org/hadoop/HowToContribute
On Thu, Aug 15, 2013 at 8:03 AM, Alejandro Abdelnur t...@cloudera.com wrote:
Following up on this.
HADOOP-9845 HADOOP-9872 have been committed
to
Hi,
About Hadoop, Harsh is dealing with this problem in HADOOP-9346.
For more detail, please see the JIRA ticket:
https://issues.apache.org/jira/browse/HADOOP-9346
- Tsuyoshi
On Thu, Aug 8, 2013 at 1:49 AM, Alejandro Abdelnur t...@cloudera.com wrote:
I' like to upgrade to protobuf 2.5.0 for
+1 (non-binding)
* verified md5 of the source code.
* build the package from source code.
* run basic hdfs commands.
* run MapReduce example jobs(random text writer, wordcount, and pi)
over YARN in single node.
- Tsuyoshi
On Tue, Jul 30, 2013 at 10:29 PM, Arun C Murthy a...@hortonworks.com
Tsuyoshi OZAWA created MAPREDUCE-5443:
-
Summary: ClientId should have getMsb/getLsb methods
Key: MAPREDUCE-5443
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5443
Project: Hadoop Map/Reduce
[
https://issues.apache.org/jira/browse/MAPREDUCE-5443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tsuyoshi OZAWA resolved MAPREDUCE-5443.
---
Resolution: Invalid
Release Note: Moved to HADOOP-9821, and close
specifically? At what times would one prefer the other?
On Fri, Jul 26, 2013 at 11:43 AM, Tsuyoshi OZAWA
ozawa.tsuyo...@gmail.com wrote:
Hi,
Now, Apache Mesos, an distributed resource manager, is top-level
apache project. Meanwhile, As you know, Hadoop has own resource
manager - YARN. IMHO, we
be
confusing.
Its very easy for a good technology to get starved because no one asks how
to combine these features in to the framework.
On Jul 29, 2013, at 9:58 AM, Tsuyoshi OZAWA ozawa.tsuyo...@gmail.com wrote:
I thought some high availability and resource isolation features in
Mesos are more
Hi,
Now, Apache Mesos, an distributed resource manager, is top-level
apache project. Meanwhile, As you know, Hadoop has own resource
manager - YARN. IMHO, we should make resource manager pluggable in
MRv2, because there are their own field users of MapReduce would like
to use. I think this work
Hi,
I've suggested and created a patch for node-level aggregation(MAPREDUCE-4502).
This patch is now ready for review by anyone. The design doc is also available
for review at JIRA[1].
Aggregation jobs with Hadoop are very common,
so this work can achieve better experience with Hadoop.
[1]
1 - 100 of 128 matches
Mail list logo