Hortonworks Inc.
http://hortonworks.com/
--
Todd Lipcon
Software Engineer, Cloudera
Day!
Lohit
--
Todd Lipcon
Software Engineer, Cloudera
, but it is passing
its tests. If it looks good I'll start putting up the patches on JIRA and
committing next week.
-Todd
On Fri, Nov 16, 2012 at 1:14 PM, Todd Lipcon t...@cloudera.com wrote:
+1 from me, too. I wanted to let it sit in trunk for a few weeks to see if
anyone found issues, but it's now
to the fundamentally
less robust design which has caused a lot of subtle bugs over the past
several years.
Thanks
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
, 2012, at 1:01 PM, Eli Collins e...@cloudera.com wrote:
On Sat, Sep 1, 2012 at 12:47 PM, Arun C Murthy a...@hortonworks.com wrote:
Todd,
On Sep 1, 2012, at 1:20 AM, Todd Lipcon wrote:
I'd actually contend that YARN was merged too early. I have yet to see
anyone running YARN in production
JIRAs goes in,
I'll start a sweep for findbugs, removing TODOs, and a adding a few
more stress tests. Then I think it will be a good time to propose a
merge.
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
, and be granted
access as soon as they get an apache SVN account.
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
++
--
Todd Lipcon
Software Engineer, Cloudera
(71):
Alejandro Abdelnur (106):
Suresh Srinivas (107):
Aaron Twining Myers (171):
Tsz-wo Sze (184):
Eli Collins (252):
Todd Lipcon (286):
So I would propose:
atm,daryn,ddas,eli,eyang,hairong,harsh,jitendra,mahadev,mattf,shv,sradia,stevel,suresh,szetszwo,todd,tomwhite,tucu,umamahesh
and listing
, but
this whole thread just seems like it's stirring up trouble and not
going to accomplish anything except a bunch of wasted man-hours. (I've
already wasted about 45 minutes today on it, oops!)
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
in the
eventual TLP-ification of subcomponents, of course.
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
in a
reasonable way at runtime without jar conflicts, tons of duplicate
configuration work, byzantine version dependencies, etc.
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
simplifying things by having a single user@hadoop.apache.orglist
by merging all of them?
Thoughts?
Arun
--
http://hortonworks.com/download/
--
Todd Lipcon
Software Engineer, Cloudera
OK, the fixes to CHANGES.txt and JIRA are complete. Sorry for the mail bomb ;-)
-Todd
On Tue, May 15, 2012 at 10:30 PM, Todd Lipcon t...@cloudera.com wrote:
Thanks for posting the new RC. Will take a look tomorrow. Meanwhile,
I'm going through CHANGES.txt and JIRA and moving things that didn't
be included too?
It seems like this was marked for inclusion but I can't seem to find the
patch in the branch-2.0.0-alpha tree.
Thanks,
Kumar
Kumar Ravi
[image: Inactive hide details for Todd Lipcon ---05/14/2012 11:21:34
PM---Hey Arun,]Todd Lipcon ---05/14/2012 11:21:34 PM---Hey Arun,
From
[a...@hortonworks.com]
Sent: Monday, May 14, 2012 10:24 PM
To: general@hadoop.apache.org
Subject: Re: [VOTE] Release hadoop-2.0.0-alpha
Todd,
Please go ahead and merge changes into branch-2.0.0-alpha and I'll roll
RC1.
thanks,
Arun
On May 12, 2012, at 10:05 PM, Todd Lipcon wrote:
Looking
-2.0.0-alpha-rc1/
The maven artifacts are available via repository.apache.org.
Please try the release and vote; the vote will run for the usual 7 days.
thanks,
Arun
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
--
Todd Lipcon
Software Engineer, Cloudera
To: general@hadoop.apache.org
Subject: Re: [VOTE] Release hadoop-2.0.0-alpha
Todd,
Please go ahead and merge changes into branch-2.0.0-alpha and I'll roll
RC1.
thanks,
Arun
On May 12, 2012, at 10:05 PM, Todd Lipcon wrote:
Looking at the release tag vs the current state
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
--
Todd Lipcon
Software Engineer, Cloudera
. - Piet
Hein (via Tom White)
--
Todd Lipcon
Software Engineer, Cloudera
/
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
--
Todd Lipcon
Software Engineer, Cloudera
to correct this lest any users get the wrong perception and
migrate their HBase clusters to a version which is rarely used and
strictly inferior for this use case.
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
.
If a group of committers wants to make a release branch, then the
maintenance of that branch should be up to them.
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
, 5 in order (binding).
The vote will run the normal 7 days.
thanks,
Arun
[1] http://en.wikipedia.org/wiki/Single_transferable_vote
--
Todd Lipcon
Software Engineer, Cloudera
try the release and vote; the vote will run for the usual 7 days.
thanks,
Arun
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
--
Todd Lipcon
Software Engineer, Cloudera
it's pretty nasty once you run into
it. The only way I could start my NN again without losing data was to
recompile with the fix in place.
-Todd
On Wed, Feb 22, 2012 at 6:43 PM, Todd Lipcon t...@cloudera.com wrote:
-1, unfortunately. HDFS-2991 is a blocker regression introduced in
0.23.1. See
with hadoop-0.23.1.
Please try the release and vote; the vote will run for the usual 7 days.
thanks,
Arun
--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/
--
Todd Lipcon
Software Engineer, Cloudera
--
Todd Lipcon
Software Engineer, Cloudera
, and
source.deb/RPM files to build themselves on Linux. I'd rather avoid all that
work
The protobuf java jar is required at runtime. protoc (native) is only
required at compile time.
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
with.)
--
Todd Lipcon
Software Engineer, Cloudera
something like twice as slow on my test cluster due to this bug.
0.23/MR2 doesn't suffer from this bug.
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
On behalf of the PMC, I am pleased to announce that Harsh J Chouraria
has been elected a committer in the Apache Hadoop Common, HDFS, and
MapReduce projects. Anyone subscribed to the mailing list or JIRA will
undoubtedly recognize Harsh's name as one of the most helpful
community members and an
a960eea40dbd6a4e87072bdf73ac3b62e772f70a
Author: Todd Lipcon t...@lipcon.org
Date: Sun Jun 13 23:02:38 2010 -0700
HDFS-1197. Received blocks should not be added to block map
prematurely for under construction files
Description: Fixes a possible dataloss scenario when using append
improvements?
Given how recently MR2 was merged, I imagine there will be a lot of
things that aren't strictly bugs that we will really want to have in
our next release. I also have a couple of HDFS patches (eg the new
faster CRC on-by-default) that I'd like to get into 23.
-Todd
--
Todd Lipcon
Software
: Jitendra Pandey jiten...@hortonworks.com
Date: Tue, 19 Jul 2011 18:23:39 -0700
+1 for the merge. I haven't looked at BackupNode changes in much detail,
but
apart from that the patch looks good.
On Tue, Jul 19, 2011 at 6:12 PM, Todd Lipcon t...@cloudera.com wrote:
Hi all
:)
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
in the
next day or two, can respond to review comments and commit over the weekend,
and call a vote to merge early next week.
Thanks
-Todd
On Jul 6, 2011, at 8:03 PM, Todd Lipcon wrote:
Hi all,
Just an update on this project:
- The current list of uncommitted patches up for review
.
The last bylaw change required lazy majority of PMC and ran for 7
days, which I believe would apply to this one as well. That would
have this vote ending 5pm PST July 18.
-Jakob
--
Todd Lipcon
Software Engineer, Cloudera
bylaw change required lazy majority of PMC and ran for 7
days, which I believe would apply to this one as well. That would
have this vote ending 5pm PST July 18.
-Jakob
--
Todd Lipcon
Software Engineer, Cloudera
is as painless as
possible.
Comments are certainly welcome on this strategy.
Thanks a lot,
Aaron
--
Aaron T. Myers
Software Engineer, Cloudera
--
Todd Lipcon
Software Engineer, Cloudera
on reviewing pre-merge, please do so *this week*. Of course, if you
don't have time and you find issues post-merge, I absolutely plan on fixing
them ASAP ;-)
Thanks
-Todd
On Thu, Jun 30, 2011 at 12:11 AM, Todd Lipcon t...@cloudera.com wrote:
Hey all,
Work on the HDFS-1073 branch has been
a demo!
--
Todd Lipcon
Software Engineer, Cloudera
data.
Cheers,
Evert
--
Todd Lipcon
Software Engineer, Cloudera
On Fri, Jun 24, 2011 at 5:28 PM, Arun C Murthy ar...@yahoo-inc.com wrote:
Thanks Suresh!
Todd - I'd appreciate if you could help on some of the HBase/Performance
jiras... thanks!
Sure thing.
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
]
- Passing most tests now and discussing merging into trunk
--
Todd Lipcon
Software Engineer, Cloudera
.
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
to
such earlier Jira?
Cheers,
Joep
From: Todd Lipcon [t...@cloudera.com]
Sent: Monday, June 13, 2011 1:37 PM
To: general@hadoop.apache.org
Subject: Re: JIRAs post-unsplit
On Mon, Jun 13, 2011 at 11:51 AM, Konstantin Boudnik c...@apache.org
wrote:
I
of course): 4, 1, 2, 3, 5, 6.
In other words, I want option 4 most and option 6 least. With STV, you
don't need to worry about voting for an unpopular choice since your vote
will automatically roll over to your next choice.
-- Owen
--
Todd Lipcon
Software Engineer, Cloudera
:
Could someone unlock some of these branches for anonymous read only
checkout? At least with MR-279 I get a 403 forbidden error when I try to
check out.
--Bobby
On 6/12/11 6:38 PM, Todd Lipcon t...@cloudera.com wrote:
OK, this seems to have succeeded without any big problems!
I've re-enabled
Hmm, as I got farther down my email this morning, I saw some complaints that
HBase's SVN was giving 403s as well, this morning. Perhaps there is some
ASF-wide issue going on, completely unrelated to the Hadoop changes over the
weekend?
-Todd
On Mon, Jun 13, 2011 at 7:52 AM, Todd Lipcon t
On Mon, Jun 13, 2011 at 8:14 AM, Todd Lipcon t...@cloudera.com wrote:
Oops, sorry about that one. I will take care of that in about 30 minutes
(just headed out the door now to catch a train). If someone else with commit
access wants to, you just need to propset the externals to point to th
a top level pom file can build sub-poms, but the subpoms
could also continue to be built independently if necessary. I think the
top-level pom would live in the new root.
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
cross-project patches in a reasonable way.
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
On Mon, Jun 13, 2011 at 4:54 PM, Konstantin Boudnik c...@apache.org wrote:
On Mon, Jun 13, 2011 at 01:37PM, Todd Lipcon wrote:
On Mon, Jun 13, 2011 at 11:51 AM, Konstantin Boudnik c...@apache.org
wrote:
I tend to agree: JIRA separation was the benefit of the split.
I'd rather keep
\)/\(.*\),common/\2/\1,')
=== Git Users ===
The git mirrors of the above 7 branches should now have a set of 4 commits
near the top that look like this:
Merge: 928d485 cd66945 77f628f
Author: Todd Lipcon t...@apache.org
Date: Sun Jun 12 22:53:28 2011 +
HADOOP-7106. Reorganize SVN layout
a message asking folks to please
hold commits to all branches while the move is in progress.
Thanks
-Todd
On Fri, Jun 10, 2011 at 11:20 AM, Todd Lipcon t...@cloudera.com wrote:
Hi all,
Pending any unforeseen issues, I am planning on committing HADOOP-7106 this
weekend. I have the credentials from
in advance of when I
actually do the commit.
Thanks
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
thing in mind?
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
On Mon, Jun 6, 2011 at 6:05 PM, Allen Wittenauer a...@apache.org wrote:
On Jun 6, 2011, at 5:56 PM, Todd Lipcon wrote:
Or because this is the sort of thing that could take weeks of discussion
or
just 5 minutes to unblock HBase from moving on to trunk. I'd rather have
the
weeks
what goes into a release.
The PMC votes on it once there is a release candidate.
-- Owen
--
Todd Lipcon
Software Engineer, Cloudera
and bugs are
blockers.
Bugs are blockers? Then we'll never release!
Let's hear from Nigel what he thinks. It's his branch, if he's upset about
the way it's being handled, he can deal with it as he sees fit.
-Todd
On Thu, Jun 2, 2011 at 10:39 AM, Todd Lipcon t...@cloudera.com wrote:
On Wed
--
Todd Lipcon
Software Engineer, Cloudera
bug fixes only with a vote process for any exceptions. 0.20-security is
obviously entirely different, but as yet remains undefined (it's way more
than just security).
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
, and add the same label. Then, we can point new contributors at
this list of JIRAs -- hopefully this will get them on the right path towards
understanding our project's workflow and give some nice positive
reinforcement since they should be easy to review and commit quickly.
Thanks!
-Todd
--
Todd
be back by then too.
Any objections?
Cheers,
Nige
On Apr 29, 2011, at 11:36 AM, Owen O'Malley wrote:
On Apr 28, 2011, at 11:24 PM, Todd Lipcon wrote:
Wasn't sure how to go about doing that. I guess we need to talk to infra
about it? Do you know how we might clone the SVN repos
://people.apache.org/~omalley/hadoop-0.20.203.0-rc1/
Please download it, inspect it, compile it, and test it. Clearly, I'm +1.
-- Owen
--
Todd Lipcon
Software Engineer, Cloudera
from branch-0.20-security that follows the
existing, established community process.
Thanks,
Eli
--
Todd Lipcon
Software Engineer, Cloudera
to work on, so I won't keep going, but this is from looking at
the last couple months of 203.
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
.
Missed adding HADOOP-5759 to that list, I'll check with Amareshwari
before committing.
Arun
Thanks for doing this so fast Arun.
--
Todd Lipcon
Software Engineer, Cloudera
, at 10:58 PM, Todd Lipcon wrote:
On Tue, Apr 19, 2011 at 10:20 PM, Todd Lipcon t...@cloudera.com
wrote:
I'm currently looking into how the git mirrors are setup in
Apache-land.
Uh, why isn't infra-dev on this thread?
For those on infra-dev, the context is that Nigel is trying
Cheers,
Nige
--
Todd Lipcon
Software Engineer, Cloudera
On Tue, Apr 19, 2011 at 10:20 PM, Todd Lipcon t...@cloudera.com wrote:
I'm currently looking into how the git mirrors are setup in Apache-land.
Git-wise, I think we have two options:
Option 1)
- Create a new git mirror for the new hadoop/ tree. This will have no
history.
- On the Apache side
are interested in seeing these issues ported to mainline, let
us know. We are happy to help review your patches and explain context to
anyone who is interested in doing this work.
Arun and Eric
--
Todd Lipcon
Software Engineer, Cloudera
rename the Common project to C'Mon. We can think about the
details of what exactly these project splits mean later.
Please let me know what you think.
Best,
Aaron
--
Todd Lipcon
Software Engineer, Cloudera
to a green state so we can talk about releasing them, rather than
applying patches to a branch with no releases planned.
Of course a decision now doesn't preclude anyone from stepping up later,
backporting patches to 0.21, and releasing an 0.21.1.
Thanks
-Todd
--
Todd Lipcon
Software Engineer
+CC all the user lists, or just
common-user which most people are on, if you think that's better?
-Todd
From: Todd Lipcon t...@cloudera.com
To: general@hadoop.apache.org
Sent: Wed, March 30, 2011 2:41:35 PM
Subject: Maintenance of Hadoop 0.21 branch?
Hi
(CA) - Italy
e-mail: simone@crs4.it
http://www.crs4.it
--
Todd Lipcon
Software Engineer, Cloudera
The Apache HBase team is happy to announce the general availability of HBase
0.90.1, available from your Apache mirror of choice:
http://www.apache.org/dyn/closer.cgi/hbase/
[at the time of this writing, not all mirrors have updated yet -- please
pick a different mirror if your first choice does
, data_join, mumak, or vertica contribs. Wouldn't you rather
these components lived on github so the people who wrote them could update
them as they wished without having to wait on committers who have little to
no clue about how to evaluate the changes?
-Todd
--
Todd Lipcon
Software Engineer
of contribs that Hadoop seems to have sprouted.
-Todd
On Tue, Feb 1, 2011 at 1:02 AM, Allen Wittenauer
awittena...@linkedin.com wrote:
On Jan 31, 2011, at 3:23 PM, Todd Lipcon wrote:
On Sun, Jan 30, 2011 at 11:19 PM, Owen O'Malley omal...@apache.org
wrote:
Also note that pushing code out
--
Todd Lipcon
Software Engineer, Cloudera
while also offering people the latest and greatest libraries,
tools, codecs, etc.
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
://hudson.apache.org/hudson/view/G-L/view/Hadoop/job/PreCommit-MAPREDUCE-Build/17/
Let's see if 17th time is a charm...
Nige
On Jan 7, 2011, at 5:14 PM, Todd Lipcon wrote:
On Fri, Jan 7, 2011 at 2:11 PM, Nigel Daley nda...@mac.com wrote:
Hrm, the MR precommit test I'm running has hung (been
. There is limited info I can get from the Jira API, thus the
triggering mechanism had to change.
Cheers,
Nige
--
Todd Lipcon
Software Engineer, Cloudera
,
Arun
--
Todd Lipcon
Software Engineer, Cloudera
patch) and by not including the sync
feature which is critical for a large segment of users. Given those
downsides I'd rather see the effort diverted towards making a killer 0.22
release that we can all jump on.
Thanks
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
a more natural place to keep a top level build
and pkg scripts that operate across all 3 projects.
Thoughts?
Cheers,
Nige
--
Todd Lipcon
Software Engineer, Cloudera
that can cause hangs on some tests -
HDFS-1529 - would appreciate if someone can take a look. But I don't think
this is responsible for the MR hang above.
-Todd
On Jan 5, 2011, at 5:42 PM, Todd Lipcon wrote:
On Wed, Jan 5, 2011 at 4:39 PM, Nigel Daley nda...@mac.com wrote:
Thanks for looking
? I'll also look into that one today, but if it's
something that will take a while to fix, I don't think we should hold off
the useful testing for all the other patches.
-Todd
On Jan 5, 2011, at 2:45 PM, Todd Lipcon wrote:
Hi Nigel,
MAPREDUCE-2172 has been fixed for a while. Are there any
implementation. So it wasn't all a wasted effort
;-)
--
Todd Lipcon
Software Engineer, Cloudera
really weird semantics where it's
doing write-back caching.
Just take a look at its manpage and you should get scared about using it for
a critical mount point like this.
A soft interruptable NFS mount is a much safer bet.
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
distro doesn't allow
us to fix a bug in trunk. I can readily pull up several recent examples of
this, and I'm surprised that there isn't more concern in the general
community about bugs that may result in NN metadata corruption.
Thanks,
-Todd
On Thu, Dec 23, 2010 at 12:02 PM, Todd Lipcon t
these tests fixed
or
removed/? Also, I need to get MAPREDUCE-2172 fixed (applies to HDFS as
well) before I turn this on.
Cheers,
Nige
--
Connect to me at http://www.facebook.com/dhruba
--
Todd Lipcon
Software Engineer, Cloudera
major release.
Any thoughts here? Do people often make use of the hadoop.job.ugi variable
to such an extent that this breaking change would block your organization
from upgrading?
Thanks
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
copy of it from your computer or paper files.
--
Todd Lipcon
Software Engineer, Cloudera
the core hadoop components
but also integrates many other important ecosystem components including Pig,
Hive, Oozie, HBase, Zookeeper, Flume, etc.
Thanks
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
,
So...it is a significant drawback.
As a matter of fact, there are many cases we need to modify.
I dont understand why Yahoo didn't provoid that functionality. And as I
know
no one else is working on this. Why is that?
--
Todd Lipcon
Software Engineer, Cloudera
block
blk_926027507678171558_3620 src: /10.32.56.170:34823 dest: /
10.32.56.171:50010
On Mon, May 17, 2010 at 11:43 AM, Todd Lipcon t...@cloudera.com wrote:
Hi Ted,
Can you please grep your NN and DN logs for blk_926027507678171558 and
pastebin the results?
-Todd
On Mon, May 17
notch up the
stability/testing scale.
-Todd
--
Todd Lipcon
Software Engineer, Cloudera
/mapreduce/core.
If the community likes this idea, I will volunteer myself to be the release
manager for this new branch and will propose a formal vote.
comments/feedback/questions are most welcome.
dhruba
--
Connect to me at http://www.facebook.com/dhruba
--
Todd Lipcon
Software
1 - 100 of 117 matches
Mail list logo
