Re: Checkstyle 80 char limit

2015-05-05 Thread Niels Basjes
...@mail.gmail.com%3E -- Best regards / Met vriendelijke groeten, Niels Basjes

Re: Checkstyle 80 char limit

2015-05-05 Thread Niels Basjes
was made on April 20, 1999 So the 80 chars thing was at best reconsidered 16 years ago. Things have changed ... Niels Basjes On Tue, May 5, 2015 at 8:21 PM, Jonathan Eagles jeag...@gmail.com wrote: More formally, we follow the sun java coding standards which follow the 80 character limit

Re: Checkstyle 80 char limit

2015-05-05 Thread Niels Basjes
be a reason to force everyone to write code as if our screen sizes can’t support more than 80 characters. On May 5, 2015, at 12:21 PM, Niels Basjes ni...@basjes.nlmailto: ni...@basjes.nl wrote: Perhaps we should tell him these screens can also be turned landscape ? ;) But seriously: 1

Re: IMPORTANT: testing patches for branches

2015-04-22 Thread Niels Basjes
that there should really be no more ‘blind’ +1’s to patches that go to branches. The “we only test against trunk” argument is no longer valid. :) -- Best regards / Met vriendelijke groeten, Niels Basjes

[jira] [Created] (HADOOP-11843) Make setting up the build environment easier

2015-04-17 Thread Niels Basjes (JIRA)
Niels Basjes created HADOOP-11843: - Summary: Make setting up the build environment easier Key: HADOOP-11843 URL: https://issues.apache.org/jira/browse/HADOOP-11843 Project: Hadoop Common

Re: NFSv3 Filesystem Connector

2015-01-14 Thread Niels Basjes
such a core concept breaking piece in the main codebase. New people may start to think it is a good idea to do this. So I say you should simply make this plugin available to your customers, just not as a core part of Hadoop. Niels Basjes [1] 50 GB/sec = approx 20*12*200MB/sec This page

Re: Updates on migration to git

2014-08-26 Thread Niels Basjes
(this one still talks about the time when there were 3 projects). Thanks. -- Best regards / Met vriendelijke groeten, Niels Basjes

Deprecated configuration settings set from the core code / {core,hdfs,...}-default.xml ??

2014-08-21 Thread Niels Basjes
groeten, Niels Basjes

Hortonworks scripting ...

2014-08-14 Thread Niels Basjes
into a blank directory. But in /usr/bin/pig sourcing /etc/default/hadoop hardcoded into the script. Why is this done this way? P.S. Where is the git(?) repo located where this (apperently HW specific) scripting is maintained? -- Best regards / Met vriendelijke groeten, Niels Basjes

Re: Change proposal for FileInputFormat isSplitable

2014-07-30 Thread Niels Basjes
://issues.apache.org/jira/browse/MAPREDUCE-2094 Niels Basjes P.S. I still thing that the FileInputFormat.isSplitable() should implement a safe default instead of an optimistic default. On Sat, Jun 14, 2014 at 10:33 AM, Niels Basjes ni...@basjes.nl wrote: I did some digging through the code base

Re: Jenkins problem or patch problem?

2014-07-29 Thread Niels Basjes
in your svn patch ? Thanks On Sun, Jul 27, 2014 at 12:27 PM, Niels Basjes ni...@basjes.nl wrote: I created a patch file with SVN and it works now. I dare to ask: Are there any git created patch files that work? On Sun, Jul 27, 2014 at 9:44 PM, Niels Basjes ni

Re: Jenkins problem or patch problem?

2014-07-28 Thread Niels Basjes
at 12:27 PM, Niels Basjes ni...@basjes.nl wrote: I created a patch file with SVN and it works now. I dare to ask: Are there any git created patch files that work? On Sun, Jul 27, 2014 at 9:44 PM, Niels Basjes ni...@basjes.nl wrote: I'll look for a workaround regarding the binary file

Jenkins problem or patch problem?

2014-07-27 Thread Niels Basjes
) in this patch, perhaps I did something wrong? Or is this problem caused by the error I highlighted? What can I do to fix this? -- Best regards / Met vriendelijke groeten, Niels Basjes

Re: Jenkins problem or patch problem?

2014-07-27 Thread Niels Basjes
/4768/console So I say Jenkins problem for now. On Sun, Jul 27, 2014 at 9:01 PM, Niels Basjes ni...@basjes.nl wrote: Hi, I just submitted a patch and Jenkins said it failed to apply the patch. But when I look at the console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build

Re: Jenkins problem or patch problem?

2014-07-27 Thread Niels Basjes
it but hadoop is currently using svn. Cheers On Sun, Jul 27, 2014 at 11:01 AM, Niels Basjes ni...@basjes.nl wrote: Hi, I just submitted a patch and Jenkins said it failed to apply the patch. But when I look at the console output https://builds.apache.org/job/PreCommit-MAPREDUCE

Re: Jenkins problem or patch problem?

2014-07-27 Thread Niels Basjes
I created a patch file with SVN and it works now. I dare to ask: Are there any git created patch files that work? On Sun, Jul 27, 2014 at 9:44 PM, Niels Basjes ni...@basjes.nl wrote: I'll look for a workaround regarding the binary file. Thanks. On Sun, Jul 27, 2014 at 9:07 PM, Ted Yu yuzhih

Re: Change proposal for FileInputFormat isSplitable

2014-06-13 Thread Niels Basjes
Hi, On Wed, Jun 11, 2014 at 8:25 PM, Chris Douglas cdoug...@apache.org wrote: On Wed, Jun 11, 2014 at 1:35 AM, Niels Basjes ni...@basjes.nl wrote: That's not what I meant. What I understood from what was described is that sometimes people use an existing file extension (like .gz

Re: Change proposal for FileInputFormat isSplitable

2014-06-11 Thread Niels Basjes
On Tue, Jun 10, 2014 at 8:10 PM, Chris Douglas cdoug...@apache.org wrote: On Fri, Jun 6, 2014 at 4:03 PM, Niels Basjes ni...@basjes.nl wrote: and if you then give the file the .gz extension this breaks all common sense / conventions about file names. That the suffix for all compression

Re: Change proposal for FileInputFormat isSplitable

2014-06-06 Thread Niels Basjes
On Mon, Jun 2, 2014 at 1:21 AM, Chris Douglas cdoug...@apache.org wrote: On Sat, May 31, 2014 at 10:53 PM, Niels Basjes ni...@basjes.nl wrote: The Hadoop framework uses the filename extension to automatically insert the right decompression codec in the read pipeline. This would be the new

Re: Change proposal for FileInputFormat isSplitable

2014-05-31 Thread Niels Basjes
be difficult for them to determine why. Such folks are probably few, but perhaps exist. I'd prefer a change that avoided that possibility entirely. Doug On Fri, May 30, 2014 at 3:02 PM, Niels Basjes ni...@basjes.nl wrote: Hi, The way I see the effects of the original patch on existing

Re: Change proposal for FileInputFormat isSplitable

2014-05-31 Thread Niels Basjes
not be splittable at all. Niels On May 31, 2014 11:12 PM, Chris Douglas cdoug...@apache.org wrote: On Fri, May 30, 2014 at 11:05 PM, Niels Basjes ni...@basjes.nl wrote: How would someone create the situation you are referring to? By adopting a naming convention where the filename suffix doesn't

Re: Change proposal for FileInputFormat isSplitable

2014-05-29 Thread Niels Basjes
ste...@hortonworks.comwrote: On 28 May 2014 20:50, Niels Basjes ni...@basjes.nl wrote: Hi, Last week I ran into this problem again https://issues.apache.org/jira/browse/MAPREDUCE-2094 What happens here is that the default implementation of the isSplitable method in FileInputFormat

Re: Change proposal for FileInputFormat isSplitable

2014-05-29 Thread Niels Basjes
, 2014 at 10:47 AM, Niels Basjes ni...@basjes.nl wrote: My original proposal (from about 3 years ago) was to change the isSplitable method to return a safe default ( you can see that in the patch that is still attached to that Jira issue). For arguments I still do not fully understand

Re: Change proposal for FileInputFormat isSplitable

2014-05-29 Thread Niels Basjes
I forgot to ask a relevant question: What made the original proposed solution incompatible? To me it still seems to be a clean backward compatible solution that fixes this issue in a simple way. Perhaps Todd can explain why? Niels On May 29, 2014 2:17 PM, Niels Basjes ni...@basjes.nl wrote

Change proposal for FileInputFormat isSplitable

2014-05-28 Thread Niels Basjes
for me to propose this as an incompatible change is that this way I hope to eradicate some of the existing bugs in custom implementations 'out there'. P.S. If you agree to this change then I'm willing to put my back into it and submit a patch. -- Best regards, Niels Basjes

Re: Sorting user defined MR counters.

2013-01-07 Thread Niels Basjes
/ Met vriendelijke groeten, Niels Basjes

Re: Making Gzip splittable

2012-02-22 Thread Niels Basjes
by using a config setting. Does this make things any less potentially confusing? I don't think this would make it less confusing. Niels - Tim. From: ni...@basj.es [ni...@basj.es] On Behalf Of Niels Basjes [ ni...@basjes.nl] Sent: Sunday, February

Re: Gzip progress during map phase.

2011-12-27 Thread Niels Basjes
Yes, this is what i was looking for. Thanks -- Met vriendelijke groet, Niels Basjes (Verstuurd vanaf mobiel ) Op 27 dec. 2011 12:08 schreef Koji Noguchi knogu...@yahoo-inc.com het volgende: Assuming you're using TextInputFormat, it sounds like https://issues.apache.org/jira/browse/MAPREDUCE

Re: Gzip progress during map phase.

2011-12-27 Thread Niels Basjes
I would not expect this. I would expect behaviour that is independent of the way the splits are created. -- Met vriendelijke groet, Niels Basjes (Verstuurd vanaf mobiel ) Op 26 dec. 2011 07:57 schreef Anthony Urso antho...@cs.ucla.edu het volgende: Gzip files (unlike uncompressed files

Re: Which branch for my patch?

2011-12-06 Thread Niels Basjes
do something wrong in the patch I created for branch-0.22? Or is HADOOP-7435 not yet operational? Thanks. Niels Basjes On Tue, Dec 6, 2011 at 00:17, Niels Basjes ni...@basjes.nl wrote: Hi, On Mon, Dec 5, 2011 at 18:54, Eli Collins e...@cloudera.com wrote: https://issues.apache.org/jira

Re: Which branch for my patch?

2011-12-05 Thread Niels Basjes
uploading the various patches? -- Best regards / Met vriendelijke groeten, Niels Basjes

Re: Which branch for my patch?

2011-12-04 Thread Niels Basjes
/ Met vriendelijke groeten, Niels Basjes

Re: Which branch for my patch?

2011-12-01 Thread Niels Basjes
Thanks, I'll get busy creating a new patch over the next few days. Niels Basjes On Wed, Nov 30, 2011 at 18:51, Eli Collins e...@cloudera.com wrote: Hey Niels, Thanks for contributing. The nest place to contribute new features is to trunk. It's currently an easy merge from trunk to branch

Which branch for my patch?

2011-11-30 Thread Niels Basjes
Hadoop and the trunk is the basis for the yarn Hadoop. For which branch of the source tree should I make my changes so you guys will reevaluate it for inclusion? Thanks. -- Best regards / Met vriendelijke groeten, Niels Basjes

Re: making file system block size bigger to improve hdfs performance ?

2011-10-03 Thread Niels Basjes
Have you tried it to see what diffrence it makes? -- Met vriendelijke groet, Niels Basjes (Verstuurd vanaf mobiel ) Op 3 okt. 2011 07:06 schreef Jinsong Hu jinsong...@hotmail.com het volgende: Hi, There: I just thought an idea. When we format the disk , the block size is usually 1K to 4K

What happened to Chris?

2011-07-31 Thread Niels Basjes
why this is happening. Is he on a long vacation? Or is there something else? -- Best regards / Met vriendelijke groeten, Niels Basjes

Re: Hadoop Annotations support

2011-07-02 Thread Niels Basjes
this message in context: http://old.nabble.com/Hadoop-Annotations-support-tp31977831p31977831.html Sent from the Hadoop core-dev mailing list archive at Nabble.com. -- Best regards / Met vriendelijke groeten, Niels Basjes

Re: help me to solve Exception

2011-06-14 Thread Niels Basjes
, Niels Basjes

[jira] [Reopened] (HADOOP-7305) Eclipse project files are incomplete

2011-06-04 Thread Niels Basjes (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niels Basjes reopened HADOOP-7305: -- Apparently there are some issues with the first version in combination with OS X. Eclipse

Re: Eclipse target

2011-05-19 Thread Niels Basjes
QA should start in a few minutes to validate this). -- Met vriendelijke groeten, Niels Basjes

Re: MapReduce compilation error

2011-05-18 Thread Niels Basjes
ClassWithNoPackage.java Hadoop-MR/src/test/mapred/testjar Any thoughts? Thanks, Bikash -- Harsh J http://harshj.com -- Met vriendelijke groeten, Niels Basjes

Eclipse target

2011-05-18 Thread Niels Basjes
/ library path=${conf.dir} exported=false / +library path=${java.home}/../lib/tools.jar exported=false / /classpath /eclipse /target -- Met vriendelijke groeten, Niels Basjes

Report as a bug?

2011-01-29 Thread Niels Basjes
at least the text : or null:null It will probably fail a bit later when really trying to login with a wrong uid/password. So, is this worth reporting as a bug? -- Met vriendelijke groeten, Niels Basjes

[jira] Created: (HADOOP-7127) Bug in login error handling in org.apache.hadoop.fs.ftp.FTPFileSystem

2011-01-29 Thread Niels Basjes (JIRA)
Type: Bug Components: fs Reporter: Niels Basjes I was playing around with PMD, just to see what kind of messages it gives on hadoop. I noticed a message about Dead code in org.apache.hadoop.fs.ftp.FTPFileSystem Starting at about line 80: String userAndPassword

Re: [Hadoop Wiki] Update of FrontPage by prosch

2011-01-10 Thread Niels Basjes
the hadoop community]]. -   * [[Support|People and companies for hire]]. +   * [[Support|People and companies for hire]].   * [[Conferences|Hadoop Community Events and Conferences]]    * HadoopUserGroups (HUGs)    * HadoopSummit -- Met vriendelijke groeten, Niels Basjes

Ready for review?

2011-01-07 Thread Niels Basjes
/ ... https://issues.apache.org/jira/browse/HADOOP-7076 -- Met vriendelijke groeten, Niels Basjes

Re: Ready for review?

2011-01-07 Thread Niels Basjes
in the patch available state, which is the flag for reviewers to know there's work for them to do.  Since this is a volunteer effort, I'm afraid there's no firm timeline for when this will get done. -Jakob On Fri, Jan 7, 2011 at 6:50 AM, Niels Basjes ni...@basjes.nl wrote: Hi, I consider

Jira workflow problem.

2011-01-06 Thread Niels Basjes
vriendelijke groeten, Niels Basjes

Re: Jira workflow problem.

2011-01-06 Thread Niels Basjes
Thanks guys, I really appreciate your help. Niels Basjes 2011/1/6 Doug Cutting cutt...@apache.org: The problem was that the submitter could transition from Patch Available to In Progress, following the Resume Progress transition, but the submitter cannot then transtion anywhere from

Build failed, hudson broken?

2011-01-05 Thread Niels Basjes
to get this problem fixed? -- Met vriendelijke groeten, Niels Basjes

Re: Build failed, hudson broken?

2011-01-05 Thread Niels Basjes
I found where to report this ... so I did: https://issues.apache.org/jira/browse/INFRA-3340 2011/1/5 Niels Basjes ni...@basjes.nl: Hi, I just submitted a patch for the feature I've been working on. https://issues.apache.org/jira/browse/HADOOP-7076 This patch works fine on my system

What is the correct spelling?

2010-12-25 Thread Niels Basjes
files I'm touching? -- Best regards, Niels Basjes

[jira] Created: (HADOOP-7076) Splittable Gzip

2010-12-23 Thread Niels Basjes (JIRA)
Splittable Gzip --- Key: HADOOP-7076 URL: https://issues.apache.org/jira/browse/HADOOP-7076 Project: Hadoop Common Issue Type: New Feature Components: io Reporter: Niels Basjes Files compressed