Re: Change proposal for FileInputFormat isSplitable

2014-05-30 Thread Niels Basjes
Ok, got it. If someone has an Avro file (foo.avro) and gzips that ( foo.avro.gz) then the frame work will select the GzipCodec which is not capable of splitting and which will cause the problem. So by gzipping a splittable file it becomes non splittable. At my workplace we have applied gzip to av

[jira] [Resolved] (HADOOP-10444) add pom.xml infrastructure for hadoop-native-core

2014-05-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HADOOP-10444. --- Resolution: Fixed Fix Version/s: HADOOP-10388 Target Versio

[jira] [Created] (HADOOP-10646) KeyProvider buildVersion method should be moved to a utils class

2014-05-30 Thread Alejandro Abdelnur (JIRA)
Alejandro Abdelnur created HADOOP-10646: --- Summary: KeyProvider buildVersion method should be moved to a utils class Key: HADOOP-10646 URL: https://issues.apache.org/jira/browse/HADOOP-10646 Proj

[jira] [Resolved] (HADOOP-10637) Add snapshot and several dfsadmin tests into TestCLI

2014-05-30 Thread Dasha Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dasha Boudnik resolved HADOOP-10637. Resolution: Duplicate Duplicate of HDFS-6297. > Add snapshot and several dfsadmin tests

[jira] [Resolved] (HADOOP-10624) Fix some minors typo and add more test cases for hadoop_err

2014-05-30 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HADOOP-10624. --- Resolution: Fixed Fix Version/s: HADOOP-10388 committed, thanks! >

[jira] [Created] (HADOOP-10645) TestKMS fails because race condition writing acl files

2014-05-30 Thread Alejandro Abdelnur (JIRA)
Alejandro Abdelnur created HADOOP-10645: --- Summary: TestKMS fails because race condition writing acl files Key: HADOOP-10645 URL: https://issues.apache.org/jira/browse/HADOOP-10645 Project: Hadoop

Re: Change proposal for FileInputFormat isSplitable

2014-05-30 Thread Doug Cutting
I was trying to explain my comment, where I stated that, "changing the default implementation to return false would be an incompatible change". The patch was added 6 months after that comment, so the comment didn't address the patch. The patch does not appear to change the default implementation

Re: Change proposal for FileInputFormat isSplitable

2014-05-30 Thread Tim
Remove On Fri, May 30, 2014 at 3:03 PM, Niels Basjes wrote: > Hi, > The way I see the effects of the original patch on existing subclasses: > - implemented isSplitable >--> no performance difference. > - did not implement isSplitable >--> then there is no performance difference if the co

Re: Change proposal for FileInputFormat isSplitable

2014-05-30 Thread Niels Basjes
Hi, The way I see the effects of the original patch on existing subclasses: - implemented isSplitable --> no performance difference. - did not implement isSplitable --> then there is no performance difference if the container is either not compressed or uses a splittable compression. -->

Re: Change proposal for FileInputFormat isSplitable

2014-05-30 Thread Doug Cutting
On Thu, May 29, 2014 at 2:47 AM, Niels Basjes wrote: > For arguments I still do not fully understand this was rejected by Todd and > Doug. Performance is a part of compatibility. Doug

[jira] [Resolved] (HADOOP-10644) Remote principal name case sensitivity issue introduced on Windows by HADOOP-10418

2014-05-30 Thread Remus Rusanu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Remus Rusanu resolved HADOOP-10644. --- Resolution: Not a Problem ok, the issue comes from config. the principals in *-site.zml mus

[jira] [Created] (HADOOP-10644) Remote principal name case sensitivity issue introduced on Windows by HADOOP-10418

2014-05-30 Thread Remus Rusanu (JIRA)
Remus Rusanu created HADOOP-10644: - Summary: Remote principal name case sensitivity issue introduced on Windows by HADOOP-10418 Key: HADOOP-10644 URL: https://issues.apache.org/jira/browse/HADOOP-10644

Build failed in Jenkins: Hadoop-Common-trunk #1124

2014-05-30 Thread Apache Jenkins Server
See Changes: [atm] HADOOP-10638. Updating hadoop-daemon.sh to work as expected when nfs is started as a privileged user. Contributed by Manikandan Narayanaswamy. [arp] HADOOP-9968. Update CHANGES.txt in trunk. [cnauroth] HDFS-646

[jira] [Resolved] (HADOOP-10635) Add a method to CryptoCodec to generate SRNs for IV

2014-05-30 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu resolved HADOOP-10635. - Resolution: Fixed Hadoop Flags: Reviewed Committed to branch. Move the {{DEFAULT_SECURE_RANDOM_A

[jira] [Resolved] (HADOOP-10632) Minor improvements to Crypto input and output streams

2014-05-30 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu resolved HADOOP-10632. - Resolution: Fixed > Minor improvements to Crypto input and output streams > ---