[jira] [Updated] (HIVE-4275) Hive does not differentiate scheme and authority in file uris
[ https://issues.apache.org/jira/browse/HIVE-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-4275: --- Fix Version/s: (was: 0.12.0) 0.11.0 > Hive does not differentiate scheme and authority in file uris > - > > Key: HIVE-4275 > URL: https://issues.apache.org/jira/browse/HIVE-4275 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.11.0 >Reporter: Vikram Dixit K >Assignee: Vikram Dixit K > Fix For: 0.11.0 > > Attachments: HIVE-4275.2.patch, HIVE-4275.3.patch, HIVE-4275.4.patch, > HIVE-4275.patch > > > Consider the following set of queries: > ALTER TABLE abc ADD PARTITION (x='0') LOCATION 'file:///foo'; > ALTER TABLE abc ADD PARTITION (x='1') LOCATION '/foo'; > select count(*) from abc; > Even though there are different files under these directories, depending on > number of mappers, the count produces a value = num of mappers * num of files > in the 2 directories. This is incorrect. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4275) Hive does not differentiate scheme and authority in file uris
[ https://issues.apache.org/jira/browse/HIVE-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-4275: --- Resolution: Fixed Fix Version/s: 0.12.0 Status: Resolved (was: Patch Available) Committed to trunk. Thanks, Vikram! > Hive does not differentiate scheme and authority in file uris > - > > Key: HIVE-4275 > URL: https://issues.apache.org/jira/browse/HIVE-4275 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.11.0 >Reporter: Vikram Dixit K >Assignee: Vikram Dixit K > Fix For: 0.12.0 > > Attachments: HIVE-4275.2.patch, HIVE-4275.3.patch, HIVE-4275.4.patch, > HIVE-4275.patch > > > Consider the following set of queries: > ALTER TABLE abc ADD PARTITION (x='0') LOCATION 'file:///foo'; > ALTER TABLE abc ADD PARTITION (x='1') LOCATION '/foo'; > select count(*) from abc; > Even though there are different files under these directories, depending on > number of mappers, the count produces a value = num of mappers * num of files > in the 2 directories. This is incorrect. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4275) Hive does not differentiate scheme and authority in file uris
[ https://issues.apache.org/jira/browse/HIVE-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-4275: - Attachment: HIVE-4275.4.patch > Hive does not differentiate scheme and authority in file uris > - > > Key: HIVE-4275 > URL: https://issues.apache.org/jira/browse/HIVE-4275 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.11.0 >Reporter: Vikram Dixit K >Assignee: Vikram Dixit K > Attachments: HIVE-4275.2.patch, HIVE-4275.3.patch, HIVE-4275.4.patch, > HIVE-4275.patch > > > Consider the following set of queries: > ALTER TABLE abc ADD PARTITION (x='0') LOCATION 'file:///foo'; > ALTER TABLE abc ADD PARTITION (x='1') LOCATION '/foo'; > select count(*) from abc; > Even though there are different files under these directories, depending on > number of mappers, the count produces a value = num of mappers * num of files > in the 2 directories. This is incorrect. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4275) Hive does not differentiate scheme and authority in file uris
[ https://issues.apache.org/jira/browse/HIVE-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-4275: - Status: Patch Available (was: Open) Addressed issues mentioned by Ashutosh. > Hive does not differentiate scheme and authority in file uris > - > > Key: HIVE-4275 > URL: https://issues.apache.org/jira/browse/HIVE-4275 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.11.0 >Reporter: Vikram Dixit K >Assignee: Vikram Dixit K > Attachments: HIVE-4275.2.patch, HIVE-4275.3.patch, HIVE-4275.patch > > > Consider the following set of queries: > ALTER TABLE abc ADD PARTITION (x='0') LOCATION 'file:///foo'; > ALTER TABLE abc ADD PARTITION (x='1') LOCATION '/foo'; > select count(*) from abc; > Even though there are different files under these directories, depending on > number of mappers, the count produces a value = num of mappers * num of files > in the 2 directories. This is incorrect. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4275) Hive does not differentiate scheme and authority in file uris
[ https://issues.apache.org/jira/browse/HIVE-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-4275: - Attachment: HIVE-4275.3.patch Fixes issue in test cases. > Hive does not differentiate scheme and authority in file uris > - > > Key: HIVE-4275 > URL: https://issues.apache.org/jira/browse/HIVE-4275 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.11.0 >Reporter: Vikram Dixit K >Assignee: Vikram Dixit K > Attachments: HIVE-4275.2.patch, HIVE-4275.3.patch, HIVE-4275.patch > > > Consider the following set of queries: > ALTER TABLE abc ADD PARTITION (x='0') LOCATION 'file:///foo'; > ALTER TABLE abc ADD PARTITION (x='1') LOCATION '/foo'; > select count(*) from abc; > Even though there are different files under these directories, depending on > number of mappers, the count produces a value = num of mappers * num of files > in the 2 directories. This is incorrect. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4275) Hive does not differentiate scheme and authority in file uris
[ https://issues.apache.org/jira/browse/HIVE-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-4275: --- Status: Open (was: Patch Available) Following tests failed: * Test org.apache.hadoop.hive.ql.exec.TestExecDriver FAILED * Test org.apache.hadoop.hive.ql.exec.TestOperators FAILED > Hive does not differentiate scheme and authority in file uris > - > > Key: HIVE-4275 > URL: https://issues.apache.org/jira/browse/HIVE-4275 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.11.0 >Reporter: Vikram Dixit K >Assignee: Vikram Dixit K > Attachments: HIVE-4275.2.patch, HIVE-4275.patch > > > Consider the following set of queries: > ALTER TABLE abc ADD PARTITION (x='0') LOCATION 'file:///foo'; > ALTER TABLE abc ADD PARTITION (x='1') LOCATION '/foo'; > select count(*) from abc; > Even though there are different files under these directories, depending on > number of mappers, the count produces a value = num of mappers * num of files > in the 2 directories. This is incorrect. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4275) Hive does not differentiate scheme and authority in file uris
[ https://issues.apache.org/jira/browse/HIVE-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-4275: - Status: Patch Available (was: Open) > Hive does not differentiate scheme and authority in file uris > - > > Key: HIVE-4275 > URL: https://issues.apache.org/jira/browse/HIVE-4275 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.11.0 >Reporter: Vikram Dixit K >Assignee: Vikram Dixit K > Attachments: HIVE-4275.2.patch, HIVE-4275.patch > > > Consider the following set of queries: > ALTER TABLE abc ADD PARTITION (x='0') LOCATION 'file:///foo'; > ALTER TABLE abc ADD PARTITION (x='1') LOCATION '/foo'; > select count(*) from abc; > Even though there are different files under these directories, depending on > number of mappers, the count produces a value = num of mappers * num of files > in the 2 directories. This is incorrect. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4275) Hive does not differentiate scheme and authority in file uris
[ https://issues.apache.org/jira/browse/HIVE-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-4275: - Attachment: HIVE-4275.2.patch The test was actually for TestMinimrCliDriver. I had missed the changes in build-common.xml. > Hive does not differentiate scheme and authority in file uris > - > > Key: HIVE-4275 > URL: https://issues.apache.org/jira/browse/HIVE-4275 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.11.0 >Reporter: Vikram Dixit K >Assignee: Vikram Dixit K > Attachments: HIVE-4275.2.patch, HIVE-4275.patch > > > Consider the following set of queries: > ALTER TABLE abc ADD PARTITION (x='0') LOCATION 'file:///foo'; > ALTER TABLE abc ADD PARTITION (x='1') LOCATION '/foo'; > select count(*) from abc; > Even though there are different files under these directories, depending on > number of mappers, the count produces a value = num of mappers * num of files > in the 2 directories. This is incorrect. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4275) Hive does not differentiate scheme and authority in file uris
[
https://issues.apache.org/jira/browse/HIVE-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan updated HIVE-4275:
---
Fix Version/s: (was: 0.11.0)
Status: Open (was: Patch Available)
I get following error after I applied your patch and ran the included test.
{noformat}
[junit] Failed query: schemeAuthority.q
[junit] mkdir: Incomplete HDFS URI, no host: hdfs:///tmp/test
{noformat}
> Hive does not differentiate scheme and authority in file uris
> -
>
> Key: HIVE-4275
> URL: https://issues.apache.org/jira/browse/HIVE-4275
> Project: Hive
> Issue Type: Bug
> Components: Query Processor
>Affects Versions: 0.11.0
>Reporter: Vikram Dixit K
>Assignee: Vikram Dixit K
> Attachments: HIVE-4275.patch
>
>
> Consider the following set of queries:
> ALTER TABLE abc ADD PARTITION (x='0') LOCATION 'file:///foo';
> ALTER TABLE abc ADD PARTITION (x='1') LOCATION '/foo';
> select count(*) from abc;
> Even though there are different files under these directories, depending on
> number of mappers, the count produces a value = num of mappers * num of files
> in the 2 directories. This is incorrect.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4275) Hive does not differentiate scheme and authority in file uris
[ https://issues.apache.org/jira/browse/HIVE-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-4275: - Attachment: HIVE-4275.patch Without the change, hive generates count as 4 (when it should be 2). > Hive does not differentiate scheme and authority in file uris > - > > Key: HIVE-4275 > URL: https://issues.apache.org/jira/browse/HIVE-4275 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.11.0 >Reporter: Vikram Dixit K >Assignee: Vikram Dixit K > Fix For: 0.11.0 > > Attachments: HIVE-4275.patch > > > Consider the following set of queries: > ALTER TABLE abc ADD PARTITION (x='0') LOCATION 'file:///foo'; > ALTER TABLE abc ADD PARTITION (x='1') LOCATION '/foo'; > select count(*) from abc; > Even though there are different files under these directories, depending on > number of mappers, the count produces a value = num of mappers * num of files > in the 2 directories. This is incorrect. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4275) Hive does not differentiate scheme and authority in file uris
[ https://issues.apache.org/jira/browse/HIVE-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikram Dixit K updated HIVE-4275: - Status: Patch Available (was: Open) > Hive does not differentiate scheme and authority in file uris > - > > Key: HIVE-4275 > URL: https://issues.apache.org/jira/browse/HIVE-4275 > Project: Hive > Issue Type: Bug > Components: Query Processor >Affects Versions: 0.11.0 >Reporter: Vikram Dixit K >Assignee: Vikram Dixit K > Fix For: 0.11.0 > > Attachments: HIVE-4275.patch > > > Consider the following set of queries: > ALTER TABLE abc ADD PARTITION (x='0') LOCATION 'file:///foo'; > ALTER TABLE abc ADD PARTITION (x='1') LOCATION '/foo'; > select count(*) from abc; > Even though there are different files under these directories, depending on > number of mappers, the count produces a value = num of mappers * num of files > in the 2 directories. This is incorrect. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
