[jira] [Commented] (HIVE-7633) Warehouse#getTablePath() doesn't handle external tables

[ https://issues.apache.org/jira/browse/HIVE-7633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14277568#comment-14277568 ] Yin Huai commented on HIVE-7633: Changes in HIVE-1537 allows users to specify the location

[jira] [Updated] (HIVE-7633) Warehouse#getTablePath() doesn't handle external tables

[ https://issues.apache.org/jira/browse/HIVE-7633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-7633: --- Component/s: Metastore Warehouse#getTablePath() doesn't handle external tables

[jira] [Updated] (HIVE-7633) Warehouse#getTablePath() doesn't handle external tables

[ https://issues.apache.org/jira/browse/HIVE-7633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-7633: --- Affects Version/s: 0.8.1 0.9.0 0.10.0

[jira] [Updated] (HIVE-7633) Warehouse#getTablePath() doesn't handle external tables

[ https://issues.apache.org/jira/browse/HIVE-7633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-7633: --- Priority: Critical (was: Major) Warehouse#getTablePath() doesn't handle external tables

[jira] [Commented] (HIVE-6137) Hive should report that the file/path doesn’t exist when it doesn’t

[ https://issues.apache.org/jira/browse/HIVE-6137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14277228#comment-14277228 ] Yin Huai commented on HIVE-6137: [~hsubramaniyan] What is the affect version(s) of this

[jira] [Commented] (HIVE-7205) Wrong results when union all of grouping followed by group by with correlation optimization

[ https://issues.apache.org/jira/browse/HIVE-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14173804#comment-14173804 ] Yin Huai commented on HIVE-7205: [~navis] Can you update the review board? I will take a

[jira] [Commented] (HIVE-7205) Wrong results when union all of grouping followed by group by with correlation optimization

[ https://issues.apache.org/jira/browse/HIVE-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093129#comment-14093129 ] Yin Huai commented on HIVE-7205: Yeah, fixing correctness bug is very important. However,

[jira] [Commented] (HIVE-7205) Wrong results when union all of grouping followed by group by with correlation optimization

[ https://issues.apache.org/jira/browse/HIVE-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14084158#comment-14084158 ] Yin Huai commented on HIVE-7205: My main concern is that because we use the right most

[jira] [Commented] (HIVE-7205) Wrong results when union all of grouping followed by group by with correlation optimization

[ https://issues.apache.org/jira/browse/HIVE-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14084215#comment-14084215 ] Yin Huai commented on HIVE-7205: Oh, I see. In the current patch, isLastInput takes special

[jira] [Commented] (HIVE-7205) Wrong results when union all of grouping followed by group by with correlation optimization

[ https://issues.apache.org/jira/browse/HIVE-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14082384#comment-14082384 ] Yin Huai commented on HIVE-7205: No yet. I will try to find sometime during the weekend.

[jira] [Commented] (HIVE-7205) Wrong results when union all of grouping followed by group by with correlation optimization

[ https://issues.apache.org/jira/browse/HIVE-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14060383#comment-14060383 ] Yin Huai commented on HIVE-7205: [~navis] Thank you for the patch. I have left some

[jira] [Commented] (HIVE-5130) Document Correlation Optimizer in Hive wiki

[ https://issues.apache.org/jira/browse/HIVE-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14060292#comment-14060292 ] Yin Huai commented on HIVE-5130: Design doc in Hive wiki:

[jira] [Commented] (HIVE-5130) Document Correlation Optimizer in Hive wiki

[ https://issues.apache.org/jira/browse/HIVE-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14060355#comment-14060355 ] Yin Huai commented on HIVE-5130: Thanks [~leftylev] Let's put it in the Completed section.

[jira] [Created] (HIVE-7362) Enabling Correlation Optimizer by default.

Yin Huai created HIVE-7362: -- Summary: Enabling Correlation Optimizer by default. Key: HIVE-7362 URL: https://issues.apache.org/jira/browse/HIVE-7362 Project: Hive Issue Type: Task

[jira] [Commented] (HIVE-7205) Wrong results when union all of grouping followed by group by with correlation optimization

[ https://issues.apache.org/jira/browse/HIVE-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054303#comment-14054303 ] Yin Huai commented on HIVE-7205: Sure. I will take a look at it. Seems the issue is that

[jira] [Commented] (HIVE-7205) Wrong results when union all of grouping followed by group by with correlation optimization

[ https://issues.apache.org/jira/browse/HIVE-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054454#comment-14054454 ] Yin Huai commented on HIVE-7205: [~navis] Simplifying interactions between operators is

[jira] [Commented] (HIVE-7222) Support timestamp column statistics in ORC and extend PPD for timestamp

[ https://issues.apache.org/jira/browse/HIVE-7222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028769#comment-14028769 ] Yin Huai commented on HIVE-7222: [~prasanth_j] Unfortunately, I am not working on that.

[jira] [Commented] (HIVE-6716) ORC struct throws NPE for tables with inner structs having null values

[ https://issues.apache.org/jira/browse/HIVE-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13943839#comment-13943839 ] Yin Huai commented on HIVE-6716: [~prasanth_j] It is the same bug as I mentioned in

[jira] [Resolved] (HIVE-6631) NPE when select a field of a struct from a table stored by ORC

[ https://issues.apache.org/jira/browse/HIVE-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved HIVE-6631. Resolution: Duplicate NPE when select a field of a struct from a table stored by ORC

[jira] [Commented] (HIVE-6716) ORC struct throws NPE for tables with inner structs having null values

[ https://issues.apache.org/jira/browse/HIVE-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13943843#comment-13943843 ] Yin Huai commented on HIVE-6716: ok. Have marked that one. Thanks. ORC struct throws NPE

[jira] [Commented] (HIVE-6432) Remove deprecated methods in HCatalog

[ https://issues.apache.org/jira/browse/HIVE-6432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13936175#comment-13936175 ] Yin Huai commented on HIVE-6432: I tried to generate the tarball with {code} mvn clean

[jira] [Created] (HIVE-6668) When auto join convert is on and noconditionaltask is off, ConditionalResolverCommonJoin fails to resolve map joins.

Yin Huai created HIVE-6668: -- Summary: When auto join convert is on and noconditionaltask is off, ConditionalResolverCommonJoin fails to resolve map joins. Key: HIVE-6668 URL:

[jira] [Commented] (HIVE-6668) When auto join convert is on and noconditionaltask is off, ConditionalResolverCommonJoin fails to resolve map joins.

[ https://issues.apache.org/jira/browse/HIVE-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13935290#comment-13935290 ] Yin Huai commented on HIVE-6668: I guess it was broken by HIVE-6403 or HIVE-6144. When

[jira] [Commented] (HIVE-6668) When auto join convert is on and noconditionaltask is off, ConditionalResolverCommonJoin fails to resolve map joins.

[ https://issues.apache.org/jira/browse/HIVE-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13935397#comment-13935397 ] Yin Huai commented on HIVE-6668: Seems aliases returned from this line

[jira] [Commented] (HIVE-6668) When auto join convert is on and noconditionaltask is off, ConditionalResolverCommonJoin fails to resolve map joins.

[ https://issues.apache.org/jira/browse/HIVE-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13935455#comment-13935455 ] Yin Huai commented on HIVE-6668: TestConditionalResolverCommonJoin cannot catch this bug.

[jira] [Created] (HIVE-6631) NPE when select a field of a struct from a table stored by ORC

Yin Huai created HIVE-6631: -- Summary: NPE when select a field of a struct from a table stored by ORC Key: HIVE-6631 URL: https://issues.apache.org/jira/browse/HIVE-6631 Project: Hive Issue Type:

[jira] [Updated] (HIVE-6631) NPE when select a field of a struct from a table stored by ORC

[ https://issues.apache.org/jira/browse/HIVE-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-6631: --- Component/s: Serializers/Deserializers Query Processor NPE when select a field of a struct

[jira] [Updated] (HIVE-6631) NPE when select a field of a struct from a table stored by ORC

[ https://issues.apache.org/jira/browse/HIVE-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-6631: --- Affects Version/s: 0.14.0 0.13.0 NPE when select a field of a struct from a table

[jira] [Updated] (HIVE-6631) NPE when select a field of a struct from a table stored by ORC

[ https://issues.apache.org/jira/browse/HIVE-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-6631: --- Description: I have a table like this ... {code:sql} create table lineitem_orc_cg ( CG1 STRUCTL_PARTKEY:INT,

[jira] [Created] (HIVE-6632) ORC should be able to only read needed fields in a complex column

Yin Huai created HIVE-6632: -- Summary: ORC should be able to only read needed fields in a complex column Key: HIVE-6632 URL: https://issues.apache.org/jira/browse/HIVE-6632 Project: Hive Issue

[jira] [Commented] (HIVE-6632) ORC should be able to only read needed fields in a complex column

[ https://issues.apache.org/jira/browse/HIVE-6632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13931978#comment-13931978 ] Yin Huai commented on HIVE-6632: Does Parquet have the same issue? ORC should be able to

[jira] [Commented] (HIVE-6163) OrcOutputFormat#getRecordWriter creates OrcRecordWriter with relative path

[ https://issues.apache.org/jira/browse/HIVE-6163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13892067#comment-13892067 ] Yin Huai commented on HIVE-6163: I think we should also check all other OutputFormats and

[jira] [Updated] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask also sums those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5945: --- Resolution: Fixed Fix Version/s: 0.13.0 Release Note: Committed to trunk. Thanks, Navis!

[jira] [Updated] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask also sums those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5945: --- Release Note: (was: Committed to trunk. Thanks, Navis!)

[jira] [Commented] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask also sums those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13873656#comment-13873656 ] Yin Huai commented on HIVE-5945: Committed to trunk. Thanks, Navis!

[jira] [Commented] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask also sums those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13872582#comment-13872582 ] Yin Huai commented on HIVE-5945: +1

[jira] [Commented] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask also sums those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13863047#comment-13863047 ] Yin Huai commented on HIVE-5945: Thanks Navis for the change. date_dim is a native table.

[jira] [Updated] (HIVE-6083) User provided table properties are not assigned to the TableDesc of the FileSinkDesc in a CTAS query

[ https://issues.apache.org/jira/browse/HIVE-6083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-6083: --- Status: Open (was: Patch Available) User provided table properties are not assigned to the TableDesc of the

[jira] [Updated] (HIVE-6083) User provided table properties are not assigned to the TableDesc of the FileSinkDesc in a CTAS query

[ https://issues.apache.org/jira/browse/HIVE-6083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-6083: --- Status: Patch Available (was: Open) User provided table properties are not assigned to the TableDesc of the

[jira] [Commented] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask also sums those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13859114#comment-13859114 ] Yin Huai commented on HIVE-5945: Thanks Navis :) I played with your patch and found a issue

[jira] [Updated] (HIVE-6083) User provided table properties are not assigned to the TableDesc of the FileSinkDesc in a CTAS query

[ https://issues.apache.org/jira/browse/HIVE-6083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-6083: --- Status: Open (was: Patch Available) User provided table properties are not assigned to the TableDesc of the

[jira] [Updated] (HIVE-6083) User provided table properties are not assigned to the TableDesc of the FileSinkDesc in a CTAS query

[ https://issues.apache.org/jira/browse/HIVE-6083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-6083: --- Attachment: HIVE-6083.2.patch.txt Let me trigger HiveQA again. User provided table properties are not

[jira] [Updated] (HIVE-6083) User provided table properties are not assigned to the TableDesc of the FileSinkDesc in a CTAS query

[ https://issues.apache.org/jira/browse/HIVE-6083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-6083: --- Status: Patch Available (was: Open) User provided table properties are not assigned to the TableDesc of the

[jira] [Updated] (HIVE-6083) User provided table properties are not assigned to the TableDesc of the FileSinkDesc in a CTAS query

[ https://issues.apache.org/jira/browse/HIVE-6083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-6083: --- Summary: User provided table properties are not assigned to the TableDesc of the FileSinkDesc in a CTAS query

[jira] [Commented] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask also sums those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851756#comment-13851756 ] Yin Huai commented on HIVE-5945: Two minor comments in the review board. Two additional

[jira] [Updated] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask also sums those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5945: --- Status: Open (was: Patch Available) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask also sums

[jira] [Updated] (HIVE-6043) Document incompatible changes in Hive 0.12 and trunk

[ https://issues.apache.org/jira/browse/HIVE-6043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-6043: --- Description: We need to document incompatible changes. For example * HIVE-5372 changed object inspector

[jira] [Commented] (HIVE-6043) Document incompatible changes in Hive 0.12 and trunk

[ https://issues.apache.org/jira/browse/HIVE-6043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13850759#comment-13850759 ] Yin Huai commented on HIVE-6043: I added HIVE-4827, which removed the flag of

[jira] [Commented] (HIVE-5891) Alias conflict when merging multiple mapjoin tasks into their common child mapred task

[ https://issues.apache.org/jira/browse/HIVE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851007#comment-13851007 ] Yin Huai commented on HIVE-5891: [~sunrui] Sorry for getting back late. I just took a look

[jira] [Commented] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask also sums those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851260#comment-13851260 ] Yin Huai commented on HIVE-5945: Thanks [~navis] :) I left a few comments on the review

[jira] [Updated] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask also sums those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5945: --- Status: Open (was: Patch Available) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask also sums

[jira] [Created] (HIVE-6007) Make the output of the reduce side plan optimized by the correlation optimizer more reader-friendly.

Yin Huai created HIVE-6007: -- Summary: Make the output of the reduce side plan optimized by the correlation optimizer more reader-friendly. Key: HIVE-6007 URL: https://issues.apache.org/jira/browse/HIVE-6007

[jira] [Commented] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask also sums those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13844968#comment-13844968 ] Yin Huai commented on HIVE-5945: Thanks [~navis] for taking this issue. Can you attach the

[jira] [Updated] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask sums all tables' sizes including those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5945: --- Affects Version/s: 0.13.0 ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask sums all tables' sizes

[jira] [Created] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask sums all tables' sizes including those tables which are not used in the child of this conditional task.

Yin Huai created HIVE-5945: -- Summary: ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask sums all tables' sizes including those tables which are not used in the child of this conditional task. Key: HIVE-5945 URL:

[jira] [Updated] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask sums all tables' sizes including those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5945: --- Component/s: Query Processor ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask sums all tables'

[jira] [Updated] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask sums all tables' sizes including those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5945: --- Description: Here is an example {code} select i_item_id, s_state, avg(ss_quantity) agg1,

[jira] [Updated] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask sums all tables' sizes including those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5945: --- Description: Here is an example {code} select i_item_id, s_state, avg(ss_quantity) agg1,

[jira] [Updated] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask sums all tables' sizes including those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5945: --- Description: Here is an example {code} select i_item_id, s_state, avg(ss_quantity) agg1,

[jira] [Commented] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask sums all tables' sizes including those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13838991#comment-13838991 ] Yin Huai commented on HIVE-5945: aliasToFileSizeMap should have aliases used in the next

[jira] [Updated] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask sums all tables' sizes including those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5945: --- Affects Version/s: 0.8.0 0.9.0 0.10.0

[jira] [Commented] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask sums all tables' sizes including those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13839008#comment-13839008 ] Yin Huai commented on HIVE-5945: Seems this bug was introduced by HIVE-2095. I am marking

[jira] [Updated] (HIVE-5945) ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask also sums those tables which are not used in the child of this conditional task.

[ https://issues.apache.org/jira/browse/HIVE-5945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5945: --- Summary: ql.plan.ConditionalResolverCommonJoin.resolveMapJoinTask also sums those tables which are not used

[jira] [Created] (HIVE-5922) In orc.InStream.CompressedStream, the desired position passed to seek can equal offsets[i] + bytes[i].remaining() when ORC predicate pushdown is enabled

Yin Huai created HIVE-5922: -- Summary: In orc.InStream.CompressedStream, the desired position passed to seek can equal offsets[i] + bytes[i].remaining() when ORC predicate pushdown is enabled Key: HIVE-5922 URL:

[jira] [Commented] (HIVE-5922) In orc.InStream.CompressedStream, the desired position passed to seek can equal offsets[i] + bytes[i].remaining() when ORC predicate pushdown is enabled

[ https://issues.apache.org/jira/browse/HIVE-5922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837275#comment-13837275 ] Yin Huai commented on HIVE-5922: For the first trace, the desired position is 21496054 and

[jira] [Moved] (HIVE-5910) In HiveConf, the name of mapred.min.split.size.per.rack is MAPREDMINSPLITSIZEPERNODE and the name of mapred.min.split.size.per.node is MAPREDMINSPLITSIZEPERRACK

[ https://issues.apache.org/jira/browse/HIVE-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai moved MAPREDUCE-5659 to HIVE-5910: --- Key: HIVE-5910 (was: MAPREDUCE-5659) Project: Hive (was: Hadoop

[jira] [Commented] (HIVE-5910) In HiveConf, the name of mapred.min.split.size.per.rack is MAPREDMINSPLITSIZEPERNODE and the name of mapred.min.split.size.per.node is MAPREDMINSPLITSIZEPERRACK

[ https://issues.apache.org/jira/browse/HIVE-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13835768#comment-13835768 ] Yin Huai commented on HIVE-5910: my bad... did not notice the project when I created it...

[jira] [Commented] (HIVE-5910) In HiveConf, the name of mapred.min.split.size.per.rack is MAPREDMINSPLITSIZEPERNODE and the name of mapred.min.split.size.per.node is MAPREDMINSPLITSIZEPERRACK

[ https://issues.apache.org/jira/browse/HIVE-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13835921#comment-13835921 ] Yin Huai commented on HIVE-5910: [~leftylev] Actually, these two are MapReduce

[jira] [Commented] (HIVE-5891) Alias conflict when merging multiple mapjoin tasks into their common child mapred task

[ https://issues.apache.org/jira/browse/HIVE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13833857#comment-13833857 ] Yin Huai commented on HIVE-5891: I think the main problem is

[jira] [Commented] (HIVE-5891) Alias conflict when merging multiple mapjoin tasks into their common child mapred task

[ https://issues.apache.org/jira/browse/HIVE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13832779#comment-13832779 ] Yin Huai commented on HIVE-5891: [~sunrui] What will the plan of the query in the

[jira] [Commented] (HIVE-5891) Alias conflict when merging multiple mapjoin tasks into their common child mapred task

[ https://issues.apache.org/jira/browse/HIVE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13833409#comment-13833409 ] Yin Huai commented on HIVE-5891: Thanks [~sunrui] for confirming the plan. Will

[jira] [Updated] (HIVE-5697) Correlation Optimizer may generate wrong plans for cases involving outer join

[ https://issues.apache.org/jira/browse/HIVE-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5697: --- Attachment: (was: HIVE-5697.2.patch) Correlation Optimizer may generate wrong plans for cases involving

[jira] [Updated] (HIVE-5697) Correlation Optimizer may generate wrong plans for cases involving outer join

[ https://issues.apache.org/jira/browse/HIVE-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5697: --- Attachment: HIVE-5697.2.patch reuploading patch .2 Correlation Optimizer may generate wrong plans for cases

[jira] [Updated] (HIVE-5697) Correlation Optimizer may generate wrong plans for cases involving outer join

[ https://issues.apache.org/jira/browse/HIVE-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5697: --- Issue Type: Sub-task (was: Bug) Parent: HIVE-3667 Correlation Optimizer may generate wrong plans

[jira] [Created] (HIVE-5697) Correlation Optimizer may generate wrong plans for cases involving outer join

Yin Huai created HIVE-5697: -- Summary: Correlation Optimizer may generate wrong plans for cases involving outer join Key: HIVE-5697 URL: https://issues.apache.org/jira/browse/HIVE-5697 Project: Hive

[jira] [Updated] (HIVE-5697) Correlation Optimizer may generate wrong plans for cases involving outer join

[ https://issues.apache.org/jira/browse/HIVE-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5697: --- Attachment: HIVE-5697.1.patch Will add test later. Correlation Optimizer may generate wrong plans for cases

[jira] [Updated] (HIVE-5697) Correlation Optimizer may generate wrong plans for cases involving outer join

[ https://issues.apache.org/jira/browse/HIVE-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5697: --- Status: Patch Available (was: Open) Correlation Optimizer may generate wrong plans for cases involving

[jira] [Updated] (HIVE-5697) Correlation Optimizer may generate wrong plans for cases involving outer join

[ https://issues.apache.org/jira/browse/HIVE-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5697: --- Attachment: HIVE-5697.2.patch added a test query Correlation Optimizer may generate wrong plans for cases

[jira] [Updated] (HIVE-5697) Correlation Optimizer may generate wrong plans for cases involving outer join

[ https://issues.apache.org/jira/browse/HIVE-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5697: --- Attachment: (was: HIVE-5697.2.patch) Correlation Optimizer may generate wrong plans for cases involving

[jira] [Updated] (HIVE-5697) Correlation Optimizer may generate wrong plans for cases involving outer join

[ https://issues.apache.org/jira/browse/HIVE-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5697: --- Status: Open (was: Patch Available) Correlation Optimizer may generate wrong plans for cases involving

[jira] [Updated] (HIVE-5697) Correlation Optimizer may generate wrong plans for cases involving outer join

[ https://issues.apache.org/jira/browse/HIVE-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5697: --- Attachment: HIVE-5697.2.patch Correlation Optimizer may generate wrong plans for cases involving outer join

[jira] [Updated] (HIVE-5697) Correlation Optimizer may generate wrong plans for cases involving outer join

[ https://issues.apache.org/jira/browse/HIVE-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5697: --- Status: Patch Available (was: Open) Correlation Optimizer may generate wrong plans for cases involving

[jira] [Commented] (HIVE-5610) Merge maven branch into trunk

[ https://issues.apache.org/jira/browse/HIVE-5610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804341#comment-13804341 ] Yin Huai commented on HIVE-5610: Not an expert on maven. Here are what I tried... I first

[jira] [Commented] (HIVE-5610) Merge maven branch into trunk

[ https://issues.apache.org/jira/browse/HIVE-5610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13804379#comment-13804379 ] Yin Huai commented on HIVE-5610: my bad... I did not notice that... Tried again. The

[jira] [Updated] (HIVE-5592) Add an option to convert enum as structvalue:int as of Hive 0.8

[ https://issues.apache.org/jira/browse/HIVE-5592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5592: --- Description: HIVE-3323 introduced the incompatible change: Hive handling of enum types has been changed to

[jira] [Created] (HIVE-5546) A change in ORCInputFormat made by HIVE-4113 was reverted by HIVE-HIVE-5391

Yin Huai created HIVE-5546: -- Summary: A change in ORCInputFormat made by HIVE-4113 was reverted by HIVE-HIVE-5391 Key: HIVE-5546 URL: https://issues.apache.org/jira/browse/HIVE-5546 Project: Hive

[jira] [Updated] (HIVE-5546) A change in ORCInputFormat made by HIVE-4113 was reverted by HIVE-5391

[ https://issues.apache.org/jira/browse/HIVE-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5546: --- Summary: A change in ORCInputFormat made by HIVE-4113 was reverted by HIVE-5391 (was: A change in

[jira] [Updated] (HIVE-5546) A change in ORCInputFormat made by HIVE-4113 was reverted by HIVE-5391

[ https://issues.apache.org/jira/browse/HIVE-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5546: --- Description: {code} 2013-10-15 10:49:49,386 INFO org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: included

[jira] [Updated] (HIVE-5546) A change in ORCInputFormat made by HIVE-4113 was reverted by HIVE-5391

[ https://issues.apache.org/jira/browse/HIVE-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5546: --- Description: {code} 2013-10-15 10:49:49,386 INFO org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: included

[jira] [Commented] (HIVE-5546) A change in ORCInputFormat made by HIVE-4113 was reverted by HIVE-5391

[ https://issues.apache.org/jira/browse/HIVE-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13795280#comment-13795280 ] Yin Huai commented on HIVE-5546: Based on my understanding, I think that includedStr in

[jira] [Updated] (HIVE-5546) A change in ORCInputFormat made by HIVE-4113 was reverted by HIVE-5391

[ https://issues.apache.org/jira/browse/HIVE-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5546: --- Attachment: HIVE-5546.1.patch Tried both {code} select count(1) from web_sales_orc; {code} and {code} select

[jira] [Updated] (HIVE-5546) A change in ORCInputFormat made by HIVE-4113 was reverted by HIVE-5391

[ https://issues.apache.org/jira/browse/HIVE-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5546: --- Status: Patch Available (was: Open) [~sershe] [~ashutoshc] Can you take a look? A change in ORCInputFormat

[jira] [Commented] (HIVE-2419) CREATE TABLE AS SELECT should create warehouse directory

[ https://issues.apache.org/jira/browse/HIVE-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13795317#comment-13795317 ] Yin Huai commented on HIVE-2419: Seems MoveTask.moveFile(Path, Path, boolean) throws this

[jira] [Updated] (HIVE-5546) A change in ORCInputFormat made by HIVE-4113 was reverted by HIVE-5391

[ https://issues.apache.org/jira/browse/HIVE-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5546: --- Affects Version/s: 0.13.0 A change in ORCInputFormat made by HIVE-4113 was reverted by HIVE-5391

[jira] [Updated] (HIVE-5546) A change in ORCInputFormat made by HIVE-4113 was reverted by HIVE-5391

[ https://issues.apache.org/jira/browse/HIVE-5546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated HIVE-5546: --- Attachment: HIVE-5546.2.patch Sure. I have removed includedStr (I kept the log of included column ids =).

[jira] [Commented] (HIVE-5245) hive create table as select(CTAS) can not work(not support) with join on operator

[ https://issues.apache.org/jira/browse/HIVE-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13793439#comment-13793439 ] Yin Huai commented on HIVE-5245: I meant you can try hive trunk and see if the error also

[jira] [Commented] (HIVE-5245) hive create table as select(CTAS) can not work(not support) with join on operator

[ https://issues.apache.org/jira/browse/HIVE-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13792648#comment-13792648 ] Yin Huai commented on HIVE-5245: I think that error log is fine. Because you have a CTAS

[jira] [Commented] (HIVE-5245) hive create table as select(CTAS) can not work(not support) with join on operator

[ https://issues.apache.org/jira/browse/HIVE-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791546#comment-13791546 ] Yin Huai commented on HIVE-5245: [~jeff_little] I tried both trunk and 0.11 with tables

[jira] [Commented] (HIVE-5245) hive create table as select(CTAS) can not work(not support) with join on operator

[ https://issues.apache.org/jira/browse/HIVE-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791578#comment-13791578 ] Yin Huai commented on HIVE-5245: Can you check your log and see you can find something like

[jira] [Commented] (HIVE-5245) hive create table as select(CTAS) can not work(not support) with join on operator

[ https://issues.apache.org/jira/browse/HIVE-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13791604#comment-13791604 ] Yin Huai commented on HIVE-5245: Seems those logs are at runtime from Map tasks. I meant

  1   2   3   4   5   6   >