[
https://issues.apache.org/jira/browse/HIVE-635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zheng Shao updated HIVE-635:
----------------------------
Attachment: HIVE-635.3.patch
Good idea.
This patch makes sure UnionOperator does not touch the row if it's already in
the format wanted.
The following log verifies that.
{code}
ant test -Dhadoop.version=0.17.0 -Dtestcase=TestCliDriver -Dtest.silent=false
-Dqfile=union21.q
...
[junit] 09/07/15 16:27:22 INFO exec.UnionOperator: parent 4 initialized
[junit] 09/07/15 16:27:22 INFO exec.UnionOperator: start Initializing 2
[junit] 09/07/15 16:27:22 INFO exec.UnionOperator: Initializing Self 2
[junit] 09/07/15 16:27:22 INFO exec.UnionOperator: Union Operator needs to
transform row from parent[2] from
org.apache.hadoop.hive.serde2.objectinspector.StandardStructObjectInspector<org.apache.hadoop.hive.serde2.lazy.objectinspector.primitive.lazystringobjectinspec...@c970c0e>
to
org.apache.hadoop.hive.serde2.objectinspector.StandardStructObjectInspector<org.apache.hadoop.hive.serde2.objectinspector.primitive.writablestringobjectinspec...@549b6220>
[junit] 09/07/15 16:27:22 INFO exec.UnionOperator: Union Operator needs to
transform row from parent[3] from
org.apache.hadoop.hive.serde2.objectinspector.StandardStructObjectInspector<org.apache.hadoop.hive.serde2.objectinspector.primitive.javastringobjectinspec...@5e2c17f7>
to
org.apache.hadoop.hive.serde2.objectinspector.StandardStructObjectInspector<org.apache.hadoop.hive.serde2.objectinspector.primitive.writablestringobjectinspec...@549b6220>
[junit] 09/07/15 16:27:22 INFO exec.UnionOperator: Union Operator needs to
transform row from parent[4] from
org.apache.hadoop.hive.serde2.objectinspector.StandardStructObjectInspector<org.apache.hadoop.hive.serde2.objectinspector.primitive.javastringobjectinspec...@5e2c17f7>
to
org.apache.hadoop.hive.serde2.objectinspector.StandardStructObjectInspector<org.apache.hadoop.hive.serde2.objectinspector.primitive.writablestringobjectinspec...@549b6220>
{code}
> UnionOperator fails when different inputs have different ObjectInspector (but
> the same TypeInfo)
> ------------------------------------------------------------------------------------------------
>
> Key: HIVE-635
> URL: https://issues.apache.org/jira/browse/HIVE-635
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.3.0, 0.3.1
> Reporter: Zheng Shao
> Assignee: Zheng Shao
> Attachments: HIVE-635.1.patch, HIVE-635.3.patch
>
>
> The current UnionOperator code assumes the ObjectInspectors from all parents
> are the same.
> But in reality, they can be different, and UnionOperator needs to do
> conversion if necessary.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
