[
https://issues.apache.org/jira/browse/DRILL-3991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16498578#comment-16498578
]
ASF GitHub Bot commented on DRILL-3991:
---------------------------------------
ilooner commented on issue #299: DRILL-3991 Initial patch to support schema
changes in hash join.
URL: https://github.com/apache/drill/pull/299#issuecomment-394010292
@amithadke Thanks for making these changes. Unfortunately, there have been
major changes to HashJoin since it now does spilling. So this code will have to
be refactored significantly. Additionally there will have be a design
discussion on how to handle schema changes with spilling, since I suspect
handling that will be non trivial. Since this PR has been inactive for a few
years and would require a good amount of work to update. I will close this PR.
Please feel free to reopen this PR if you would like to continue forward.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Support schema changes in hash join operator
> --------------------------------------------
>
> Key: DRILL-3991
> URL: https://issues.apache.org/jira/browse/DRILL-3991
> Project: Apache Drill
> Issue Type: Improvement
> Reporter: amit hadke
> Assignee: amit hadke
> Priority: Major
>
> Hash join should be able to support schema changes during execution.
> It should resolve edge cases when join columns are missing.
> Example:
> |Table A | Table B|
> | k1 v1 | k2 v2|
> | 1 "a" | "2" "b"|
> | 2 "b" | 1 "a"|
> | 2.0 "b" | 2.0 "b"|
> | 3 "c" | |
>
> A INNER JOIN B on A.k1=B.k2
> |k1 | v1 | k2| v2|
> | 1 | "a" | 1 | "a" |
> | 2 | "b" | 2.0 | "b" |
> | 2.0 | "b" | 2.0 | "b" |
> Where in output
>
> k1 is of union type (INTEGER, DOUBLE)
> k2 is of union type (INTEGER, DOUBLE, VARCHAR)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
