[
https://issues.apache.org/jira/browse/HIVE-11431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653132#comment-14653132
]
Matt McCline commented on HIVE-11431:
-------------------------------------
Detailed system log:
{code}
2015-08-03 23:08:08,920 INFO [main]: physical.Vectorizer
(Vectorizer.java:specializeMapJoinOperator(1517)) - Vectorizer
vectorizeOperator map join hashTableKind HASH_SET hashTableKeyType MULTI_KEY
2015-08-03 23:08:08,920 INFO [main]: vector.VectorizationContext
(VectorizationContext.java:<init>(184)) - VectorizationContext consructor
reference contextName MAPJOIN level 1
2015-08-03 23:08:08,920 DEBUG [main]: vector.VectorizationContext
(VectorizationContext.java:getVectorExpression(450)) - Input Expression =
string, Vectorized Expression = IdentityExpression[0]
2015-08-03 23:08:08,920 DEBUG [main]: vector.VectorizationContext
(VectorizationContext.java:getVectorExpression(450)) - Input Expression =
string, Vectorized Expression = IdentityExpression[2]
2015-08-03 23:08:08,921 DEBUG [main]: vector.VectorizationContext
(VectorizationContext.java:getVectorExpression(450)) - Input Expression =
string, Vectorized Expression = IdentityExpression[0]
2015-08-03 23:08:08,921 DEBUG [main]: vector.VectorizationContext
(VectorizationContext.java:getVectorExpression(450)) - Input Expression =
string, Vectorized Expression = IdentityExpression[1]
2015-08-03 23:08:08,921 DEBUG [main]: vector.VectorizationContext
(VectorizationContext.java:getVectorExpression(450)) - Input Expression =
string, Vectorized Expression = IdentityExpression[2]
2015-08-03 23:08:08,921 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:determineCommonInfo(453)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor order [0, 1]
2015-08-03 23:08:08,921 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:determineCommonInfo(454)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor posBigTable 0
2015-08-03 23:08:08,921 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:determineCommonInfo(455)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor posSingleVectorMapJoinSmallTable 1
2015-08-03 23:08:08,921 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:determineCommonInfo(457)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor bigTableKeyColumnMap [0, 2]
2015-08-03 23:08:08,921 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:determineCommonInfo(458)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor bigTableKeyTypeNames [string, string]
2015-08-03 23:08:08,921 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:determineCommonInfo(460)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor bigTableValueColumnMap [0, 1, 2]
2015-08-03 23:08:08,921 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:determineCommonInfo(461)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor bigTableValueTypeNames [string, string,
string]
2015-08-03 23:08:08,921 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:determineCommonInfo(463)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor smallTableIndices [1, -1, 0]
2015-08-03 23:08:08,922 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:determineCommonInfo(464)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor smallTableRetainList [0, 1, 2]
2015-08-03 23:08:08,922 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:determineCommonInfo(466)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor firstSmallTableOutputColumn 3
2015-08-03 23:08:08,922 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:determineCommonInfo(467)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor smallTableOutputCount 3
2015-08-03 23:08:08,922 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:determineCommonInfo(469)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor bigTableRetainedMapping source columns:
[0, 1, 2], output columns: [0, 1, 2], type names: [string, string, string]
2015-08-03 23:08:08,922 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:determineCommonInfo(471)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor bigTableOuterKeyMapping source columns:
[], output columns: [], type names: []
2015-08-03 23:08:08,922 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:determineCommonInfo(473)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor smallTableMapping source columns: [0],
output columns: [3], type names: [string]
2015-08-03 23:08:08,922 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:determineCommonInfo(475)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor bigTableByteColumnVectorColumns []
2015-08-03 23:08:08,922 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:determineCommonInfo(476)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor smallTableByteColumnVectorColumns [3]
2015-08-03 23:08:08,922 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:determineCommonInfo(478)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor outputProjection [0, 1, 2, 2, 3, 0]
2015-08-03 23:08:08,922 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:determineCommonInfo(479)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor outputTypeNames [string, string,
string, string, string, string]
2015-08-03 23:08:08,922 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:setupVOutContext(511)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor outputColumnNames [_col0, _col1, _col2,
_col6, _col7, _col8]
2015-08-03 23:08:08,922 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:setupVOutContext(523)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor addProjectionColumn 0 columnName _col0
outputColumn 0
2015-08-03 23:08:08,923 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:setupVOutContext(523)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor addProjectionColumn 1 columnName _col1
outputColumn 1
2015-08-03 23:08:08,923 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:setupVOutContext(523)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor addProjectionColumn 2 columnName _col2
outputColumn 2
2015-08-03 23:08:08,923 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:setupVOutContext(523)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor addProjectionColumn 3 columnName _col6
outputColumn 2
2015-08-03 23:08:08,923 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:setupVOutContext(523)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor addProjectionColumn 4 columnName _col7
outputColumn 3
2015-08-03 23:08:08,923 DEBUG [main]: mapjoin.VectorMapJoinCommonOperator
(VectorMapJoinCommonOperator.java:setupVOutContext(523)) - null, MAPJOIN_19
VectorMapJoinCommonOperator constructor addProjectionColumn 5 columnName _col8
outputColumn 0
2015-08-03 23:08:08,923 INFO [main]: physical.Vectorizer
(Vectorizer.java:specializeMapJoinOperator(1587)) - Vectorizer
vectorizeOperator map join class VectorMapJoinLeftSemiMultiKeyOperator
2015-08-03 23:08:08,923 INFO [main]: physical.Vectorizer
(Vectorizer.java:vectorizeOperator(1717)) - vectorizeOperator
org.apache.hadoop.hive.ql.exec.vector.mapjoin.VectorMapJoinLeftSemiMultiKeyOperator
2015-08-03 23:08:08,923 INFO [main]: physical.Vectorizer
(Vectorizer.java:vectorizeOperator(1718)) - vectorizeOperator
org.apache.hadoop.hive.ql.plan.MapJoinDesc
2015-08-03 23:08:08,923 DEBUG [main]: physical.Vectorizer
(Vectorizer.java:process(754)) - Vectorized MapWork operator MAPJOIN added
vectorization context Context name MAPJOIN, level 1, sorted projectionColumnMap
{0=_col0, 1=_col1, 2=_col2, 3=_col7}, sorted scratchColumnTypeMap {3=String}
{code}
> Vectorization: select * Left Semi Join projections NPE
> ------------------------------------------------------
>
> Key: HIVE-11431
> URL: https://issues.apache.org/jira/browse/HIVE-11431
> Project: Hive
> Issue Type: Bug
> Components: Vectorization
> Affects Versions: 1.3.0, 1.2.1
> Reporter: Gopal V
> Assignee: Matt McCline
> Attachments: left-semi-bug.sql
>
>
> The "select *" is meant to only apply to the left most table, not the right
> most - the unprojected "d" from tmp1 triggers this NPE.
> {code}
> select * from tmp2 left semi join tmp1 where c1 = id and c0 = q;
> {code}
> {code}
> Caused by: java.lang.NullPointerException
> at java.lang.System.arraycopy(Native Method)
> at org.apache.hadoop.io.Text.set(Text.java:225)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorExtractRow$StringExtractorByValue.extract(VectorExtractRow.java:472)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorExtractRow.extractRow(VectorExtractRow.java:732)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorFileSinkOperator.process(VectorFileSinkOperator.java:96)
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:837)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorSelectOperator.process(VectorSelectOperator.java:136)
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:837)
> at
> org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator.process(VectorFilterOperator.java:117)
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:837)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
