[jira] [Assigned] (HIVE-22114) insert query for partitioned table failing when all buckets are empty, s3 storage location

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-22114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar reassigned HIVE-22114:
---


> insert query for partitioned table failing when all buckets are empty, s3 
> storage location
> --
>
> Key: HIVE-22114
> URL: https://issues.apache.org/jira/browse/HIVE-22114
> Project: Hive
>  Issue Type: Bug
>  Components: Hive
>Affects Versions: 3.1.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Vineet Garg
>Priority: Major
>
> Following insert query fails when all buckets are empty
> {noformat}
> create table src_emptybucket_partitioned_1 (name string, age int, gpa 
> decimal(3,2))
>partitioned by(year int)
>clustered by (age)
>sorted by (age)
>into 100 buckets
>stored as orc;
> insert into table src_emptybucket_partitioned_1
>partition(year=2015)
>select * from studenttab10k limit 0;
> {noformat}
> Error:
> {noformat}
> ERROR : Job Commit failed with exception 
> 'org.apache.hadoop.hive.ql.metadata.HiveException(java.io.FileNotFoundException:
>  No such file or directory: 
> s3a://warehouse/tablespace/managed/hive/src_emptybucket_partitioned/year=2015)'
> # org.apache.hadoop.hive.ql.metadata.HiveException: 
> java.io.FileNotFoundException: No such file or directory: 
> s3a:///warehouse/tablespace/managed/hive/src_emptybucket_partitioned/year=2015
>   at 
> org.apache.hadoop.hive.ql.exec.FileSinkOperator.jobCloseOp(FileSinkOperator.java:1403)
>   at org.apache.hadoop.hive.ql.exec.Operator.jobClose(Operator.java:798)
>   at org.apache.hadoop.hive.ql.exec.Operator.jobClose(Operator.java:803)
>   at org.apache.hadoop.hive.ql.exec.tez.TezTask.close(TezTask.java:590)
>   at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:327)
>   at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212)
>   at 
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:103)
>   at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2335)
>   at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2002)
>   at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1674)
>   at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1372)
>   at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1366)
>   at 
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:157)
>   at 
> org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:226)
>   at 
> org.apache.hive.service.cli.operation.SQLOperation.access$700(SQLOperation.java:87)
>   at 
> org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:324)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)
>   at 
> org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:342)
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>   at java.lang.Thread.run(Thread.java:748)
> Caused by: java.io.FileNotFoundException: No such file or directory: 
> s3a:///warehouse/tablespace/managed/hive/src_emptybucket_partitioned/year=2015
>   at 
> org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:2805)
>   at 
> org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:2694)
>   at 
> org.apache.hadoop.fs.s3a.S3AFileSystem.getFileStatus(S3AFileSystem.java:2587)
>   at 
> org.apache.hadoop.fs.s3a.S3AFileSystem.innerListStatus(S3AFileSystem.java:2388)
>   at 
> org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$listStatus$10(S3AFileSystem.java:2367)
>   at org.apache.hadoop.fs.s3a.Invoker.once(Invoker.java:109)
>   at 
> org.apache.hadoop.fs.s3a.S3AFileSystem.listStatus(S3AFileSystem.java:2367)
>   at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1880)
>   at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1922)
>   at 
> 

[jira] [Assigned] (HIVE-19292) More than one materialized view in DB affecting query rewrite

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-19292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar reassigned HIVE-19292:
---


> More than one materialized view in DB affecting query rewrite
> -
>
> Key: HIVE-19292
> URL: https://issues.apache.org/jira/browse/HIVE-19292
> Project: Hive
>  Issue Type: Bug
>  Components: Hive
>Affects Versions: 3.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
>
> When there are more than one materialized view query rewrite fails to pick 
> the materialized view, which it picks otherwise
> {noformat}
> 1: jdbc:hive2://> show materialized views;
> INFO  : Compiling 
> command(queryId=hive_20180424204708_e39107e4-ae65-4e3e-a73f-19e0519b515c): 
> show materialized views
> INFO  : Semantic Analysis Completed
> INFO  : Returning Hive schema: 
> Schema(fieldSchemas:[FieldSchema(name:tab_name, type:string, comment:from 
> deserializer)], properties:null)
> INFO  : Completed compiling 
> command(queryId=hive_20180424204708_e39107e4-ae65-4e3e-a73f-19e0519b515c); 
> Time taken: 0.021 seconds
> INFO  : Executing 
> command(queryId=hive_20180424204708_e39107e4-ae65-4e3e-a73f-19e0519b515c): 
> show materialized views
> INFO  : Starting task [Stage-0:DDL] in serial mode
> INFO  : Completed executing 
> command(queryId=hive_20180424204708_e39107e4-ae65-4e3e-a73f-19e0519b515c); 
> Time taken: 0.174 seconds
> INFO  : OK
> +--+
> |   tab_name   |
> +--+
> | cmv_mat_view |
> | mv_agg   |
> | source_table_001_mv  |
> +--+
> 3 rows selected (0.3 seconds)
> 1: jdbc:hive2://> drop materialized view cmv_mat_view;
> INFO  : Compiling 
> command(queryId=hive_20180424204724_5d4f3aaf-ed22-4828-a1a8-d8fe9f6bd9af): 
> drop materialized view cmv_mat_view
> INFO  : Semantic Analysis Completed
> INFO  : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO  : Completed compiling 
> command(queryId=hive_20180424204724_5d4f3aaf-ed22-4828-a1a8-d8fe9f6bd9af); 
> Time taken: 0.029 seconds
> INFO  : Executing 
> command(queryId=hive_20180424204724_5d4f3aaf-ed22-4828-a1a8-d8fe9f6bd9af): 
> drop materialized view cmv_mat_view
> INFO  : Starting task [Stage-0:DDL] in serial mode
> INFO  : Completed executing 
> command(queryId=hive_20180424204724_5d4f3aaf-ed22-4828-a1a8-d8fe9f6bd9af); 
> Time taken: 0.312 seconds
> INFO  : OK
> No rows affected (0.369 seconds)
> 1: jdbc:hive2://> explain
> . . . . . . . . . . . . . . . . . . . . . . .> select
> . . . . . . . . . . . . . . . . . . . . . . .> SUM(A.DOWN_VOLUME) AS 
> DOWNLOAD_VOLUME_BYTES,
> . . . . . . . . . . . . . . . . . . . . . . .> FLOOR(A.MY_DATE to 
> hour),A.MY_ID2,A.ENVIRONMENT
> . . . . . . . . . . . . . . . . . . . . . . .> FROM source_table_001 AS A
> . . . . . . . . . . . . . . . . . . . . . . .> group by 
> A.MY_ID,A.MY_ID2,A.ENVIRONMENT,FLOOR(A.MY_DATE to hour);
> INFO  : Compiling 
> command(queryId=hive_20180424204736_76958a4d-0f08-4e22-93c6-67e3a1493b92): 
> explain
> select
> SUM(A.DOWN_VOLUME) AS DOWNLOAD_VOLUME_BYTES,
> FLOOR(A.MY_DATE to hour),A.MY_ID2,A.ENVIRONMENT
> FROM source_table_001 AS A
> group by A.MY_ID,A.MY_ID2,A.ENVIRONMENT,FLOOR(A.MY_DATE to hour)
> INFO  : Semantic Analysis Completed
> INFO  : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:Explain, 
> type:string, comment:null)], properties:null)
> INFO  : Completed compiling 
> command(queryId=hive_20180424204736_76958a4d-0f08-4e22-93c6-67e3a1493b92); 
> Time taken: 0.374 seconds
> INFO  : Executing 
> command(queryId=hive_20180424204736_76958a4d-0f08-4e22-93c6-67e3a1493b92): 
> explain
> select
> SUM(A.DOWN_VOLUME) AS DOWNLOAD_VOLUME_BYTES,
> FLOOR(A.MY_DATE to hour),A.MY_ID2,A.ENVIRONMENT
> FROM source_table_001 AS A
> group by A.MY_ID,A.MY_ID2,A.ENVIRONMENT,FLOOR(A.MY_DATE to hour)
> INFO  : Starting task [Stage-3:EXPLAIN] in serial mode
> INFO  : Completed executing 
> command(queryId=hive_20180424204736_76958a4d-0f08-4e22-93c6-67e3a1493b92); 
> Time taken: 0.006 seconds
> INFO  : OK
> ++
> |  Explain   |
> ++
> | Plan optimized by CBO. |
> ||
> | Vertex dependency in root stage|
> | Reducer 2 <- Map 1 (SIMPLE_EDGE)   |
> ||
> | Stage-0|
> |   Fetch Operator   |
> | limit:-1   |
> | Stage-1

[jira] [Assigned] (HIVE-19001) ADD CONSTRAINT support for DEFAULT, NOT NULL constraints

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-19001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar reassigned HIVE-19001:
---


> ADD CONSTRAINT support for DEFAULT, NOT NULL constraints
> 
>
> Key: HIVE-19001
> URL: https://issues.apache.org/jira/browse/HIVE-19001
> Project: Hive
>  Issue Type: Improvement
>  Components: Hive
>Affects Versions: 3.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Vineet Garg
>Priority: Major
>
> Add ALTER TABLE ADD CONSTRAINT support for DEFAULT and NOT NULL constraints. 
> Currently we are able to add them only via CREATE TABLE statement or ALTER 
> TABLE CHANGE



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Assigned] (HIVE-18950) DESCRIBE EXTENDED missing details of default constraint

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-18950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar reassigned HIVE-18950:
---


> DESCRIBE EXTENDED missing details of default constraint
> ---
>
> Key: HIVE-18950
> URL: https://issues.apache.org/jira/browse/HIVE-18950
> Project: Hive
>  Issue Type: Bug
>  Components: Hive
>Affects Versions: 3.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Vineet Garg
>Priority: Major
> Fix For: 3.0.0
>
>
> Describe extended output is missing default constraint details
> {noformat}
> 0: jdbc:hive2://ctr-e138-1518143905142-95188-> create table t1(j int 
> constraint c1 default 4);
> INFO  : Compiling 
> command(queryId=hive_20180313202851_de315f0e-4064-467d-9dcc-f8dd7f737318): 
> create table t1(j int constraint c1 default 4)
> INFO  : Semantic Analysis Completed
> INFO  : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO  : Completed compiling 
> command(queryId=hive_20180313202851_de315f0e-4064-467d-9dcc-f8dd7f737318); 
> Time taken: 0.015 seconds
> INFO  : Executing 
> command(queryId=hive_20180313202851_de315f0e-4064-467d-9dcc-f8dd7f737318): 
> create table t1(j int constraint c1 default 4)
> INFO  : Starting task [Stage-0:DDL] in serial mode
> INFO  : Completed executing 
> command(queryId=hive_20180313202851_de315f0e-4064-467d-9dcc-f8dd7f737318); 
> Time taken: 0.048 seconds
> INFO  : OK
> No rows affected (0.087 seconds)
> {noformat}
> {noformat}
> 0: jdbc:hive2://ctr-e138-1518143905142-95188-> DESCRIBE EXTENDED t1;
> INFO  : Compiling 
> command(queryId=hive_20180313215805_0596cea8-918c-46f7-bd9a-8611972eb3cc): 
> DESCRIBE EXTENDED t1
> INFO  : Semantic Analysis Completed
> INFO  : Returning Hive schema: 
> Schema(fieldSchemas:[FieldSchema(name:col_name, type:string, comment:from 
> deserializer), FieldSchema(name:data_type, type:string, comment:from 
> deserializer), FieldSchema(name:comment, type:string, comment:from 
> deserializer)], properties:null)
> INFO  : Completed compiling 
> command(queryId=hive_20180313215805_0596cea8-918c-46f7-bd9a-8611972eb3cc); 
> Time taken: 0.029 seconds
> INFO  : Executing 
> command(queryId=hive_20180313215805_0596cea8-918c-46f7-bd9a-8611972eb3cc): 
> DESCRIBE EXTENDED t1
> INFO  : Starting task [Stage-0:DDL] in serial mode
> INFO  : Completed executing 
> command(queryId=hive_20180313215805_0596cea8-918c-46f7-bd9a-8611972eb3cc); 
> Time taken: 0.03 seconds
> INFO  : OK
> +-++--+
> |  col_name   | data_type 
>  | comment  |
> +-++--+
> | j   | int   
>  |  |
> | | NULL  
>  | NULL |
> | Detailed Table Information  | Table(tableName:t1, dbName:default, 
> owner:hrt_qa, createTime:1520972931, lastAccessTime:0, retention:0, 
> sd:StorageDescriptor(cols:[FieldSchema(name:j, type:int, comment:null)], 
> location:hdfs://mycluster/apps/hive/warehouse/t1, 
> inputFormat:org.apache.hadoop.mapred.TextInputFormat, 
> outputFormat:org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat, 
> compressed:false, numBuckets:-1, serdeInfo:SerDeInfo(name:null, 
> serializationLib:org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe, 
> parameters:{serialization.format=1}), bucketCols:[], sortCols:[], 
> parameters:{}, skewedInfo:SkewedInfo(skewedColNames:[], skewedColValues:[], 
> skewedColValueLocationMaps:{}), storedAsSubDirectories:false), 
> partitionKeys:[], parameters:{totalSize=0, numRows=0, rawDataSize=0, 
> transactional_properties=insert_only, 
> COLUMN_STATS_ACCURATE={\"BASIC_STATS\":\"true\",\"COLUMN_STATS\":{\"j\":\"true\"}},
>  numFiles=0, transient_lastDdlTime=1520972931, transactional=true}, 
> viewOriginalText:null, viewExpandedText:null, tableType:MANAGED_TABLE, 
> rewriteEnabled:false) |  |
> +-++--+
> 3 rows selected (0.099 seconds){noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Assigned] (HIVE-18687) Triggers failing to result in event in HA clusters

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-18687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar reassigned HIVE-18687:
---


> Triggers failing to result in event in HA clusters
> --
>
> Key: HIVE-18687
> URL: https://issues.apache.org/jira/browse/HIVE-18687
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2
>Affects Versions: 3.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Prasanth Jayachandran
>Priority: Major
> Fix For: 3.0.0
>
>
> Triggers in active plan are failing to get picked in some cases, in HA 
> cluster . In HA environment when the query to activate plan and the test 
> query (which we expect to get killed by trigger) end up in different 
> hiveserver2 instances in the same cluster, trigger fails to kick in and kill 
> the query.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Resolved] (HIVE-18656) Trigger with counter TOTAL_TASKS fails to result in an event even when condition is met

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-18656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar resolved HIVE-18656.
-
Resolution: Invalid

Design for the counter to separate the counters at vertex level and dag level

> Trigger with counter TOTAL_TASKS fails to result in an event even when 
> condition is met
> ---
>
> Key: HIVE-18656
> URL: https://issues.apache.org/jira/browse/HIVE-18656
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2
>Affects Versions: 3.0.0
> Environment: Trigger involving counter TOTAL_TASKS seems to fail to 
> trigger event in definition even when the trigger condition is met
> Trigger definition:
> {noformat}
> ++
> |line|
> ++
> | plan_1[status=ACTIVE,parallelism=null,defaultPool=default] |
> |  +  default[allocFraction=1.0,schedulingPolicy=null,parallelism=4] |
> |  |  mapped for default |
> |  +  |
> |  |  trigger limit_task_per_vertex_trigger: if (TOTAL_TASKS > 5) { KILL 
> } |
> ++
> {noformat}
> Query is finishing fine even when one vertex is having 29 tasks 
> {noformat}
> INFO  : Query ID = hive_20180208193705_73642730-2c6b-4d4d-a608-a849b147bc37
> INFO  : Total jobs = 1
> INFO  : Launching Job 1 out of 1
> INFO  : Starting task [Stage-1:MAPRED] in serial mode
> INFO  : Subscribed to counters: [TOTAL_TASKS] for queryId: 
> hive_20180208193705_73642730-2c6b-4d4d-a608-a849b147bc37
> INFO  : Tez session hasn't been created yet. Opening session
> INFO  : Dag name: with ssales as
> (select c_last_name...ssales) (Stage-1)
> INFO  : Setting tez.task.scale.memory.reserve-fraction to 0.3001192092896
> INFO  : Setting tez.task.scale.memory.reserve-fraction to 0.3001192092896
> INFO  : Setting tez.task.scale.memory.reserve-fraction to 0.3001192092896
> INFO  : Setting tez.task.scale.memory.reserve-fraction to 0.3001192092896
> INFO  : Status: Running (Executing on YARN cluster with App id 
> application_151782410_0199)
> --
> VERTICES  MODESTATUS  TOTAL  COMPLETED  RUNNING  PENDING  
> FAILED  KILLED
> --
> Map 6 .. container SUCCEEDED  1  100  
>  0   0
> Map 8 .. container SUCCEEDED  1  100  
>  0   0
> Map 7 .. container SUCCEEDED  1  100  
>  0   0
> Map 9 .. container SUCCEEDED  1  100  
>  0   0
> Map 10 . container SUCCEEDED  3  300  
>  0   0
> Map 11 . container SUCCEEDED  1  100  
>  0   0
> Map 12 . container SUCCEEDED  1  100  
>  0   0
> Map 13 . container SUCCEEDED  3  300  
>  0   0
> Map 1 .. container SUCCEEDED  9  900  
>  0   0
> Reducer 2 .. container SUCCEEDED  2  200  
>  0   0
> Reducer 4 .. container SUCCEEDED 29 2900  
>  0   0
> Reducer 5 .. container SUCCEEDED  1  100  
>  0   0
> Reducer 3container SUCCEEDED  0  000  
>  0   0
> --
> VERTICES: 12/13  [==>>] 100%  ELAPSED TIME: 21.15 s
> --
> INFO  : Status: DAG finished successfully in 21.07 seconds
> {noformat}
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Prasanth Jayachandran
>Priority: Major
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Assigned] (HIVE-18656) Trigger with counter TOTAL_TASKS fails to result in an event even when condition is met

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-18656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar reassigned HIVE-18656:
---


> Trigger with counter TOTAL_TASKS fails to result in an event even when 
> condition is met
> ---
>
> Key: HIVE-18656
> URL: https://issues.apache.org/jira/browse/HIVE-18656
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2
>Affects Versions: 3.0.0
> Environment: Trigger involving counter TOTAL_TASKS seems to fail to 
> trigger event in definition even when the trigger condition is met
> Trigger definition:
> {noformat}
> ++
> |line|
> ++
> | plan_1[status=ACTIVE,parallelism=null,defaultPool=default] |
> |  +  default[allocFraction=1.0,schedulingPolicy=null,parallelism=4] |
> |  |  mapped for default |
> |  +  |
> |  |  trigger limit_task_per_vertex_trigger: if (TOTAL_TASKS > 5) { KILL 
> } |
> ++
> {noformat}
> Query is finishing fine even when one vertex is having 29 tasks 
> {noformat}
> INFO  : Query ID = hive_20180208193705_73642730-2c6b-4d4d-a608-a849b147bc37
> INFO  : Total jobs = 1
> INFO  : Launching Job 1 out of 1
> INFO  : Starting task [Stage-1:MAPRED] in serial mode
> INFO  : Subscribed to counters: [TOTAL_TASKS] for queryId: 
> hive_20180208193705_73642730-2c6b-4d4d-a608-a849b147bc37
> INFO  : Tez session hasn't been created yet. Opening session
> INFO  : Dag name: with ssales as
> (select c_last_name...ssales) (Stage-1)
> INFO  : Setting tez.task.scale.memory.reserve-fraction to 0.3001192092896
> INFO  : Setting tez.task.scale.memory.reserve-fraction to 0.3001192092896
> INFO  : Setting tez.task.scale.memory.reserve-fraction to 0.3001192092896
> INFO  : Setting tez.task.scale.memory.reserve-fraction to 0.3001192092896
> INFO  : Status: Running (Executing on YARN cluster with App id 
> application_151782410_0199)
> --
> VERTICES  MODESTATUS  TOTAL  COMPLETED  RUNNING  PENDING  
> FAILED  KILLED
> --
> Map 6 .. container SUCCEEDED  1  100  
>  0   0
> Map 8 .. container SUCCEEDED  1  100  
>  0   0
> Map 7 .. container SUCCEEDED  1  100  
>  0   0
> Map 9 .. container SUCCEEDED  1  100  
>  0   0
> Map 10 . container SUCCEEDED  3  300  
>  0   0
> Map 11 . container SUCCEEDED  1  100  
>  0   0
> Map 12 . container SUCCEEDED  1  100  
>  0   0
> Map 13 . container SUCCEEDED  3  300  
>  0   0
> Map 1 .. container SUCCEEDED  9  900  
>  0   0
> Reducer 2 .. container SUCCEEDED  2  200  
>  0   0
> Reducer 4 .. container SUCCEEDED 29 2900  
>  0   0
> Reducer 5 .. container SUCCEEDED  1  100  
>  0   0
> Reducer 3container SUCCEEDED  0  000  
>  0   0
> --
> VERTICES: 12/13  [==>>] 100%  ELAPSED TIME: 21.15 s
> --
> INFO  : Status: DAG finished successfully in 21.07 seconds
> {noformat}
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Prasanth Jayachandran
>Priority: Major
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Assigned] (HIVE-18638) Triggers for multi-pool move, failing to initiate the move event

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-18638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar reassigned HIVE-18638:
---


> Triggers for multi-pool move, failing to initiate the move event
> 
>
> Key: HIVE-18638
> URL: https://issues.apache.org/jira/browse/HIVE-18638
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2
>Affects Versions: 3.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Prasanth Jayachandran
>Priority: Major
>
> Resource plan with multiple pools and trigger set to move job across those 
> pools seems to be failing to do so
> Resource plan:
> {noformat}
> 1: jdbc:hive2://ctr-e137-1514896590304-51538-> show resource plan plan_2; 
> INFO : Compiling 
> command(queryId=hive_20180202220823_2fb8bca7-5b7a-48cf-8ff9-8d5f3548d334): 
> show resource plan plan_2 INFO : Semantic Analysis Completed INFO : Returning 
> Hive schema: Schema(fieldSchemas:[FieldSchema(name:line, type:string, 
> comment:from deserializer)], properties:null) INFO : Completed compiling 
> command(queryId=hive_20180202220823_2fb8bca7-5b7a-48cf-8ff9-8d5f3548d334); 
> Time taken: 0.008 seconds INFO : Executing 
> command(queryId=hive_20180202220823_2fb8bca7-5b7a-48cf-8ff9-8d5f3548d334): 
> show resource plan plan_2 INFO : Starting task [Stage-0:DDL] in serial mode 
> INFO : Completed executing 
> command(queryId=hive_20180202220823_2fb8bca7-5b7a-48cf-8ff9-8d5f3548d334); 
> Time taken: 0.196 seconds INFO : OK 
> ++ | line | 
> ++ | 
> plan_2[status=ACTIVE,parallelism=null,defaultPool=pool2] | | + 
> pool2[allocFraction=0.5,schedulingPolicy=default,parallelism=3] | | | trigger 
> too_large_write_triger: if (HDFS_BYTES_WRITTEN > 10kb) { MOVE TO pool1 } | | 
> | mapped for default | | + 
> pool1[allocFraction=0.3,schedulingPolicy=default,parallelism=5] | | | trigger 
> slow_pool_trigger: if (ELAPSED_TIME > 3) { MOVE TO pool3 } | | + 
> pool3[allocFraction=0.2,schedulingPolicy=default,parallelism=3] | | + 
> default[allocFraction=0.0,schedulingPolicy=null,parallelism=4] | 
> ++ 8 rows selected (0.25 
> seconds)
> {noformat}
> Workload Manager Events Summary from query run:
> {noformat}
> INFO  : {
>   "queryId" : "hive_20180202213425_9633d7af-4242-4e95-a391-2cd3823e3eac",
>   "queryStartTime" : 1517607265395,
>   "queryEndTime" : 1517607321648,
>   "queryCompleted" : true,
>   "queryWmEvents" : [ {
> "wmTezSessionInfo" : {
>   "sessionId" : "21f8a4ab-511e-4828-a2dd-1d5f2932c492",
>   "poolName" : "pool2",
>   "clusterPercent" : 50.0
> },
> "eventStartTimestamp" : 1517607269660,
> "eventEndTimestamp" : 1517607269661,
> "eventType" : "GET",
> "elapsedTime" : 1
>   }, {
> "wmTezSessionInfo" : {
>   "sessionId" : "21f8a4ab-511e-4828-a2dd-1d5f2932c492",
>   "poolName" : null,
>   "clusterPercent" : 0.0
> },
> "eventStartTimestamp" : 1517607321663,
> "eventEndTimestamp" : 1517607321663,
> "eventType" : "RETURN",
> "elapsedTime" : 0
>   } ],
>   "appliedTriggers" : [ {
> "name" : "too_large_write_triger",
> "expression" : {
>   "counterLimit" : {
> "limit" : 10240,
> "name" : "HDFS_BYTES_WRITTEN"
>   },
>   "predicate" : "GREATER_THAN"
> },
> "action" : {
>   "type" : "MOVE_TO_POOL",
>   "poolName" : "pool1"
> },
> "violationMsg" : null
>   } ],
>   "subscribedCounters" : [ "HDFS_BYTES_WRITTEN" ],
>   "currentCounters" : {
> "HDFS_BYTES_WRITTEN" : 33306829
>   },
>   "elapsedTime" : 56284
> }
> {noformat}
> From the Workload Manager Event Summary it could seen that the 'MOVE' event 
> didn't happen though the limit for counter (10240) HDFS_BYTES_WRITTEN was 
> exceeded



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Assigned] (HIVE-18637) WorkloadManagent Event Summary leaving subscribedCounters and currentCounters fields empty

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-18637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar reassigned HIVE-18637:
---


> WorkloadManagent Event Summary leaving subscribedCounters and currentCounters 
> fields empty
> --
>
> Key: HIVE-18637
> URL: https://issues.apache.org/jira/browse/HIVE-18637
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2
>Affects Versions: 3.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Harish Jaiprakash
>Priority: Major
>
> subscribedCounters and currentCounters values are empty when trigger results 
> in MOVE event
> WorkloadManager Events Summary
> {noformat}
> INFO  : {
>   "queryId" : "hive_20180205214449_d2955891-e3b2-4ac3-bca9-5d2a53feb8c0",
>   "queryStartTime" : 1517867089060,
>   "queryEndTime" : 1517867144341,
>   "queryCompleted" : true,
>   "queryWmEvents" : [ {
> "wmTezSessionInfo" : {
>   "sessionId" : "157866e5-ed1c-4abd-9846-db76b91c1124",
>   "poolName" : "pool2",
>   "clusterPercent" : 30.0
> },
> "eventStartTimestamp" : 1517867094797,
> "eventEndTimestamp" : 1517867094798,
> "eventType" : "GET",
> "elapsedTime" : 1
>   }, {
> "wmTezSessionInfo" : {
>   "sessionId" : "157866e5-ed1c-4abd-9846-db76b91c1124",
>   "poolName" : "pool1",
>   "clusterPercent" : 70.0
> },
> "eventStartTimestamp" : 1517867139886,
> "eventEndTimestamp" : 1517867139887,
> "eventType" : "MOVE",
> "elapsedTime" : 1
>   }, {
> "wmTezSessionInfo" : {
>   "sessionId" : "157866e5-ed1c-4abd-9846-db76b91c1124",
>   "poolName" : null,
>   "clusterPercent" : 0.0
> },
> "eventStartTimestamp" : 1517867144360,
> "eventEndTimestamp" : 1517867144360,
> "eventType" : "RETURN",
> "elapsedTime" : 0
>   } ],
>   "appliedTriggers" : [ {
> "name" : "too_large_write_triger",
> "expression" : {
>   "counterLimit" : {
> "limit" : 10240,
> "name" : "HDFS_BYTES_WRITTEN"
>   },
>   "predicate" : "GREATER_THAN"
> },
> "action" : {
>   "type" : "MOVE_TO_POOL",
>   "poolName" : "pool1"
> },
> "violationMsg" : "Trigger { name: too_large_write_triger, expression: 
> HDFS_BYTES_WRITTEN > 10240, action: MOVE TO pool1 } violated. Current value: 
> 5096345"
>   } ],
>   "subscribedCounters" : [ ],
>   "currentCounters" : { },
>   "elapsedTime" : 55304
> }
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (HIVE-16421) Runtime filtering breaks user-level explain

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-16421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar updated HIVE-16421:

Description: 
Query:
SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY 
t1.tinyint_col_52 DESC) AS int_col FROM table_6 t1 INNER JOIN table_14 t2 ON 
((t2.decimal0101_col_55) = (t1.decimal0101_col_9));

Without runtime filtering
+-+--+
|   
Explain 
  |
+-+--+
| Plan not optimized by CBO.

  |
|   

  |
| Vertex dependency in root stage   

  |
| Map 1 <- Map 3 (BROADCAST_EDGE)   

  |
| Reducer 2 <- Map 1 (SIMPLE_EDGE)  

  |
|   

  |
| Stage-0   

  |
|Fetch Operator 

  |
|   limit:-1

  |
|   Stage-1 

  |
|  Reducer 2

  |
|  File Output Operator [FS_364]

  |
| compressed:false  

  |
| Statistics:Num rows: 74781721 Data size: 299126884 Basic stats: 
COMPLETE Column stats: COMPLETE 
|
| table:{"input 
format:":"org.apache.hadoop.mapred.TextInputFormat","output 
format:":"org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat","serde:":"org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe"}
  |
| Select Operator [SEL_362] 

  |
|outputColumnNames:["_col0"]

  

[jira] [Commented] (HIVE-16181) Make logic for hdfs directory location extraction more generic, in webhcat test driver

[Aswathy Chellammal Sreekumar (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-16181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925160#comment-15925160
 ] 

Aswathy Chellammal Sreekumar commented on HIVE-16181:
-

Thanks for the review [~daijy]

> Make logic for hdfs directory location extraction more generic, in webhcat 
> test driver
> --
>
> Key: HIVE-16181
> URL: https://issues.apache.org/jira/browse/HIVE-16181
> Project: Hive
>  Issue Type: Test
>  Components: WebHCat
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Aswathy Chellammal Sreekumar
>Priority: Minor
> Fix For: 2.2.0
>
> Attachments: HIVE-16181.1.patch
>
>
> Patch to make regular expression for directory location lookup in 
> setLocationPermGroup of TestDriverCurl more generic to accommodate patterns 
> without port number like hdfs://mycluster/hive/warehouse/



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (HIVE-16181) Make logic for hdfs directory location extraction more generic, in webhcat test driver

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-16181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar updated HIVE-16181:

Description: Patch to make regular expression for directory location lookup 
in setLocationPermGroup of TestDriverCurl more generic to accommodate patterns 
without port number like hdfs://mycluster/hive/warehouse/  (was: Patch 
to make regular expression for directory location lookup in 
setLocationPermGroup of TestDriverCurl more generic to accommodate patterns 
without port number like hdfs://mycluster//hive/warehouse/)

> Make logic for hdfs directory location extraction more generic, in webhcat 
> test driver
> --
>
> Key: HIVE-16181
> URL: https://issues.apache.org/jira/browse/HIVE-16181
> Project: Hive
>  Issue Type: Test
>  Components: WebHCat
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Aswathy Chellammal Sreekumar
>Priority: Minor
> Attachments: HIVE-16181.1.patch
>
>
> Patch to make regular expression for directory location lookup in 
> setLocationPermGroup of TestDriverCurl more generic to accommodate patterns 
> without port number like hdfs://mycluster/hive/warehouse/



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (HIVE-16181) Make logic for hdfs directory location extraction more generic, in webhcat test driver

[Aswathy Chellammal Sreekumar (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-16181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925040#comment-15925040
 ] 

Aswathy Chellammal Sreekumar commented on HIVE-16181:
-

With that, the match is going all the way to last part of hdfs location, 
retrieving just the folder name instead of the whole path

> Make logic for hdfs directory location extraction more generic, in webhcat 
> test driver
> --
>
> Key: HIVE-16181
> URL: https://issues.apache.org/jira/browse/HIVE-16181
> Project: Hive
>  Issue Type: Test
>  Components: WebHCat
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Aswathy Chellammal Sreekumar
>Priority: Minor
> Attachments: HIVE-16181.1.patch
>
>
> Patch to make regular expression for directory location lookup in 
> setLocationPermGroup of TestDriverCurl more generic to accommodate patterns 
> without port number like hdfs://mycluster//hive/warehouse/



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (HIVE-16181) Make logic for hdfs directory location extraction more generic, in webhcat test driver

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-16181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar updated HIVE-16181:

Attachment: HIVE-16181.1.patch

> Make logic for hdfs directory location extraction more generic, in webhcat 
> test driver
> --
>
> Key: HIVE-16181
> URL: https://issues.apache.org/jira/browse/HIVE-16181
> Project: Hive
>  Issue Type: Test
>  Components: WebHCat
>Reporter: Aswathy Chellammal Sreekumar
>Priority: Minor
> Attachments: HIVE-16181.1.patch
>
>
> Patch to make regular expression for directory location lookup in 
> setLocationPermGroup of TestDriverCurl more generic to accommodate patterns 
> without port number like hdfs://mycluster//hive/warehouse/



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (HIVE-15919) Row count mismatch for count * query

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-15919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar updated HIVE-15919:

Description: 
The following query is returning different output when run against hive and 
postgres.

Query:

SELECT COUNT (*)
FROM
(SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY 
t1.tinyint_col_52 DESC) AS int_col
FROM table_6 t1
INNER JOIN table_14 t2 ON ((t2.decimal0101_col_55) = (t1.decimal0101_col_9))) 
AS FOO;

>From hive: 0
>From postgres: 66903279

Attaching ddl files for the tables.

  was:
The following query is returning different output when run against hive and 
postgres.

Query:

SELECT COUNT (*)
FROM
(SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY 
t1.tinyint_col_52 DESC) AS int_col
FROM table_6 t1
INNER JOIN table_14 t2 ON ((t2.decimal0101_col_55) = (t1.decimal0101_col_9))) 
AS FOO;

>From hive: 0
>From postgres: 66903279

Attaching ddl and data files for the tables.


> Row count mismatch for count * query
> 
>
> Key: HIVE-15919
> URL: https://issues.apache.org/jira/browse/HIVE-15919
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2
>Reporter: Aswathy Chellammal Sreekumar
> Attachments: table_14.q, table_6.q
>
>
> The following query is returning different output when run against hive and 
> postgres.
> Query:
> SELECT COUNT (*)
> FROM
> (SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY 
> t1.tinyint_col_52 DESC) AS int_col
> FROM table_6 t1
> INNER JOIN table_14 t2 ON ((t2.decimal0101_col_55) = (t1.decimal0101_col_9))) 
> AS FOO;
> From hive: 0
> From postgres: 66903279
> Attaching ddl files for the tables.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (HIVE-15919) Row count mismatch for count * query

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-15919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar updated HIVE-15919:

Attachment: table_6.q
table_14.q

> Row count mismatch for count * query
> 
>
> Key: HIVE-15919
> URL: https://issues.apache.org/jira/browse/HIVE-15919
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2
>Reporter: Aswathy Chellammal Sreekumar
> Attachments: table_14.q, table_6.q
>
>
> The following query is returning different output when run against hive and 
> postgres.
> Query:
> SELECT COUNT (*)
> FROM
> (SELECT LAG(COALESCE(t2.int_col_14, t1.int_col_80),22) OVER (ORDER BY 
> t1.tinyint_col_52 DESC) AS int_col
> FROM table_6 t1
> INNER JOIN table_14 t2 ON ((t2.decimal0101_col_55) = (t1.decimal0101_col_9))) 
> AS FOO;
> From hive: 0
> From postgres: 66903279
> Attaching ddl and data files for the tables.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (HIVE-15904) select query throwing Null Pointer Exception from org.apache.hadoop.hive.ql.optimizer.DynamicPartitionPruningOptimization.generateSemiJoinOperatorPlan

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-15904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar updated HIVE-15904:

Description: 
Following query failing with Null Pointer Exception from 
org.apache.hadoop.hive.ql.optimizer.DynamicPartitionPruningOptimization.generateSemiJoinOperatorPlan

Attaching create table statements for table_1 and table_18

Query:
SELECT
COALESCE(498, LEAD(COALESCE(-973, -684, 515)) OVER (PARTITION BY (t2.int_col_10 
+ t1.smallint_col_50) ORDER BY (t2.int_col_10 + t1.smallint_col_50), 
FLOOR(t1.double_col_16) DESC), 524) AS int_col,
(t2.int_col_10) + (t1.smallint_col_50) AS int_col_1,
FLOOR(t1.double_col_16) AS float_col,
COALESCE(SUM(COALESCE(62, -380, -435)) OVER (PARTITION BY (t2.int_col_10 + 
t1.smallint_col_50) ORDER BY (t2.int_col_10 + t1.smallint_col_50) DESC, 
FLOOR(t1.double_col_16) DESC ROWS BETWEEN UNBOUNDED PRECEDING AND 48 
FOLLOWING), 704) AS int_col_2
FROM table_1 t1
INNER JOIN table_18 t2 ON (((t2.tinyint_col_15) = (t1.bigint_col_7)) AND
((t2.decimal2709_col_9) = (t1.decimal2016_col_26))) AND
((t2.tinyint_col_20) = (t1.tinyint_col_3))
WHERE (t2.smallint_col_19) IN (SELECT
COALESCE(-92, -994) AS int_col
FROM table_1 tt1
INNER JOIN table_18 tt2 ON (tt2.decimal1911_col_16) = (tt1.decimal2612_col_77)
WHERE (t1.timestamp_col_9) = (tt2.timestamp_col_18));

Error Stack:

org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: 
FAILED: NullPointerException null
at 
org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:387)
 
at 
org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:193)
 
at 
org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:276)
 
at 
org.apache.hive.service.cli.operation.Operation.run(Operation.java:324) 
at 
org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:507)
 
at 
org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:495)
 
at 
org.apache.hive.service.cli.CLIService.executeStatementAsync(CLIService.java:308)
 
at 
org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(ThriftCLIService.java:506)
 
at 
org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1437)
 
at 
org.apache.hive.service.rpc.thrift.TCLIService$Processor$ExecuteStatement.getResult(TCLIService.java:1422)
 
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) 
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) 
at 
org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge.java:599)
 
at 
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
 
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
[?:1.8.0_112]
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
[?:1.8.0_112]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_112]
Caused by: java.lang.NullPointerException
at 
org.apache.hadoop.hive.ql.optimizer.DynamicPartitionPruningOptimization.generateSemiJoinOperatorPlan(DynamicPartitionPruningOptimization.java:402)
 
at 
org.apache.hadoop.hive.ql.optimizer.DynamicPartitionPruningOptimization.process(DynamicPartitionPruningOptimization.java:226)
 
at 
org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:90)
 
at 
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatchAndReturn(DefaultGraphWalker.java:105)
 
at 
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:89)
 
at 
org.apache.hadoop.hive.ql.lib.ForwardWalker.walk(ForwardWalker.java:74) 
at 
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWalker.java:120)
 
at 
org.apache.hadoop.hive.ql.parse.TezCompiler.runDynamicPartitionPruning(TezCompiler.java:358)
 
at 
org.apache.hadoop.hive.ql.parse.TezCompiler.optimizeOperatorPlan(TezCompiler.java:90)
 
at 
org.apache.hadoop.hive.ql.parse.TaskCompiler.compile(TaskCompiler.java:134) 
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:11126)
 
at 
org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:288)
 
at 
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:257)
 
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:447) 
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:329) 
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1189) 
at 

[jira] [Updated] (HIVE-15904) select query throwing Null Pointer Exception from org.apache.hadoop.hive.ql.optimizer.DynamicPartitionPruningOptimization.generateSemiJoinOperatorPlan

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-15904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar updated HIVE-15904:

Attachment: table_1.q
table_18.q

> select query throwing Null Pointer Exception from 
> org.apache.hadoop.hive.ql.optimizer.DynamicPartitionPruningOptimization.generateSemiJoinOperatorPlan
> --
>
> Key: HIVE-15904
> URL: https://issues.apache.org/jira/browse/HIVE-15904
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Jason Dere
> Attachments: table_18.q, table_1.q
>
>
> Following query failing with Null Pointer Exception from 
> org.apache.hadoop.hive.ql.optimizer.DynamicPartitionPruningOptimization.generateSemiJoinOperatorPlan
> Attaching create table statements for table_1 and table_18
> Query:
> SELECT
> COALESCE(498, LEAD(COALESCE(-973, -684, 515)) OVER (PARTITION BY 
> (t2.int_col_10 + t1.smallint_col_50) ORDER BY (t2.int_col_10 + 
> t1.smallint_col_50), FLOOR(t1.double_col_16) DESC), 524) AS int_col,
> (t2.int_col_10) + (t1.smallint_col_50) AS int_col_1,
> FLOOR(t1.double_col_16) AS float_col,
> COALESCE(SUM(COALESCE(62, -380, -435)) OVER (PARTITION BY (t2.int_col_10 + 
> t1.smallint_col_50) ORDER BY (t2.int_col_10 + t1.smallint_col_50) DESC, 
> FLOOR(t1.double_col_16) DESC ROWS BETWEEN UNBOUNDED PRECEDING AND 48 
> FOLLOWING), 704) AS int_col_2
> FROM table_1 t1
> INNER JOIN table_18 t2 ON (((t2.tinyint_col_15) = (t1.bigint_col_7)) AND
> ((t2.decimal2709_col_9) = (t1.decimal2016_col_26))) AND
> ((t2.tinyint_col_20) = (t1.tinyint_col_3))
> WHERE (t2.smallint_col_19) IN (SELECT
> COALESCE(-92, -994) AS int_col
> FROM table_1 tt1
> INNER JOIN table_18 tt2 ON (tt2.decimal1911_col_16) = (tt1.decimal2612_col_77)
> WHERE (t1.timestamp_col_9) = (tt2.timestamp_col_18));



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Assigned] (HIVE-15904) select query throwing Null Pointer Exception from org.apache.hadoop.hive.ql.optimizer.DynamicPartitionPruningOptimization.generateSemiJoinOperatorPlan

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-15904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar reassigned HIVE-15904:
---


> select query throwing Null Pointer Exception from 
> org.apache.hadoop.hive.ql.optimizer.DynamicPartitionPruningOptimization.generateSemiJoinOperatorPlan
> --
>
> Key: HIVE-15904
> URL: https://issues.apache.org/jira/browse/HIVE-15904
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Jason Dere
>
> Following query failing with Null Pointer Exception from 
> org.apache.hadoop.hive.ql.optimizer.DynamicPartitionPruningOptimization.generateSemiJoinOperatorPlan
> Attaching create table statements for table_1 and table_18
> Query:
> SELECT
> COALESCE(498, LEAD(COALESCE(-973, -684, 515)) OVER (PARTITION BY 
> (t2.int_col_10 + t1.smallint_col_50) ORDER BY (t2.int_col_10 + 
> t1.smallint_col_50), FLOOR(t1.double_col_16) DESC), 524) AS int_col,
> (t2.int_col_10) + (t1.smallint_col_50) AS int_col_1,
> FLOOR(t1.double_col_16) AS float_col,
> COALESCE(SUM(COALESCE(62, -380, -435)) OVER (PARTITION BY (t2.int_col_10 + 
> t1.smallint_col_50) ORDER BY (t2.int_col_10 + t1.smallint_col_50) DESC, 
> FLOOR(t1.double_col_16) DESC ROWS BETWEEN UNBOUNDED PRECEDING AND 48 
> FOLLOWING), 704) AS int_col_2
> FROM table_1 t1
> INNER JOIN table_18 t2 ON (((t2.tinyint_col_15) = (t1.bigint_col_7)) AND
> ((t2.decimal2709_col_9) = (t1.decimal2016_col_26))) AND
> ((t2.tinyint_col_20) = (t1.tinyint_col_3))
> WHERE (t2.smallint_col_19) IN (SELECT
> COALESCE(-92, -994) AS int_col
> FROM table_1 tt1
> INNER JOIN table_18 tt2 ON (tt2.decimal1911_col_16) = (tt1.decimal2612_col_77)
> WHERE (t1.timestamp_col_9) = (tt2.timestamp_col_18));



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Assigned] (HIVE-15902) Select query involving date throwing Hive 2 Internal error: unsupported conversion from type: date

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-15902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar reassigned HIVE-15902:
---


> Select query involving date throwing Hive 2 Internal error: unsupported 
> conversion from type: date
> --
>
> Key: HIVE-15902
> URL: https://issues.apache.org/jira/browse/HIVE-15902
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2
>Affects Versions: 2.1.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Jason Dere
>
> The following query is throwing Hive 2 Internal error: unsupported conversion 
> from type: date
> Query:
> create table table_one (ts timestamp, dt date) stored as orc;
> insert into table_one values ('2034-08-04 17:42:59','2038-07-01');
> insert into table_one values ('2031-02-07 13:02:38','2072-10-19');
> create table table_two (ts timestamp, dt date) stored as orc;
> insert into table_two values ('2069-04-01 09:05:54','1990-10-12');
> insert into table_two values ('2031-02-07 13:02:38','2072-10-19');
> create table table_three as
> select count(*) from table_one
> group by ts,dt
> having dt in (select dt from table_two);
> Error while running task ( failure ) : 
> attempt_1486991777989_0184_18_02_00_0:java.lang.RuntimeException: 
> java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: 
> Hive Runtime Error while processing row
>   at 
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:211)
>   at 
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:168)
>   at 
> org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
>   at 
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
>   at 
> org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1833)
>   at 
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
>   at 
> org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
>   at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
>   at 
> org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>   at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.RuntimeException: 
> org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while 
> processing row
>   at 
> org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:95)
>   at 
> org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:70)
>   at 
> org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:420)
>   at 
> org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:185)
>   ... 15 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime 
> Error while processing row
>   at 
> org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator.process(VectorMapOperator.java:883)
>   at 
> org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:86)
>   ... 18 more
> Caused by: java.lang.RuntimeException: Hive 2 Internal error: unsupported 
> conversion from type: date
>   at 
> org.apache.hadoop.hive.serde2.objectinspector.primitive.PrimitiveObjectInspectorUtils.getLong(PrimitiveObjectInspectorUtils.java:770)
>   at 
> org.apache.hadoop.hive.ql.exec.vector.expressions.gen.FilterLongColumnBetweenDynamicValue.evaluate(FilterLongColumnBetweenDynamicValue.java:82)
>   at 
> org.apache.hadoop.hive.ql.exec.vector.expressions.FilterExprAndExpr.evaluate(FilterExprAndExpr.java:39)
>   at 
> org.apache.hadoop.hive.ql.exec.vector.VectorFilterOperator.process(VectorFilterOperator.java:112)
>   at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:883)
>   at 
> org.apache.hadoop.hive.ql.exec.TableScanOperator.process(TableScanOperator.java:130)
>   at 
> org.apache.hadoop.hive.ql.exec.vector.VectorMapOperator.process(VectorMapOperator.java:783)
>   ... 19 more



--
This message was sent by Atlassian JIRA

[jira] [Updated] (HIVE-15900) Tez job progress included in stdout instead of stderr

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-15900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar updated HIVE-15900:

Attachment: std_out

> Tez job progress included in stdout instead of stderr
> -
>
> Key: HIVE-15900
> URL: https://issues.apache.org/jira/browse/HIVE-15900
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2
>Affects Versions: 2.1.0
>Reporter: Aswathy Chellammal Sreekumar
> Attachments: std_out
>
>
> Tez job progress messages are getting updated to stdout instead of stderr
> Attaching output file for below command, with the tez job status printed
> $HIVE_HOME/bin/beeline -n  -p  -u " --outputformat=tsv -e "analyze table studenttab10k compute statistics;" > 
> stdout



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (HIVE-15900) Tez job progress included in stdout instead of stderr

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-15900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar updated HIVE-15900:

Attachment: (was: stdout)

> Tez job progress included in stdout instead of stderr
> -
>
> Key: HIVE-15900
> URL: https://issues.apache.org/jira/browse/HIVE-15900
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2
>Affects Versions: 2.1.0
>Reporter: Aswathy Chellammal Sreekumar
>
> Tez job progress messages are getting updated to stdout instead of stderr
> Attaching output file for below command, with the tez job status printed
> $HIVE_HOME/bin/beeline -n  -p  -u " --outputformat=tsv -e "analyze table studenttab10k compute statistics;" > 
> stdout



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (HIVE-15900) Tez job progress included in stdout instead of stderr

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-15900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar updated HIVE-15900:

Description: 
Tez job progress messages are getting updated to stdout instead of stderr

Attaching output file for below command, with the tez job status printed
$HIVE_HOME/bin/beeline -n  -p  -u " stdout

  was:
Tez job progress messages are getting updated to stdout instead of stderr

Attaching output file for below command, with the tez job status printed

/usr/hdp/current/hive-server2-hive2/bin/beeline -n  -p  -u 
" stdout


> Tez job progress included in stdout instead of stderr
> -
>
> Key: HIVE-15900
> URL: https://issues.apache.org/jira/browse/HIVE-15900
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2
>Affects Versions: 2.1.0
>Reporter: Aswathy Chellammal Sreekumar
> Attachments: stdout
>
>
> Tez job progress messages are getting updated to stdout instead of stderr
> Attaching output file for below command, with the tez job status printed
> $HIVE_HOME/bin/beeline -n  -p  -u " --outputformat=tsv -e "analyze table studenttab10k compute statistics;" > 
> stdout



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (HIVE-15900) Tez job progress included in stdout instead of stderr

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-15900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar updated HIVE-15900:

Attachment: stdout

> Tez job progress included in stdout instead of stderr
> -
>
> Key: HIVE-15900
> URL: https://issues.apache.org/jira/browse/HIVE-15900
> Project: Hive
>  Issue Type: Bug
>  Components: HiveServer2
>Affects Versions: 2.1.0
>Reporter: Aswathy Chellammal Sreekumar
> Attachments: stdout
>
>
> Tez job progress messages are getting updated to stdout instead of stderr
> Attaching output file for below command, with the tez job status printed
> /usr/hdp/current/hive-server2-hive2/bin/beeline -n  -p  
> -u " bline_cli_lr (a string);
> select sleep2(18, 1000, 'hdfs:///tmp/bline_cli_lr', 'hdfs:///tmp/END') 
> from (select count(*) from bline_cli_lr) a;" > stdout



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] (HIVE-15753) subquery failing with org.apache.hadoop.hive.ql.parse.SemanticException

[Aswathy Chellammal Sreekumar (JIRA)]

Title: Message Title
 
 
 
 
 
 
 
 
 
 
  
 
 Aswathy Chellammal Sreekumar assigned an issue to Vineet Garg 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 Hive /  HIVE-15753 
 
 
 
  subquery failing with org.apache.hadoop.hive.ql.parse.SemanticException  
 
 
 
 
 
 
 
 
 
 
 
 

 
 Add Comment 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 

 This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d) 
 
 
 
 
  
 
 
 
 
 
 
 
 
   

[jira] [Commented] (HIVE-12697) Remove deprecated post option from webhcat test files

[Aswathy Chellammal Sreekumar (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062941#comment-15062941
 ] 

Aswathy Chellammal Sreekumar commented on HIVE-12697:
-

One test got missed from the patch, please find attached updated patch.

> Remove deprecated post option from webhcat test files
> -
>
> Key: HIVE-12697
> URL: https://issues.apache.org/jira/browse/HIVE-12697
> Project: Hive
>  Issue Type: Test
>  Components: WebHCat
>Affects Versions: 2.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Aswathy Chellammal Sreekumar
>  Labels: test
> Attachments: HIVE-12697.1.patch
>
>
> Tests are still having the deprecated post option user.name. Need to remove 
> them and add the same to query string
> Submitting user.name as form parameter in POST method was deprecated in Hive 
> 0.13



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-12697) Remove deprecated post option from webhcat test files

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar updated HIVE-12697:

Attachment: HIVE-12697.2.patch

> Remove deprecated post option from webhcat test files
> -
>
> Key: HIVE-12697
> URL: https://issues.apache.org/jira/browse/HIVE-12697
> Project: Hive
>  Issue Type: Test
>  Components: WebHCat
>Affects Versions: 2.0.0
>Reporter: Aswathy Chellammal Sreekumar
>Assignee: Aswathy Chellammal Sreekumar
>  Labels: test
> Attachments: HIVE-12697.1.patch, HIVE-12697.2.patch
>
>
> Tests are still having the deprecated post option user.name. Need to remove 
> them and add the same to query string
> Submitting user.name as form parameter in POST method was deprecated in Hive 
> 0.13



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-9272) Tests for utf-8 support

[Aswathy Chellammal Sreekumar (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615684#comment-14615684
 ] 

Aswathy Chellammal Sreekumar commented on HIVE-9272:


[~ekoifman] Could you please review the attached patch and see if it solves the 
issue

 Tests for utf-8 support
 ---

 Key: HIVE-9272
 URL: https://issues.apache.org/jira/browse/HIVE-9272
 Project: Hive
  Issue Type: Test
  Components: Tests, WebHCat
Affects Versions: 0.14.0
Reporter: Aswathy Chellammal Sreekumar
Assignee: Aswathy Chellammal Sreekumar
Priority: Minor
 Attachments: HIVE-9272.1.patch, HIVE-9272.2.patch, HIVE-9272.3.patch, 
 HIVE-9272.4.patch, HIVE-9272.5.patch, HIVE-9272.6.patch, HIVE-9272.7.patch, 
 HIVE-9272.8.patch, HIVE-9272.9.patch, HIVE-9272.patch


 Including some test cases for utf8 support in webhcat. The first four tests 
 invoke hive, pig, mapred and streaming apis for testing the utf8 support for 
 data processed, file names and job name. The last test case tests the 
 filtering of job name with utf8 character



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-9272) Tests for utf-8 support

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar updated HIVE-9272:
---
Attachment: HIVE-9272.9.patch

 Tests for utf-8 support
 ---

 Key: HIVE-9272
 URL: https://issues.apache.org/jira/browse/HIVE-9272
 Project: Hive
  Issue Type: Test
  Components: Tests, WebHCat
Affects Versions: 0.14.0
Reporter: Aswathy Chellammal Sreekumar
Assignee: Aswathy Chellammal Sreekumar
Priority: Minor
 Attachments: HIVE-9272.1.patch, HIVE-9272.2.patch, HIVE-9272.3.patch, 
 HIVE-9272.4.patch, HIVE-9272.5.patch, HIVE-9272.6.patch, HIVE-9272.7.patch, 
 HIVE-9272.8.patch, HIVE-9272.9.patch, HIVE-9272.patch


 Including some test cases for utf8 support in webhcat. The first four tests 
 invoke hive, pig, mapred and streaming apis for testing the utf8 support for 
 data processed, file names and job name. The last test case tests the 
 filtering of job name with utf8 character



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-10828) Insert...values for fewer number of columns fail

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar updated HIVE-10828:

Description: 
Schema on insert queries with fewer number of columns fails with below error 
message

ERROR ql.Driver (SessionState.java:printError(957)) - FAILED: 
NullPointerException null
java.lang.NullPointerException
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genReduceSinkPlan(SemanticAnalyzer.java:7277)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genBucketingSortingDest(SemanticAnalyzer.java:6120)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genFileSinkPlan(SemanticAnalyzer.java:6291)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPostGroupByBodyPlan(SemanticAnalyzer.java:8992)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genBodyPlan(SemanticAnalyzer.java:8883)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:9728)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:9621)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genOPTree(SemanticAnalyzer.java:10094)
at 
org.apache.hadoop.hive.ql.parse.CalcitePlanner.genOPTree(CalcitePlanner.java:324)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10105)
at 
org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:208)
at 
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:227)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:424)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:308)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1122)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1170)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049)
at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:311)
at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:409)
at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:425)
at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:714)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

Steps to reproduce:
set hive.support.concurrency=true;
set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
set hive.enforce.bucketing=true;
drop table if exists table1; 
create table table1 (a int, b string, c string) 
   partitioned by (bkt int) 
   clustered by (a) into 2 buckets 
   stored as orc 
   tblproperties ('transactional'='true'); 
insert into table_1 partition (bkt) (b, a, bkt) values 
('part one', 1, 1), ('part one', 2, 1), ('part two', 3, 2), ('part three', 
4, 3);


  was:
Schema on insert queries with fewer number of columns fails with below error 
message

ERROR ql.Driver (SessionState.java:printError(957)) - FAILED: 
NullPointerException null
java.lang.NullPointerException
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genReduceSinkPlan(SemanticAnalyzer.java:7277)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genBucketingSortingDest(SemanticAnalyzer.java:6120)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genFileSinkPlan(SemanticAnalyzer.java:6291)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPostGroupByBodyPlan(SemanticAnalyzer.java:8992)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genBodyPlan(SemanticAnalyzer.java:8883)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:9728)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:9621)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genOPTree(SemanticAnalyzer.java:10094)
at 
org.apache.hadoop.hive.ql.parse.CalcitePlanner.genOPTree(CalcitePlanner.java:324)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10105)
at 
org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:208)
at 
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:227)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:424)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:308)
at 

[jira] [Updated] (HIVE-10828) Insert...values for fewer number of columns fail

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar updated HIVE-10828:

Description: 
Schema on insert queries with fewer number of columns fails with below error 
message

ERROR ql.Driver (SessionState.java:printError(957)) - FAILED: 
NullPointerException null
java.lang.NullPointerException
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genReduceSinkPlan(SemanticAnalyzer.java:7277)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genBucketingSortingDest(SemanticAnalyzer.java:6120)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genFileSinkPlan(SemanticAnalyzer.java:6291)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPostGroupByBodyPlan(SemanticAnalyzer.java:8992)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genBodyPlan(SemanticAnalyzer.java:8883)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:9728)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:9621)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genOPTree(SemanticAnalyzer.java:10094)
at 
org.apache.hadoop.hive.ql.parse.CalcitePlanner.genOPTree(CalcitePlanner.java:324)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10105)
at 
org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:208)
at 
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:227)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:424)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:308)
at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:1122)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1170)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049)
at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:311)
at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:409)
at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:425)
at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:714)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

*Steps to reproduce:*

set hive.support.concurrency=true;
set hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager;
set hive.enforce.bucketing=true;
drop table if exists table1; 
create table table1 (a int, b string, c string) 
   partitioned by (bkt int) 
   clustered by (a) into 2 buckets 
   stored as orc 
   tblproperties ('transactional'='true'); 
insert into table_1 partition (bkt) (b, a, bkt) values 
('part one', 1, 1), ('part one', 2, 1), ('part two', 3, 2), ('part three', 
4, 3);


  was:
Schema on insert queries with fewer number of columns fails with below error 
message

ERROR ql.Driver (SessionState.java:printError(957)) - FAILED: 
NullPointerException null
java.lang.NullPointerException
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genReduceSinkPlan(SemanticAnalyzer.java:7277)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genBucketingSortingDest(SemanticAnalyzer.java:6120)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genFileSinkPlan(SemanticAnalyzer.java:6291)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPostGroupByBodyPlan(SemanticAnalyzer.java:8992)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genBodyPlan(SemanticAnalyzer.java:8883)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:9728)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:9621)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genOPTree(SemanticAnalyzer.java:10094)
at 
org.apache.hadoop.hive.ql.parse.CalcitePlanner.genOPTree(CalcitePlanner.java:324)
at 
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:10105)
at 
org.apache.hadoop.hive.ql.parse.CalcitePlanner.analyzeInternal(CalcitePlanner.java:208)
at 
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:227)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:424)
at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:308)
at 

[jira] [Commented] (HIVE-10423) HIVE-7948 breaks deploy_e2e_artifacts.sh

[Aswathy Chellammal Sreekumar (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-10423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524175#comment-14524175
 ] 

Aswathy Chellammal Sreekumar commented on HIVE-10423:
-

testdist is getting created only during test run, so i think we need the new 
directory for test setup.

 HIVE-7948 breaks deploy_e2e_artifacts.sh
 

 Key: HIVE-10423
 URL: https://issues.apache.org/jira/browse/HIVE-10423
 Project: Hive
  Issue Type: Bug
Affects Versions: 1.2.0
Reporter: Eugene Koifman
Assignee: Aswathy Chellammal Sreekumar
 Attachments: HIVE-10423.patch


 HIVE-7948 added a step to download a ml-1m.zip file and unzip it.
 this only works if you call deploy_e2e_artifacts.sh once.  If you call it 
 again (which is very common in dev) it blocks and ask for additional input 
 from user because target files already exist.
 This needs to be changed similarly to what we discussed for HIVE-9272, i.e. 
 place artifacts not under source control in testdist/.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-9272) Tests for utf-8 support

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar updated HIVE-9272:
---
Attachment: HIVE-9272.8.patch

 Tests for utf-8 support
 ---

 Key: HIVE-9272
 URL: https://issues.apache.org/jira/browse/HIVE-9272
 Project: Hive
  Issue Type: Test
  Components: Tests, WebHCat
Affects Versions: 0.14.0
Reporter: Aswathy Chellammal Sreekumar
Assignee: Aswathy Chellammal Sreekumar
Priority: Minor
 Attachments: HIVE-9272.1.patch, HIVE-9272.2.patch, HIVE-9272.3.patch, 
 HIVE-9272.4.patch, HIVE-9272.5.patch, HIVE-9272.6.patch, HIVE-9272.7.patch, 
 HIVE-9272.8.patch, HIVE-9272.patch


 Including some test cases for utf8 support in webhcat. The first four tests 
 invoke hive, pig, mapred and streaming apis for testing the utf8 support for 
 data processed, file names and job name. The last test case tests the 
 filtering of job name with utf8 character



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (HIVE-10423) HIVE-7948 breaks deploy_e2e_artifacts.sh

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-10423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar resolved HIVE-10423.
-
Resolution: Fixed

 HIVE-7948 breaks deploy_e2e_artifacts.sh
 

 Key: HIVE-10423
 URL: https://issues.apache.org/jira/browse/HIVE-10423
 Project: Hive
  Issue Type: Bug
Affects Versions: 1.2.0
Reporter: Eugene Koifman
Assignee: Aswathy Chellammal Sreekumar
 Attachments: HIVE-10423.patch


 HIVE-7948 added a step to download a ml-1m.zip file and unzip it.
 this only works if you call deploy_e2e_artifacts.sh once.  If you call it 
 again (which is very common in dev) it blocks and ask for additional input 
 from user because target files already exist.
 This needs to be changed similarly to what we discussed for HIVE-9272, i.e. 
 place artifacts not under source control in testdist/.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-10423) HIVE-7948 breaks deploy_e2e_artifacts.sh

[Aswathy Chellammal Sreekumar (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-10423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509857#comment-14509857
 ] 

Aswathy Chellammal Sreekumar commented on HIVE-10423:
-

No, it is not committed yet.

 HIVE-7948 breaks deploy_e2e_artifacts.sh
 

 Key: HIVE-10423
 URL: https://issues.apache.org/jira/browse/HIVE-10423
 Project: Hive
  Issue Type: Bug
Affects Versions: 1.2.0
Reporter: Eugene Koifman
Assignee: Aswathy Chellammal Sreekumar
 Attachments: HIVE-10423.patch


 HIVE-7948 added a step to download a ml-1m.zip file and unzip it.
 this only works if you call deploy_e2e_artifacts.sh once.  If you call it 
 again (which is very common in dev) it blocks and ask for additional input 
 from user because target files already exist.
 This needs to be changed similarly to what we discussed for HIVE-9272, i.e. 
 place artifacts not under source control in testdist/.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-10423) HIVE-7948 breaks deploy_e2e_artifacts.sh

[Aswathy Chellammal Sreekumar (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-10423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14509861#comment-14509861
 ] 

Aswathy Chellammal Sreekumar commented on HIVE-10423:
-

I think i marked it resolved mistakenly

 HIVE-7948 breaks deploy_e2e_artifacts.sh
 

 Key: HIVE-10423
 URL: https://issues.apache.org/jira/browse/HIVE-10423
 Project: Hive
  Issue Type: Bug
Affects Versions: 1.2.0
Reporter: Eugene Koifman
Assignee: Aswathy Chellammal Sreekumar
 Attachments: HIVE-10423.patch


 HIVE-7948 added a step to download a ml-1m.zip file and unzip it.
 this only works if you call deploy_e2e_artifacts.sh once.  If you call it 
 again (which is very common in dev) it blocks and ask for additional input 
 from user because target files already exist.
 This needs to be changed similarly to what we discussed for HIVE-9272, i.e. 
 place artifacts not under source control in testdist/.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (HIVE-10409) Webhcat tests need to be updated, to accomodate HADOOP-10193

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-10409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar resolved HIVE-10409.
-
Resolution: Invalid

Issue addressed by https://issues.apache.org/jira/browse/HADOOP-11859, no need 
to change tests

 Webhcat tests need to be updated, to accomodate HADOOP-10193
 

 Key: HIVE-10409
 URL: https://issues.apache.org/jira/browse/HIVE-10409
 Project: Hive
  Issue Type: Bug
  Components: WebHCat
Affects Versions: 1.2.0
Reporter: Aswathy Chellammal Sreekumar
Assignee: Aswathy Chellammal Sreekumar
Priority: Minor
 Fix For: 1.2.0

 Attachments: HIVE-10409.1.patch, HIVE-10409.patch


 Webhcat tests need to be updated to accommodate the url change brought in by 
 HADOOP-10193. Add ?user.name=user-name for the templeton calls.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-10423) HIVE-7948 breaks deploy_e2e_artifacts.sh

[Aswathy Chellammal Sreekumar (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-10423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14505682#comment-14505682
 ] 

Aswathy Chellammal Sreekumar commented on HIVE-10423:
-

@Eugene please review the patch that includes small fix to prevent the issue 
with rerun

 HIVE-7948 breaks deploy_e2e_artifacts.sh
 

 Key: HIVE-10423
 URL: https://issues.apache.org/jira/browse/HIVE-10423
 Project: Hive
  Issue Type: Bug
Affects Versions: 1.2.0
Reporter: Eugene Koifman
Assignee: Aswathy Chellammal Sreekumar
 Attachments: HIVE-10423.patch


 HIVE-7948 added a step to download a ml-1m.zip file and unzip it.
 this only works if you call deploy_e2e_artifacts.sh once.  If you call it 
 again (which is very common in dev) it blocks and ask for additional input 
 from user because target files already exist.
 This needs to be changed similarly to what we discussed for HIVE-9272, i.e. 
 place artifacts not under source control in testdist/.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-10409) Webhcat tests need to be updated, to accomodate HADOOP-10193

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-10409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar updated HIVE-10409:

Attachment: HIVE-10409.patch

 Webhcat tests need to be updated, to accomodate HADOOP-10193
 

 Key: HIVE-10409
 URL: https://issues.apache.org/jira/browse/HIVE-10409
 Project: Hive
  Issue Type: Bug
  Components: WebHCat
Affects Versions: 1.2.0
Reporter: Aswathy Chellammal Sreekumar
Assignee: Aswathy Chellammal Sreekumar
Priority: Minor
 Fix For: 1.2.0

 Attachments: HIVE-10409.patch


 Webhcat tests need to be updated to accommodate the url change brought in by 
 HADOOP-10193. Add ?user.name=user-name for the templeton calls.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-10409) Webhcat tests need to be updated, to accomodate HADOOP-10193

[Aswathy Chellammal Sreekumar (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-10409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503843#comment-14503843
 ] 

Aswathy Chellammal Sreekumar commented on HIVE-10409:
-

Please review the test case changes to update the templeton url, with user.name 
appended. Attached the patch.

 Webhcat tests need to be updated, to accomodate HADOOP-10193
 

 Key: HIVE-10409
 URL: https://issues.apache.org/jira/browse/HIVE-10409
 Project: Hive
  Issue Type: Bug
  Components: WebHCat
Affects Versions: 1.2.0
Reporter: Aswathy Chellammal Sreekumar
Assignee: Aswathy Chellammal Sreekumar
Priority: Minor
 Fix For: 1.2.0

 Attachments: HIVE-10409.patch


 Webhcat tests need to be updated to accommodate the url change brought in by 
 HADOOP-10193. Add ?user.name=user-name for the templeton calls.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-9272) Tests for utf-8 support

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar updated HIVE-9272:
---
Attachment: HIVE-9272.7.patch

 Tests for utf-8 support
 ---

 Key: HIVE-9272
 URL: https://issues.apache.org/jira/browse/HIVE-9272
 Project: Hive
  Issue Type: Test
  Components: Tests, WebHCat
Affects Versions: 0.14.0
Reporter: Aswathy Chellammal Sreekumar
Assignee: Aswathy Chellammal Sreekumar
Priority: Minor
 Fix For: 1.2.0

 Attachments: HIVE-9272.1.patch, HIVE-9272.2.patch, HIVE-9272.3.patch, 
 HIVE-9272.4.patch, HIVE-9272.5.patch, HIVE-9272.6.patch, HIVE-9272.7.patch, 
 HIVE-9272.patch


 Including some test cases for utf8 support in webhcat. The first four tests 
 invoke hive, pig, mapred and streaming apis for testing the utf8 support for 
 data processed, file names and job name. The last test case tests the 
 filtering of job name with utf8 character



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-9272) Tests for utf-8 support

[Aswathy Chellammal Sreekumar (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504161#comment-14504161
 ] 

Aswathy Chellammal Sreekumar commented on HIVE-9272:


[~ekoifman] Please find attached the patch with the above suggestions included.

 Tests for utf-8 support
 ---

 Key: HIVE-9272
 URL: https://issues.apache.org/jira/browse/HIVE-9272
 Project: Hive
  Issue Type: Test
  Components: Tests, WebHCat
Affects Versions: 0.14.0
Reporter: Aswathy Chellammal Sreekumar
Assignee: Aswathy Chellammal Sreekumar
Priority: Minor
 Fix For: 1.2.0

 Attachments: HIVE-9272.1.patch, HIVE-9272.2.patch, HIVE-9272.3.patch, 
 HIVE-9272.4.patch, HIVE-9272.5.patch, HIVE-9272.6.patch, HIVE-9272.patch


 Including some test cases for utf8 support in webhcat. The first four tests 
 invoke hive, pig, mapred and streaming apis for testing the utf8 support for 
 data processed, file names and job name. The last test case tests the 
 filtering of job name with utf8 character



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HIVE-9272) Tests for utf-8 support

[Aswathy Chellammal Sreekumar (JIRA)]

[ 
https://issues.apache.org/jira/browse/HIVE-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14384674#comment-14384674
 ] 

Aswathy Chellammal Sreekumar commented on HIVE-9272:


[~ekoifman] Please find attached the patch with renaming of input files 
automated (in deploy_e2e_artifacts.sh). I was a little hesitant to add this 
initially as this looked like the only local file operation, but certainly will 
come in handy for anyone running the the test suite.

 Tests for utf-8 support
 ---

 Key: HIVE-9272
 URL: https://issues.apache.org/jira/browse/HIVE-9272
 Project: Hive
  Issue Type: Test
  Components: Tests, WebHCat
Affects Versions: 0.14.0
Reporter: Aswathy Chellammal Sreekumar
Assignee: Aswathy Chellammal Sreekumar
Priority: Minor
 Fix For: 1.2.0

 Attachments: HIVE-9272.1.patch, HIVE-9272.2.patch, HIVE-9272.3.patch, 
 HIVE-9272.4.patch, HIVE-9272.5.patch, HIVE-9272.6.patch, HIVE-9272.patch


 Including some test cases for utf8 support in webhcat. The first four tests 
 invoke hive, pig, mapred and streaming apis for testing the utf8 support for 
 data processed, file names and job name. The last test case tests the 
 filtering of job name with utf8 character



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HIVE-9272) Tests for utf-8 support

[Aswathy Chellammal Sreekumar (JIRA)]

 [ 
https://issues.apache.org/jira/browse/HIVE-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aswathy Chellammal Sreekumar updated HIVE-9272:
---
Attachment: HIVE-9272.6.patch

 Tests for utf-8 support
 ---

 Key: HIVE-9272
 URL: https://issues.apache.org/jira/browse/HIVE-9272
 Project: Hive
  Issue Type: Test
  Components: Tests, WebHCat
Affects Versions: 0.14.0
Reporter: Aswathy Chellammal Sreekumar
Assignee: Aswathy Chellammal Sreekumar
Priority: Minor
 Fix For: 1.2.0

 Attachments: HIVE-9272.1.patch, HIVE-9272.2.patch, HIVE-9272.3.patch, 
 HIVE-9272.4.patch, HIVE-9272.5.patch, HIVE-9272.6.patch, HIVE-9272.patch


 Including some test cases for utf8 support in webhcat. The first four tests 
 invoke hive, pig, mapred and streaming apis for testing the utf8 support for 
 data processed, file names and job name. The last test case tests the 
 filtering of job name with utf8 character



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)