[jira] [Updated] (HIVE-14528) After enabling Hive Parquet Vectorization, many queries in TPCx-BB(BigBench) failed with NullPointerException and IllegalArgumentException

[ https://issues.apache.org/jira/browse/HIVE-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-14528: - Description: We use TPCx-BB(BigBench) to evaluate the performance of Hive Parquet Vectorization in our local

[jira] [Commented] (HIVE-15671) RPCServer.registerClient() erroneously uses server/client handshake timeout for connection timeout

[ https://issues.apache.org/jira/browse/HIVE-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15857738#comment-15857738 ] KaiXu commented on HIVE-15671: -- I may encounter this situation you mentioned. I run a query, Hive on Spark,

[jira] [Commented] (HIVE-15671) RPCServer.registerClient() erroneously uses server/client handshake timeout for connection timeout

[ https://issues.apache.org/jira/browse/HIVE-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15857739#comment-15857739 ] KaiXu commented on HIVE-15671: -- I am also very confused about these timeouts. > RPCServer.registerClient()

[jira] [Commented] (HIVE-15671) RPCServer.registerClient() erroneously uses server/client handshake timeout for connection timeout

[ https://issues.apache.org/jira/browse/HIVE-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15857975#comment-15857975 ] KaiXu commented on HIVE-15671: -- this error occurs when several queries run at the same time with large data

[jira] [Commented] (HIVE-15859) Hive client side shows Spark Driver disconnected while Spark Driver side could not get RPC header

[ https://issues.apache.org/jira/browse/HIVE-15859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877560#comment-15877560 ] KaiXu commented on HIVE-15859: -- Thanks all for the efforts, I will try the patch. > Hive client side shows

[jira] [Commented] (HIVE-15887) could not get APP ID and cause failed to connect to spark driver on yarn-client mode

[ https://issues.apache.org/jira/browse/HIVE-15887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15864877#comment-15864877 ] KaiXu commented on HIVE-15887: -- >From nodemanager log, can only see container transitioned from LOCALIZED to

[jira] [Commented] (HIVE-15887) could not get APP ID and cause failed to connect to spark driver on yarn-client mode

[ https://issues.apache.org/jira/browse/HIVE-15887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15864894#comment-15864894 ] KaiXu commented on HIVE-15887: -- this issue occurred again yesterday, to be notable, this issue occurred when

[jira] [Commented] (HIVE-15887) could not get APP ID and cause failed to connect to spark driver on yarn-client mode

[ https://issues.apache.org/jira/browse/HIVE-15887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15864837#comment-15864837 ] KaiXu commented on HIVE-15887: -- Hi [~lirui], above container log is the yarn application log, the middle has

[jira] [Updated] (HIVE-15912) Failed to get spark memory/core info

[ https://issues.apache.org/jira/browse/HIVE-15912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-15912: - Description: Hive on Spark, failed with error: Starting Spark Job = 12a8cb8c-ed0d-4049-ae06-8d32d13fe285 Failed

[jira] [Updated] (HIVE-15912) Executor kill task and Failed to get spark memory/core info

[ https://issues.apache.org/jira/browse/HIVE-15912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-15912: - Summary: Executor kill task and Failed to get spark memory/core info (was: Failed to get spark memory/core info)

[jira] [Commented] (HIVE-15887) could not get APP ID and cause failed to connect to spark driver on yarn-client mode

[ https://issues.apache.org/jira/browse/HIVE-15887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865627#comment-15865627 ] KaiXu commented on HIVE-15887: -- it seems like that, Hive side timeout after hive.spark.job.monitor.timeout,

[jira] [Commented] (HIVE-15859) Hive client side shows Spark Driver disconnected while Spark Driver side could not get RPC header

[ https://issues.apache.org/jira/browse/HIVE-15859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15865696#comment-15865696 ] KaiXu commented on HIVE-15859: -- Thanks [~lirui] for your work, I found a similar issue and log on

[jira] [Updated] (HIVE-15859) Hive client side shows Spark Driver disconnected while Spark Driver side could not get RPC header

[ https://issues.apache.org/jira/browse/HIVE-15859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-15859: - Description: Hive on Spark, failed with error: 2017-02-08 09:50:59,331 Stage-2_0: 1039(+2)/1041 Stage-3_0:

[jira] [Commented] (HIVE-15912) Executor kill task and Failed to get spark memory/core info

[ https://issues.apache.org/jira/browse/HIVE-15912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15867538#comment-15867538 ] KaiXu commented on HIVE-15912: -- It's running in yarn-client mode, actually I did not see why the driver

[jira] [Commented] (HIVE-15671) RPCServer.registerClient() erroneously uses server/client handshake timeout for connection timeout

[ https://issues.apache.org/jira/browse/HIVE-15671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861241#comment-15861241 ] KaiXu commented on HIVE-15671: -- I created HIVE-15859 for the issue, comments or suggestions are welcomed.

[jira] [Updated] (HIVE-15887) could not get APP ID and cause failed to connect to spark driver on yarn-client mode

[ https://issues.apache.org/jira/browse/HIVE-15887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-15887: - External issue URL: (was: https://issues.apache.org/jira/browse/SPARK-19569) > could not get APP ID and cause

[jira] [Updated] (HIVE-15887) could not get APP ID and cause failed to connect to spark driver on yarn-client mode

[ https://issues.apache.org/jira/browse/HIVE-15887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-15887: - External issue ID: (was: SPARK-19569) > could not get APP ID and cause failed to connect to spark driver on >

[jira] [Commented] (HIVE-15887) could not get APP ID and cause failed to connect to spark driver on yarn-client mode

[ https://issues.apache.org/jira/browse/HIVE-15887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15863605#comment-15863605 ] KaiXu commented on HIVE-15887: -- Thanks Rui Li for the information, the JIRA was first loged on Spark by

[jira] [Updated] (HIVE-15859) Hive client side shows Spark Driver disconnected while Spark Driver side could not get RPC header

[ https://issues.apache.org/jira/browse/HIVE-15859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-15859: - Affects Version/s: (was: 2.1.1) 2.2.0 > Hive client side shows Spark Driver

[jira] [Updated] (HIVE-15887) could not get APP ID and cause failed to connect to spark driver on yarn-client mode

[ https://issues.apache.org/jira/browse/HIVE-15887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-15887: - Description: when I run Hive queries on Spark, got below error in the console, after check the container's log,

[jira] [Commented] (HIVE-13830) Hive on spark driver crash with Spark 1.6.1

[ https://issues.apache.org/jira/browse/HIVE-13830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825512#comment-15825512 ] KaiXu commented on HIVE-13830: -- how do you build your spark? did you add the -Phive profile? > Hive on spark

[jira] [Commented] (HIVE-9370) SparkJobMonitor timeout as sortByKey would launch extra Spark job before original job get submitted [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825533#comment-15825533 ] KaiXu commented on HIVE-9370: - Hi Xuefu Zhang, what does the 'asking user to log out and log in again would be

[jira] [Updated] (HIVE-16042) special characters in the comment of sql file cause ParseException

[ https://issues.apache.org/jira/browse/HIVE-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-16042: - Description: current Hive upstream(commit: 2768361) failed to parse some queries(q04,q17,q18,q23) in TPCx-BB

[jira] [Commented] (HIVE-16042) special characters in the comment of sql file cause ParseException

[ https://issues.apache.org/jira/browse/HIVE-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885700#comment-15885700 ] KaiXu commented on HIVE-16042: -- found that the root cause is the special characters in the comment of sql

[jira] [Updated] (HIVE-16042) special characters in the comment of sql file cause ParseException

[ https://issues.apache.org/jira/browse/HIVE-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-16042: - Summary: special characters in the comment of sql file cause ParseException (was: some sql file with comment

[jira] [Updated] (HIVE-16042) special characters in the comment of sql file cause ParseException

[ https://issues.apache.org/jira/browse/HIVE-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-16042: - Description: current Hive upstream(commit: 2768361) failed to parse some queries(q04,q17,q18,q23) in TPCx-BB

[jira] [Commented] (HIVE-16042) some sql file with comment encounter ParseException

[ https://issues.apache.org/jira/browse/HIVE-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885190#comment-15885190 ] KaiXu commented on HIVE-16042: -- Hi [~pxiong], can you point out where is the problem? if this's the cause,

[jira] [Commented] (HIVE-15859) Hive client side shows Spark Driver disconnected while Spark Driver side could not get RPC header

[ https://issues.apache.org/jira/browse/HIVE-15859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885007#comment-15885007 ] KaiXu commented on HIVE-15859: -- Hi [~xuefuz] and [~lirui], I have tried to run 3 times with the patch,

[jira] [Updated] (HIVE-16042) some sql file with comment encounter ParseException

[ https://issues.apache.org/jira/browse/HIVE-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-16042: - Attachment: q23.sql q18.sql q17.sql q04.sql the 4 sql files in

[jira] [Updated] (HIVE-14567) After enabling Hive Parquet Vectorization, POWER_TEST of query24 in TPCx-BB(BigBench) failed with 1TB scale factor, but successful with 3TB scale factor

[ https://issues.apache.org/jira/browse/HIVE-14567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-14567: - Description: We use TPCx-BB(BigBench) to evaluate the performance of Hive Parquet Vectorization in our local

[jira] [Updated] (HIVE-14528) After enabling Hive Parquet Vectorization, many queries in TPCx-BB(BigBench) failed with NullPointerException and IllegalArgumentException

[ https://issues.apache.org/jira/browse/HIVE-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-14528: - Affects Version/s: (was: 2.1.0) 2.2.0 > After enabling Hive Parquet Vectorization,

[jira] [Resolved] (HIVE-14528) After enabling Hive Parquet Vectorization, many queries in TPCx-BB(BigBench) failed with NullPointerException and IllegalArgumentException

[ https://issues.apache.org/jira/browse/HIVE-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu resolved HIVE-14528. -- Resolution: Later > After enabling Hive Parquet Vectorization, many queries in TPCx-BB(BigBench) > failed

[jira] [Updated] (HIVE-14528) After enabling Hive Parquet Vectorization, many queries in TPCx-BB(BigBench) failed with NullPointerException and IllegalArgumentException

[ https://issues.apache.org/jira/browse/HIVE-14528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-14528: - Environment: Apache Hadoop2.6.0 Apache Hive2.2.0 JDK1.8.0_73 TPCx-BB 1.0.1 was: Apache Hadoop2.6.0 Apache

[jira] [Updated] (HIVE-14567) After enabling Hive Parquet Vectorization, POWER_TEST of query24 in TPCx-BB(BigBench) failed with 1TB scale factor, but successful with 3TB scale factor

[ https://issues.apache.org/jira/browse/HIVE-14567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-14567: - Environment: Apache Hadoop2.6.0 Apache Hive2.2.0 JDK1.8.0_73 TPCx-BB 1.0.1 was: Apache Hadoop2.6.0 Apache

[jira] [Resolved] (HIVE-14567) After enabling Hive Parquet Vectorization, POWER_TEST of query24 in TPCx-BB(BigBench) failed with 1TB scale factor, but successful with 3TB scale factor

[ https://issues.apache.org/jira/browse/HIVE-14567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu resolved HIVE-14567. -- Resolution: Later > After enabling Hive Parquet Vectorization, POWER_TEST of query24 in > TPCx-BB(BigBench)

[jira] [Updated] (HIVE-14567) After enabling Hive Parquet Vectorization, POWER_TEST of query24 in TPCx-BB(BigBench) failed with 1TB scale factor, but successful with 3TB scale factor

[ https://issues.apache.org/jira/browse/HIVE-14567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-14567: - Affects Version/s: (was: 2.1.0) 2.2.0 > After enabling Hive Parquet Vectorization,

[jira] [Commented] (HIVE-13830) Hive on spark driver crash with Spark 1.6.1

[ https://issues.apache.org/jira/browse/HIVE-13830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601515#comment-15601515 ] KaiXu commented on HIVE-13830: -- I used spark1.6.2 release version, spark1.6.4 and Hive 1.2.1, it has the same

[jira] [Commented] (HIVE-15912) Executor kill task and Failed to get spark memory/core info

[ https://issues.apache.org/jira/browse/HIVE-15912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933961#comment-15933961 ] KaiXu commented on HIVE-15912: -- Hi [~lirui], I am using Hive2.2 on spark2.0.2, the issue also exists.

[jira] [Comment Edited] (HIVE-14171) Parquet: Simple vectorization throws NPEs

[ https://issues.apache.org/jira/browse/HIVE-14171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16356325#comment-16356325 ] KaiXu edited comment on HIVE-14171 at 2/8/18 1:16 AM: -- Found similar issue with 

[jira] [Commented] (HIVE-14171) Parquet: Simple vectorization throws NPEs

[ https://issues.apache.org/jira/browse/HIVE-14171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16356325#comment-16356325 ] KaiXu commented on HIVE-14171: -- Found similar issue with hive.vectorized.use.row.serde.deserialize=true on

[jira] [Comment Edited] (HIVE-14171) Parquet: Simple vectorization throws NPEs

[ https://issues.apache.org/jira/browse/HIVE-14171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16356325#comment-16356325 ] KaiXu edited comment on HIVE-14171 at 2/8/18 1:17 AM: -- Found similar issue with 

[jira] [Commented] (HIVE-14171) Parquet: Simple vectorization throws NPEs

[ https://issues.apache.org/jira/browse/HIVE-14171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16356734#comment-16356734 ] KaiXu commented on HIVE-14171: -- Thanks [~colinma] for the information. To [~vihangk1], several queries(e.g.

[jira] [Commented] (HIVE-14171) Parquet: Simple vectorization throws NPEs

[ https://issues.apache.org/jira/browse/HIVE-14171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16357911#comment-16357911 ] KaiXu commented on HIVE-14171: -- Thanks, [~colinma] > Parquet: Simple vectorization throws NPEs >

[jira] [Commented] (HIVE-18553) VectorizedParquetReader fails after adding a new column to table

[ https://issues.apache.org/jira/browse/HIVE-18553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360323#comment-16360323 ] KaiXu commented on HIVE-18553: -- Thanks for your email. I am taking annual leave, email responses can be

[jira] [Commented] (HIVE-18553) Support schema evolution in Parquet Vectorization reader

[ https://issues.apache.org/jira/browse/HIVE-18553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366489#comment-16366489 ] KaiXu commented on HIVE-18553: -- Thanks for your email. I am taking annual leave, email responses can be

[jira] [Updated] (HIVE-19022) Hive Beeline can not read user define environment variables

[ https://issues.apache.org/jira/browse/HIVE-19022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-19022: - Environment: (was: we found that user can not get exported environment variables in Hive beeline. how to

[jira] [Updated] (HIVE-19022) Hive Beeline can not read user define environment variables

[ https://issues.apache.org/jira/browse/HIVE-19022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-19022: - Description: we found that user can not get exported environment variables in Hive beeline. how to reproduce: 1.

[jira] [Updated] (HIVE-19022) Hive Beeline can not read user define environment variables

[ https://issues.apache.org/jira/browse/HIVE-19022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXu updated HIVE-19022: - Description: we found that user can not get exported environment variables in Hive beeline. how to reproduce: 1.

[jira] [Commented] (HIVE-17684) HoS memory issues with MapJoinMemoryExhaustionHandler

[ https://issues.apache.org/jira/browse/HIVE-17684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627012#comment-16627012 ] KaiXu commented on HIVE-17684: -- Hi [~stakiar] and [~mi...@cloudera.com], I recently encountered a similar