[jira] [Updated] (HIVE-13602) TPCH q16 return wrong result when CBO is on

2016-04-25 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-13602: - Description: Running tpch with factor 2, q16 returns 1,160 rows when CBO is on, while returns 24,581

[jira] [Commented] (HIVE-13602) TPCH q16 return wrong result when CBO is on

2016-04-25 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15256275#comment-15256275 ] Nemon Lou commented on HIVE-13602: -- The result is right when using hive 1.2.1. After some digging

[jira] [Commented] (HIVE-13602) TPCH q16 return wrong result when CBO is on

2016-04-25 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255976#comment-15255976 ] Nemon Lou commented on HIVE-13602: -- I just copy it from the result of "explain rewrite q16". {noformat}

[jira] [Commented] (HIVE-13602) TPCH q16 return wrong result when CBO is on

2016-04-25 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255964#comment-15255964 ] Nemon Lou commented on HIVE-13602: -- >From calcite rel plan ,we can see the p_brand column is declared to

[jira] [Commented] (HIVE-13602) TPCH q16 return wrong result when CBO is on

2016-04-25 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255937#comment-15255937 ] Nemon Lou commented on HIVE-13602: -- The join order seems to be the same for both queries.The difference

[jira] [Updated] (HIVE-13602) TPCH q16 return wrong result when CBO is on

2016-04-25 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-13602: - Attachment: explain_cbo_good(rewrite)_part3.out explain_cbo_good(rewrite)_part2.out

[jira] [Updated] (HIVE-13602) TPCH q16 return wrong result when CBO is on

2016-04-24 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-13602: - Attachment: explain_cbo_bad_part3.out explain_cbo_bad_part2.out

[jira] [Commented] (HIVE-13602) TPCH q16 return wrong result when CBO is on

2016-04-24 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255897#comment-15255897 ] Nemon Lou commented on HIVE-13602: -- I used MR engine. The attachment is bigger than 50K ,and has been

[jira] [Commented] (HIVE-13546) Patch for HIVE-12893 is broken in branch-1

2016-04-19 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247342#comment-15247342 ] Nemon Lou commented on HIVE-13546: -- After reverting HIVE-12893 or applying the patch above ,this issue

[jira] [Commented] (HIVE-13546) Patch for HIVE-12893 is broken in branch-1

2016-04-19 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247335#comment-15247335 ] Nemon Lou commented on HIVE-13546: -- [~prasanth_j] would you take a look ? Seems that the patch for

[jira] [Updated] (HIVE-13546) Patch for HIVE-12893 is broken in branch-1

2016-04-19 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-13546: - Attachment: HIVE-13546.patch > Patch for HIVE-12893 is broken in branch-1 >

[jira] [Commented] (HIVE-13141) Hive on Spark over HBase should accept parameters starting with "zookeeper.znode"

2016-03-20 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203646#comment-15203646 ] Nemon Lou commented on HIVE-13141: -- Thanks for review.We installed multiple HBase clusters on one Hadoop

[jira] [Commented] (HIVE-13314) Hive on spark mapjoin errors if spark.master is not set

2016-03-20 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203645#comment-15203645 ] Nemon Lou commented on HIVE-13314: -- Similar to HIVE-12616 ? > Hive on spark mapjoin errors if

[jira] [Updated] (HIVE-13141) Hive on Spark over HBase should accept parameters starting with "zookeeper.znode"

2016-02-24 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-13141: - Component/s: Spark > Hive on Spark over HBase should accept parameters starting with > "zookeeper.znode"

[jira] [Updated] (HIVE-13141) Hive on Spark over HBase should accept parameters starting with "zookeeper.znode"

2016-02-23 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-13141: - Attachment: HIVE-13141.patch > Hive on Spark over HBase should accept parameters starting with >

[jira] [Updated] (HIVE-13141) Hive on Spark over HBase should accept parameters starting with "zookeeper.znode"

2016-02-23 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-13141: - Status: Patch Available (was: Open) > Hive on Spark over HBase should accept parameters starting with >

[jira] [Commented] (HIVE-12847) ORC file footer cache should be memory sensitive

2016-01-16 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103066#comment-15103066 ] Nemon Lou commented on HIVE-12847: -- The serialized size of ProtoBuf object is much smaller than the size

[jira] [Updated] (HIVE-12847) ORC file footer cache should be memory sensitive

2016-01-16 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12847: - Description: The size based footer cache can not control memory usage properly. Having seen a HiveServer2

[jira] [Assigned] (HIVE-12847) ORC file footer cache should be memory sensitive

2016-01-13 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou reassigned HIVE-12847: Assignee: Nemon Lou > ORC file footer cache should be memory sensitive >

[jira] [Updated] (HIVE-12847) ORC file footer cache should be memory sensitive

2016-01-13 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12847: - Attachment: HIVE-12847.patch This patch limits the cache memory usage to 50% of max heap size. Having not

[jira] [Commented] (HIVE-12748) shuffle the metastore uris, so the request can be balanced to metastores

2015-12-25 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071797#comment-15071797 ] Nemon Lou commented on HIVE-12748: -- Duplicate of HIVE-10815 ? > shuffle the metastore uris, so the

[jira] [Commented] (HIVE-12716) Hive on Spark map-join throw NullPointerException

2015-12-21 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066211#comment-15066211 ] Nemon Lou commented on HIVE-12716: -- This issue only related to mapjoin hint. You can solve this by

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-15 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059568#comment-15059568 ] Nemon Lou commented on HIVE-12538: -- [~xuefuz] Thanks for review. I have created HIVE-12689 to keep track

[jira] [Updated] (HIVE-12616) NullPointerException when spark session is reused to run a mapjoin

2015-12-13 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12616: - Attachment: HIVE-12616.1.patch > NullPointerException when spark session is reused to run a mapjoin >

[jira] [Updated] (HIVE-12616) NullPointerException when spark session is reused to run a mapjoin

2015-12-13 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12616: - Attachment: HIVE-12616.2.patch Fixing failed test cases in TestSparkSessionManagerImpl. Failure in

[jira] [Commented] (HIVE-12615) Do not start spark session when only explain

2015-12-11 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052779#comment-15052779 ] Nemon Lou commented on HIVE-12615: -- I didn't expect so many test case are affected. Sorry for haven't run

[jira] [Commented] (HIVE-12616) NullPointerException when spark session is reused to run a mapjoin

2015-12-10 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050888#comment-15050888 ] Nemon Lou commented on HIVE-12616: -- [~xuefuz], thanks for review . It is not surprising that you doubt

[jira] [Updated] (HIVE-12616) NullPointerException when spark session is reused to run a mapjoin

2015-12-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12616: - Attachment: HIVE-12616.patch Explicitly setting spark.master before submit to spark . >

[jira] [Assigned] (HIVE-12615) Do not start spark session when only explain

2015-12-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou reassigned HIVE-12615: Assignee: Nemon Lou > Do not start spark session when only explain >

[jira] [Commented] (HIVE-12615) Do not start spark session when only explain

2015-12-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048371#comment-15048371 ] Nemon Lou commented on HIVE-12615: -- [~xuefuz] Thanks for your attention .It's a good idea to show the

[jira] [Updated] (HIVE-12615) Do not start spark session when only explain

2015-12-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12615: - Attachment: HIVE-12615.patch > Do not start spark session when only explain >

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049828#comment-15049828 ] Nemon Lou commented on HIVE-12538: -- Shall I provide a patch only fix issues mentioned here and keep track

[jira] [Updated] (HIVE-12615) Do not start spark session when only explain

2015-12-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12615: - Priority: Minor (was: Major) > Do not start spark session when only explain >

[jira] [Updated] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12538: - Attachment: HIVE-12538.5.patch Uploading a patch addressing the following issues : 1, Property

[jira] [Updated] (HIVE-12615) Do not start spark session when only explain

2015-12-08 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12615: - Component/s: Spark > Do not start spark session when only explain >

[jira] [Commented] (HIVE-12616) NullPointerException when spark session is reused to run a mapjoin

2015-12-08 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046645#comment-15046645 ] Nemon Lou commented on HIVE-12616: -- The following exception is found from excutors' log {noformat}

[jira] [Commented] (HIVE-12616) NullPointerException when spark session is reused to run a mapjoin

2015-12-08 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046799#comment-15046799 ] Nemon Lou commented on HIVE-12616: -- Another finding.Setting spark.master explicitly can also fix this.

[jira] [Commented] (HIVE-12616) NullPointerException when spark session is reused to run a mapjoin

2015-12-08 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046791#comment-15046791 ] Nemon Lou commented on HIVE-12616: -- Method SparkUtilities#isDedicatedCluster {code} public static

[jira] [Commented] (HIVE-12614) RESET command does not close spark session

2015-12-08 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047901#comment-15047901 ] Nemon Lou commented on HIVE-12614: -- For a given hive connection with spark session already started ,the

[jira] [Assigned] (HIVE-12616) NullPointerException when spark session is reused to run a mapjoin

2015-12-08 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou reassigned HIVE-12616: Assignee: Nemon Lou (was: Xuefu Zhang) > NullPointerException when spark session is reused to run

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-08 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047910#comment-15047910 ] Nemon Lou commented on HIVE-12538: -- HIVE-9223 seems that Hive on Tez has the same problem. > After set

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-04 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041360#comment-15041360 ] Nemon Lou commented on HIVE-12538: -- [~jxiang] Please feel free to take it over if you plan to support

[jira] [Updated] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-02 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12538: - Attachment: HIVE-12538.4.patch Changing to session level spark session lock. Changing back to HashMap.

[jira] [Commented] (HIVE-12569) Excessive console message from SparkClientImpl [Spark Branch]

2015-12-02 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037025#comment-15037025 ] Nemon Lou commented on HIVE-12569: -- I noticed this log, too. And here is my finds: The log messages come

[jira] [Updated] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-01 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12538: - Attachment: HIVE-12538.3.patch Using ConcurrentHashMap instead of HashMap. > After set spark related

[jira] [Updated] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-01 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12538: - Attachment: HIVE-12538.2.patch Addressing issues mentioned in comments. > After set spark related

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-01 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033606#comment-15033606 ] Nemon Lou commented on HIVE-12538: -- Uploading a new patch that only set session level's

[jira] [Updated] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-01 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12538: - Attachment: HIVE-12538.1.patch > After set spark related config, SparkSession never get reused >

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-11-30 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032988#comment-15032988 ] Nemon Lou commented on HIVE-12538: -- [~jxiang] ,thanks for review. {quote} That means we reset the flag

[jira] [Assigned] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-11-29 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou reassigned HIVE-12538: Assignee: Nemon Lou > After set spark related config, SparkSession never get reused >

[jira] [Updated] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-11-29 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12538: - Attachment: HIVE-12538.patch 1,Fixing the bug : " isSparkConfigUpdated = isSparkRelatedConfig(name)"

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-11-28 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030446#comment-15030446 ] Nemon Lou commented on HIVE-12538: -- A way to reproduce: 1, open beeline 2, run the following SQL:

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-11-28 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030451#comment-15030451 ] Nemon Lou commented on HIVE-12538: -- Actually,there are two bugs: 1, Property isSparkConfigUpdated of

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-11-27 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030405#comment-15030405 ] Nemon Lou commented on HIVE-12538: -- After debugging ,i find the problem is that ,the operation conf

[jira] [Updated] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-11-27 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12538: - Description: Hive on Spark yarn-cluster mode. After setting "set spark.yarn.queue=QueueA;" , run the

[jira] [Updated] (HIVE-12382) return actual row count for JDBC executeUpdate

2015-11-24 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12382: - Attachment: HIVE-12382.patch > return actual row count for JDBC executeUpdate >

[jira] [Commented] (HIVE-12382) return actual row count for JDBC executeUpdate

2015-11-24 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15024468#comment-15024468 ] Nemon Lou commented on HIVE-12382: -- Design proposal: 1,Adding a new counters "RECORD_OUT" in

[jira] [Updated] (HIVE-12496) Open ServerTransport After MetaStore Initialization

2015-11-23 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12496: - Attachment: (was: HIVE-12496.patch) > Open ServerTransport After MetaStore Initialization >

[jira] [Updated] (HIVE-12496) Open ServerTransport After MetaStore Initialization

2015-11-23 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12496: - Attachment: HIVE-12496.patch > Open ServerTransport After MetaStore Initialization >

[jira] [Updated] (HIVE-12496) Open ServerTransport After MetaStore Initialization

2015-11-23 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12496: - Attachment: HIVE-12496.patch > Open ServerTransport After MetaStore Initialization >

[jira] [Commented] (HIVE-12432) Hive on Spark Counter "RECORDS_OUT" always be zero

2015-11-23 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023519#comment-15023519 ] Nemon Lou commented on HIVE-12432: -- HIVE-12466 is the same issue.I don't have a clear solution yet.So let

[jira] [Commented] (HIVE-12466) SparkCounter not initialized error

2015-11-23 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023547#comment-15023547 ] Nemon Lou commented on HIVE-12466: -- Hive support multiple insert {noformat} from (select * from dec

[jira] [Resolved] (HIVE-12432) Hive on Spark Counter "RECORDS_OUT" always be zero

2015-11-23 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou resolved HIVE-12432. -- Resolution: Duplicate Assignee: (was: Nemon Lou) Target Version/s: (was:

[jira] [Commented] (HIVE-12382) return actual row count for JDBC executeUpdate

2015-11-20 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15016713#comment-15016713 ] Nemon Lou commented on HIVE-12382: -- Hive counters for "RECORDS_OUT" is wrong in some situation as i

[jira] [Updated] (HIVE-12464) Inconsistent behavior between MapReduce and Spark engine on bucket mapjoin

2015-11-19 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12464: - Summary: Inconsistent behavior between MapReduce and Spark engine on bucket mapjoin (was: Inconsistent

[jira] [Updated] (HIVE-12464) Inconsistent behavior between MapReduce and Spark engine on bucketed mapjoin

2015-11-19 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12464: - Description: Steps to reproduce: 1,prepare the table and data {noformat} create table if not exists

[jira] [Updated] (HIVE-12464) Inconsistent behavior between MapReduce and Spark engine on bucket mapjoin

2015-11-19 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12464: - Description: Steps to reproduce: 1,prepare the table and data {noformat} create table if not exists

[jira] [Commented] (HIVE-12464) Inconsistent behavior between MapReduce and Spark engine on bucket mapjoin

2015-11-19 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15013299#comment-15013299 ] Nemon Lou commented on HIVE-12464: -- HIVE-10866 shows that inserting into a non-empty bucket table is not

[jira] [Updated] (HIVE-12432) Hive on Spark Counter "RECORDS_OUT" always be zero

2015-11-17 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12432: - Description: A simple way to reproduce : set hive.execution.engine=spark; CREATE TABLE test(id INT);

[jira] [Commented] (HIVE-12432) Hive on Spark Counter "RECORDS_OUT" always be zero

2015-11-17 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008386#comment-15008386 ] Nemon Lou commented on HIVE-12432: -- Spark log shows that the counters for output has been ignored :

[jira] [Updated] (HIVE-12371) Adding a timeout connection parameter for JDBC

2015-11-10 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12371: - Assignee: (was: Vaibhav Gumashta) > Adding a timeout connection parameter for JDBC >

[jira] [Commented] (HIVE-12382) return actual row count for JDBC executeUpdate

2015-11-10 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14999784#comment-14999784 ] Nemon Lou commented on HIVE-12382: -- HIVE-8244 has same proposal for ACID but in this one,i plan to

[jira] [Updated] (HIVE-12371) Adding a timeout connection parameter for JDBC

2015-11-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-12371: - Priority: Minor (was: Major) > Adding a timeout connection parameter for JDBC >

[jira] [Updated] (HIVE-11768) java.io.DeleteOnExitHook leaks memory on long running Hive Server2 Instances

2015-10-07 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-11768: - Priority: Minor (was: Major) > java.io.DeleteOnExitHook leaks memory on long running Hive Server2

[jira] [Reopened] (HIVE-11768) java.io.DeleteOnExitHook leaks memory on long running Hive Server2 Instances

2015-09-28 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou reopened HIVE-11768: -- > java.io.DeleteOnExitHook leaks memory on long running Hive Server2 Instances >

[jira] [Commented] (HIVE-11768) java.io.DeleteOnExitHook leaks memory on long running Hive Server2 Instances

2015-09-27 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909982#comment-14909982 ] Nemon Lou commented on HIVE-11768: -- For better understand: The deletion of temp file can not fix this

[jira] [Commented] (HIVE-11768) java.io.DeleteOnExitHook leaks memory on long running Hive Server2 Instances

2015-09-27 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909973#comment-14909973 ] Nemon Lou commented on HIVE-11768: -- What HIVE-6091 did was trying to make sure the deletion of pipeout

[jira] [Updated] (HIVE-11768) java.io.DeleteOnExitHook leaks memory on long running Hive Server2 Instances

2015-09-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-11768: - Description: More than 490,000 paths was added to java.io.DeleteOnExitHook on one of our long running

[jira] [Commented] (HIVE-11768) java.io.DeleteOnExitHook leaks memory on long running Hive Server2 Instances

2015-09-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14736333#comment-14736333 ] Nemon Lou commented on HIVE-11768: -- [~navis] Thanks for working on this. > java.io.DeleteOnExitHook

[jira] [Commented] (HIVE-11768) java.io.DeleteOnExitHook leaks memory on long running Hive Server2 Instances

2015-09-08 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14736138#comment-14736138 ] Nemon Lou commented on HIVE-11768: -- The java.io.File.deleteOnExit API is flawed and causes JVM crashes on

[jira] [Commented] (HIVE-11717) nohup mode is not support for beeline

2015-09-06 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14733197#comment-14733197 ] Nemon Lou commented on HIVE-11717: -- Same as HIVE-6758,and a workaround was provided there: {quote} export

[jira] [Resolved] (HIVE-10625) Handle Authorization for 'select expr' hive queries in SQL Standard Authorization

2015-08-10 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou resolved HIVE-10625. -- Resolution: Duplicate Same work is going on at HIVE-11498,so close this one. Handle Authorization for

[jira] [Updated] (HIVE-11244) Beeline prompt info improvement for cluster mode

2015-07-17 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-11244: - Attachment: HIVE-11244.2.patch Code style fixed. I do see the failed test with this patch ,but after

[jira] [Updated] (HIVE-11244) Beeline prompt info improvement for cluster mode

2015-07-16 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-11244: - Attachment: HIVE-11244.1.patch This patch has been tested on my cluster ,and the parameter works.

[jira] [Updated] (HIVE-11244) Beeline prompt info improvement for cluster mode

2015-07-15 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-11244: - Attachment: HIVE-11244.patch Adding an option showConnectedUrl,default false. help message : {noformat}

[jira] [Commented] (HIVE-11244) Beeline prompt info improvement for cluster mode

2015-07-15 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628158#comment-14628158 ] Nemon Lou commented on HIVE-11244: -- Will fire CI tests later when i'm sure it works.

[jira] [Commented] (HIVE-11243) Changing log level in Utilities.getBaseWork

2015-07-15 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14628160#comment-14628160 ] Nemon Lou commented on HIVE-11243: -- The failed test seems unrelated. Changing log level

[jira] [Commented] (HIVE-11244) Beeline prompt info improvement for cluster mode

2015-07-14 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14625998#comment-14625998 ] Nemon Lou commented on HIVE-11244: -- The basic idea is adding a new getUrl method for

[jira] [Updated] (HIVE-11243) Changing log level in Utilities.getBaseWork

2015-07-14 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-11243: - Attachment: HIVE-11243.patch Changing log level in Utilities.getBaseWork

[jira] [Updated] (HIVE-11244) Beeline prompt info improvement for cluster mode

2015-07-14 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-11244: - Attachment: HIVE-11244.patch Beeline prompt info improvement for cluster mode

[jira] [Updated] (HIVE-11244) Beeline prompt info improvement for cluster mode

2015-07-14 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-11244: - Attachment: HIVE-11244.patch Updated based on master.Code style updated ,too.Thanks for review.

[jira] [Updated] (HIVE-11244) Beeline prompt info improvement for cluster mode

2015-07-14 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-11244: - Attachment: HIVE-11244.patch This patch is not based on master .Will be updated later. Beeline prompt

[jira] [Updated] (HIVE-11244) Beeline prompt info improvement for cluster mode

2015-07-13 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-11244: - Affects Version/s: 1.2.0 Beeline prompt info improvement for cluster mode

[jira] [Updated] (HIVE-11243) Changing log level in Utilities.getBaseWork

2015-07-13 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-11243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nemon Lou updated HIVE-11243: - Description: Seeing a lot this kind of log when running jobs without any reduce,changing this log to

[jira] [Commented] (HIVE-9625) Delegation tokens for HMS are not renewed

2015-06-28 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605057#comment-14605057 ] Nemon Lou commented on HIVE-9625: - [~xuefuz],thanks for your attention.What i propose is a

[jira] [Commented] (HIVE-9625) Delegation tokens for HMS are not renewed

2015-06-25 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14602324#comment-14602324 ] Nemon Lou commented on HIVE-9625: - Thanks all for working on this. Seeing the same issue.We

[jira] [Commented] (HIVE-10815) Let HiveMetaStoreClient Choose MetaStore Randomly

2015-06-16 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587743#comment-14587743 ] Nemon Lou commented on HIVE-10815: -- The mechanism in promoteRandomMetaStoreURI() has

[jira] [Commented] (HIVE-10820) Hive Server2 should register itself again when encounters some failures in HA mode

2015-06-11 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581715#comment-14581715 ] Nemon Lou commented on HIVE-10820: -- This has been fixed in 1.2.0 by HIVE-8890. Hive

[jira] [Commented] (HIVE-10890) Provide implementable engine selector

2015-06-10 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14581332#comment-14581332 ] Nemon Lou commented on HIVE-10890: -- I'm a little confused by this.Here is my thoughts:

[jira] [Commented] (HIVE-10815) Let HiveMetaStoreClient Choose MetaStore Randomly

2015-06-08 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14576724#comment-14576724 ] Nemon Lou commented on HIVE-10815: -- [~thiruvel] Thanks for reply. I find that only the

<    1   2   3   >