[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-15 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15059568#comment-15059568 ] Nemon Lou commented on HIVE-12538: -- [~xuefuz] Thanks for review. I have created HIVE-12689 to keep track

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-11 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052712#comment-15052712 ] Hive QA commented on HIVE-12538: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052727#comment-15052727 ] Xuefu Zhang commented on HIVE-12538: +1 > After set spark related config, SparkSession never get

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-09 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049828#comment-15049828 ] Nemon Lou commented on HIVE-12538: -- Shall I provide a patch only fix issues mentioned here and keep track

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15050091#comment-15050091 ] Xuefu Zhang commented on HIVE-12538: [~nemon], I think it's fine to solve one issue at a time. If you

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-08 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047896#comment-15047896 ] Jimmy Xiang commented on HIVE-12538: I agree. I am wondering if we need to support running just one

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-08 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047910#comment-15047910 ] Nemon Lou commented on HIVE-12538: -- HIVE-9223 seems that Hive on Tez has the same problem. > After set

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-04 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041360#comment-15041360 ] Nemon Lou commented on HIVE-12538: -- [~jxiang] Please feel free to take it over if you plan to support

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-03 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037648#comment-15037648 ] Hive QA commented on HIVE-12538: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-03 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038725#comment-15038725 ] Jimmy Xiang commented on HIVE-12538: Currently, each hive session can have just one spark session.

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-03 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038373#comment-15038373 ] Jimmy Xiang commented on HIVE-12538: Thought about it again, and chatted with Xuefu too. It seems to

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-03 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038609#comment-15038609 ] Xuefu Zhang commented on HIVE-12538: My understanding is that a hive session may "own" more than one

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-03 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15038206#comment-15038206 ] Jimmy Xiang commented on HIVE-12538: Patch v4 looks good to me. +1 > After set spark related config,

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-02 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15036440#comment-15036440 ] Jimmy Xiang commented on HIVE-12538: Patch v2 looks good to me. No need to use ConcurrentHashMap since

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-01 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034578#comment-15034578 ] Jimmy Xiang commented on HIVE-12538: bq. Not quite follow.Is there anything special in operation conf

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-12-01 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15033606#comment-15033606 ] Nemon Lou commented on HIVE-12538: -- Uploading a new patch that only set session level's

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-11-30 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032988#comment-15032988 ] Nemon Lou commented on HIVE-12538: -- [~jxiang] ,thanks for review. {quote} That means we reset the flag

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-11-29 Thread Jimmy Xiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15031109#comment-15031109 ] Jimmy Xiang commented on HIVE-12538: [~nemon], good findings. Do you want to post a patch? Otherwise,

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-11-28 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030446#comment-15030446 ] Nemon Lou commented on HIVE-12538: -- A way to reproduce: 1, open beeline 2, run the following SQL:

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-11-28 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030451#comment-15030451 ] Nemon Lou commented on HIVE-12538: -- Actually,there are two bugs: 1, Property isSparkConfigUpdated of

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-11-28 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030662#comment-15030662 ] Xuefu Zhang commented on HIVE-12538: [~jxiang], could you please check and verify if there are bugs on

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-11-27 Thread Nemon Lou (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030405#comment-15030405 ] Nemon Lou commented on HIVE-12538: -- After debugging ,i find the problem is that ,the operation conf

[jira] [Commented] (HIVE-12538) After set spark related config, SparkSession never get reused

2015-11-27 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15030396#comment-15030396 ] Xuefu Zhang commented on HIVE-12538: I tried but wasn't able to reproduce. > After set spark related