[jira] [Updated] (HIVE-8868) SparkSession and SparkClient mapping[Spark Branch]

2014-11-20 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8868: Attachment: HIVE-8868.2-spark.patch reattach patch to trigger unit test. SparkSession

[jira] [Resolved] (HIVE-8903) downgrade guava version for spark branch from 14.0.1 to 11.0.2.[Spark Branch]

2014-11-20 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li resolved HIVE-8903. - Resolution: Duplicate duplicated with HIVE-8878. downgrade guava version for spark branch from

[jira] [Updated] (HIVE-8868) SparkSession and SparkClient mapping[Spark Branch]

2014-11-20 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8868: Status: Patch Available (was: Open) SparkSession and SparkClient mapping[Spark Branch

[jira] [Updated] (HIVE-8868) SparkSession and SparkClient mapping[Spark Branch]

2014-11-20 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8868: Attachment: (was: HIVE-8868.2-spark.patch) SparkSession and SparkClient mapping[Spark Branch

[jira] [Updated] (HIVE-8868) SparkSession and SparkClient mapping[Spark Branch]

2014-11-20 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8868: Attachment: HIVE-8868.2-spark.patch SparkSession and SparkClient mapping[Spark Branch

[jira] [Updated] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-19 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8836: Attachment: HIVE-8836.1-spark.patch upload the patch as a reference since i would take a week leave

[jira] [Updated] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-19 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8836: Assignee: Rui Li (was: Chengxiang Li) Enable automatic tests with remote spark client.[Spark

[jira] [Updated] (HIVE-8868) SparkSession and SparkClient mapping[Spark Branch]

2014-11-19 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8868: Assignee: Rui Li (was: Chengxiang Li) SparkSession and SparkClient mapping[Spark Branch

[jira] [Updated] (HIVE-8903) downgrade guava version for spark branch from 14.0.1 to 11.0.2.[Spark Branch]

2014-11-18 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8903: Status: Open (was: Patch Available) downgrade guava version for spark branch from 14.0.1 to 11.0.2

[jira] [Commented] (HIVE-8903) downgrade guava version for spark branch from 14.0.1 to 11.0.2.[Spark Branch]

2014-11-18 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14215880#comment-14215880 ] Chengxiang Li commented on HIVE-8903: - Hi, [~szehon], I think Marcelo means

[jira] [Updated] (HIVE-8868) SparkSession and SparkClient mapping[Spark Branch]

2014-11-18 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8868: Status: Patch Available (was: Open) SparkSession and SparkClient mapping[Spark Branch

[jira] [Created] (HIVE-8905) Servlet classes signer information does not match[Spark branch]

2014-11-18 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-8905: --- Summary: Servlet classes signer information does not match[Spark branch] Key: HIVE-8905 URL: https://issues.apache.org/jira/browse/HIVE-8905 Project: Hive

[jira] [Commented] (HIVE-8868) SparkSession and SparkClient mapping[Spark Branch]

2014-11-18 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14216145#comment-14216145 ] Chengxiang Li commented on HIVE-8868: - From hive log, session related tests failed due

[jira] [Updated] (HIVE-8868) SparkSession and SparkClient mapping[Spark Branch]

2014-11-18 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8868: Status: Open (was: Patch Available) SparkSession and SparkClient mapping[Spark Branch

[jira] [Assigned] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-18 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li reassigned HIVE-8836: --- Assignee: Chengxiang Li Enable automatic tests with remote spark client.[Spark Branch

[jira] [Updated] (HIVE-8833) Unify spark client API and implement remote spark client.[Spark Branch]

2014-11-17 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8833: Attachment: HIVE-8833.4-spark.patch Unify spark client API and implement remote spark client.[Spark

Re: Review Request 27987: HIVE-8833 implement remote spark client

2014-11-17 Thread chengxiang li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27987/#review61819 --- On Nov. 17, 2014, 3:47 a.m., chengxiang li wrote

[jira] [Updated] (HIVE-8833) Unify spark client API and implement remote spark client.[Spark Branch]

2014-11-17 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8833: Attachment: HIVE-8833.5-spark.patch update patch for szehon's review. Unify spark client API

Re: Review Request 27987: HIVE-8833 implement remote spark client

2014-11-17 Thread chengxiang li
://reviews.apache.org/r/27987/diff/ Testing --- Thanks, chengxiang li

[jira] [Updated] (HIVE-8833) Unify spark client API and implement remote spark client.[Spark Branch]

2014-11-17 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8833: Attachment: HIVE-8833.5-spark.patch Unify spark client API and implement remote spark client.[Spark

Re: Review Request 27987: HIVE-8833 implement remote spark client

2014-11-17 Thread chengxiang li
://reviews.apache.org/r/27987/diff/ Testing --- Thanks, chengxiang li

[jira] [Commented] (HIVE-8833) Unify spark client API and implement remote spark client.[Spark Branch]

2014-11-17 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14215752#comment-14215752 ] Chengxiang Li commented on HIVE-8833: - Thanks [~szehon] and all guys help to review

[jira] [Created] (HIVE-8903) downgrade guava version for spark branch from 14.0.1 to 11.0.2.[Spark Branch]

2014-11-17 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-8903: --- Summary: downgrade guava version for spark branch from 14.0.1 to 11.0.2.[Spark Branch] Key: HIVE-8903 URL: https://issues.apache.org/jira/browse/HIVE-8903 Project

[jira] [Updated] (HIVE-8903) downgrade guava version for spark branch from 14.0.1 to 11.0.2.[Spark Branch]

2014-11-17 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8903: Status: Patch Available (was: Open) downgrade guava version for spark branch from 14.0.1 to 11.0.2

[jira] [Updated] (HIVE-8903) downgrade guava version for spark branch from 14.0.1 to 11.0.2.[Spark Branch]

2014-11-17 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8903: Attachment: HIVE-8903.1-spark.patch downgrade guava version for spark branch from 14.0.1 to 11.0.2

[jira] [Assigned] (HIVE-8835) identify dependency scope for Remote Spark Context.[Spark Branch]

2014-11-17 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li reassigned HIVE-8835: --- Assignee: Chengxiang Li identify dependency scope for Remote Spark Context.[Spark Branch

[jira] [Updated] (HIVE-8835) identify dependency scope for Remote Spark Context.[Spark Branch]

2014-11-17 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8835: Attachment: HIVE-8835.1-spark.patch Remote Spark Context need at least 3 dependencies to go through

[jira] [Updated] (HIVE-8835) identify dependency scope for Remote Spark Context.[Spark Branch]

2014-11-17 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8835: Status: Patch Available (was: Open) identify dependency scope for Remote Spark Context.[Spark

[jira] [Assigned] (HIVE-8868) SparkSession and SparkClient mapping[Spark Branch]

2014-11-17 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li reassigned HIVE-8868: --- Assignee: Chengxiang Li SparkSession and SparkClient mapping[Spark Branch

[jira] [Updated] (HIVE-8868) SparkSession and SparkClient mapping[Spark Branch]

2014-11-17 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8868: Attachment: HIVE-8868.1-spark.patch For local spark context, multi user would share the same spark

Review Request 28162: HIVE-8868 SparkSession and SparkClient mapping[Spark Branch]

2014-11-17 Thread chengxiang li
/SparkSessionImpl.java 1f7ed83 Diff: https://reviews.apache.org/r/28162/diff/ Testing --- Thanks, chengxiang li

[jira] [Updated] (HIVE-8868) SparkSession and SparkClient mapping[Spark Branch]

2014-11-17 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8868: Labels: Spark-M3 TODOC-SPARK (was: Spark-M3) SparkSession and SparkClient mapping[Spark Branch

[jira] [Updated] (HIVE-8868) SparkSession and SparkClient mapping[Spark Branch]

2014-11-17 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8868: Attachment: HIVE-8868.2-spark.patch SparkSession and SparkClient mapping[Spark Branch

Re: Review Request 28162: HIVE-8868 SparkSession and SparkClient mapping[Spark Branch]

2014-11-17 Thread chengxiang li
/hadoop/hive/ql/exec/spark/session/SparkSession.java 044cf7c ql/src/java/org/apache/hadoop/hive/ql/exec/spark/session/SparkSessionImpl.java 1f7ed83 Diff: https://reviews.apache.org/r/28162/diff/ Testing --- Thanks, chengxiang li

[jira] [Updated] (HIVE-8833) Unify spark client API and implement remote spark client.[Spark Branch]

2014-11-16 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8833: Attachment: HIVE-8833.3-spark.patch update code for xuefu and marcelo's comments. Unify spark

Re: Review Request 27987: HIVE-8833 implement remote spark client

2014-11-16 Thread chengxiang li
/27987/#review61479 --- On Nov. 14, 2014, 3:43 a.m., chengxiang li wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27987

Re: Review Request 27987: HIVE-8833 implement remote spark client

2014-11-16 Thread chengxiang li
--- Thanks, chengxiang li

[jira] [Commented] (HIVE-8833) Unify spark client API and implement remote spark client.[Spark Branch]

2014-11-16 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14214264#comment-14214264 ] Chengxiang Li commented on HIVE-8833: - [~brocknoland], previous compile failure seems

[jira] [Updated] (HIVE-8833) Unify spark client API and implement remote spark client.[Spark Branch]

2014-11-16 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8833: Attachment: HIVE-8833.4-spark.patch set tez versio from 0.5.2-snapshot to 0.5.2 to avoid previous

[jira] [Updated] (HIVE-8833) Unify spark client API and implement remote spark client.[Spark Branch]

2014-11-16 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8833: Attachment: HIVE-8833.4-spark.patch revert tez version change. Unify spark client API

[jira] [Updated] (HIVE-8833) Unify spark client API and implement remote spark client.[Spark Branch]

2014-11-16 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8833: Attachment: HIVE-8833.4-spark.patch Unify spark client API and implement remote spark client.[Spark

[jira] [Commented] (HIVE-8852) Update new spark progress API for local submitted job monitoring[Spark Branch]

2014-11-14 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14212237#comment-14212237 ] Chengxiang Li commented on HIVE-8852: - patch mainly look good to me, I only add some

[jira] [Created] (HIVE-8854) Guava dependency conflict between hive driver and remote spark context[Spark Branch]

2014-11-13 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-8854: --- Summary: Guava dependency conflict between hive driver and remote spark context[Spark Branch] Key: HIVE-8854 URL: https://issues.apache.org/jira/browse/HIVE-8854

[jira] [Updated] (HIVE-8854) Guava dependency conflict between hive driver and remote spark context[Spark Branch]

2014-11-13 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8854: Description: Hive driver would load guava 11.0.2 from hadoop/tez, while remote spark context

Review Request 27987: HIVE-8833 implement remote spark client

2014-11-13 Thread chengxiang li
d4d14a3 spark-client/src/main/java/org/apache/hive/spark/client/SparkClient.java 8346b28 Diff: https://reviews.apache.org/r/27987/diff/ Testing --- Thanks, chengxiang li

Re: Review Request 27987: HIVE-8833 implement remote spark client

2014-11-13 Thread chengxiang li
/SetSparkReducerParallelism.java https://reviews.apache.org/r/27987/#comment102775 disable it temporarily as this depends on spark context, we should enable it in an uniform way for local spark client and remote spark client. - chengxiang li On 十一月 13, 2014, 1:10 p.m., chengxiang li wrote

[jira] [Updated] (HIVE-8833) Unify spark client API and implement remote spark client.[Spark Branch]

2014-11-13 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8833: Attachment: HIVE-8833.1-spark.patch patch is not totally ready yet, upload it for pre review

[jira] [Updated] (HIVE-8833) Unify spark client API and implement remote spark client.[Spark Branch]

2014-11-13 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8833: Status: Patch Available (was: Open) enable submit patch to try auto test. Unify spark client API

[jira] [Created] (HIVE-8855) Automatic calculate reduce number for spark job[Spark Branch]

2014-11-13 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-8855: --- Summary: Automatic calculate reduce number for spark job[Spark Branch] Key: HIVE-8855 URL: https://issues.apache.org/jira/browse/HIVE-8855 Project: Hive

Re: Review Request 27987: HIVE-8833 implement remote spark client

2014-11-13 Thread chengxiang li
spark-client/src/main/java/org/apache/hive/spark/client/SparkClient.java 8346b28 spark-client/src/main/java/org/apache/hive/spark/client/SparkClientImpl.java 5af66ee Diff: https://reviews.apache.org/r/27987/diff/ Testing --- Thanks, chengxiang li

[jira] [Updated] (HIVE-8833) Unify spark client API and implement remote spark client.[Spark Branch]

2014-11-13 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8833: Attachment: HIVE-8833.2-spark.patch # enable submit spark job through programatic SparkSubmit

Re: Review Request 27987: HIVE-8833 implement remote spark client

2014-11-13 Thread chengxiang li
--- Thanks, chengxiang li

Re: Review Request 27987: HIVE-8833 implement remote spark client

2014-11-13 Thread chengxiang li
://reviews.apache.org/r/27987/#review61398 --- On 十一月 14, 2014, 3:43 a.m., chengxiang li wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r

[jira] [Updated] (HIVE-8854) Guava dependency conflict between hive driver and remote spark context[Spark Branch]

2014-11-13 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8854: Attachment: hive-dirver-classloader-info.output [~vanzin], From the classloader information, in hive

[jira] [Created] (HIVE-8868) SparkSession and SparkClient mapping[Spark Branch]

2014-11-13 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-8868: --- Summary: SparkSession and SparkClient mapping[Spark Branch] Key: HIVE-8868 URL: https://issues.apache.org/jira/browse/HIVE-8868 Project: Hive Issue Type: Sub

[jira] [Created] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-12 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-8836: --- Summary: Enable automatic tests with remote spark client.[Spark Branch] Key: HIVE-8836 URL: https://issues.apache.org/jira/browse/HIVE-8836 Project: Hive

[jira] [Commented] (HIVE-8780) insert1.q and ppd_join4.q hangs with hadoop-1 [Spark Branch]

2014-11-12 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207827#comment-14207827 ] Chengxiang Li commented on HIVE-8780: - smb_mapjoin_19 failure should not related

[jira] [Commented] (HIVE-8836) Enable automatic tests with remote spark client.[Spark Branch]

2014-11-12 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14209035#comment-14209035 ] Chengxiang Li commented on HIVE-8836: - Yes, [~xuefuz], this would be enabled with HIVE

[jira] [Commented] (HIVE-8780) insert1.q and ppd_join4.q hangs with hadoop-1 [Spark Branch]

2014-11-12 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14209200#comment-14209200 ] Chengxiang Li commented on HIVE-8780: - Well, Spark wrapped hdfs file with HadoopRDD

[jira] [Created] (HIVE-8852) Update new spark progress API for local submitted job monitoring[Spark Branch]

2014-11-12 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-8852: --- Summary: Update new spark progress API for local submitted job monitoring[Spark Branch] Key: HIVE-8852 URL: https://issues.apache.org/jira/browse/HIVE-8852 Project

[jira] [Commented] (HIVE-8780) insert1.q and ppd_join4.q hangs with hadoop-1 [Spark Branch]

2014-11-11 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206126#comment-14206126 ] Chengxiang Li commented on HIVE-8780: - I hit the same issue as xuefu, while insert1.q

[jira] [Commented] (HIVE-8780) insert1.q and ppd_join4.q hangs with hadoop-1 [Spark Branch]

2014-11-11 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207537#comment-14207537 ] Chengxiang Li commented on HIVE-8780: - Yes, I would like to see what's going on here

[jira] [Updated] (HIVE-8780) insert1.q and ppd_join4.q hangs with hadoop-1 [Spark Branch]

2014-11-11 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8780: Attachment: 8780.1-spark.patch Spark job with empty source data would not be submmited to spark

[jira] [Updated] (HIVE-8780) insert1.q and ppd_join4.q hangs with hadoop-1 [Spark Branch]

2014-11-11 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8780: Attachment: HIVE-8780.1-spark.patch insert1.q and ppd_join4.q hangs with hadoop-1 [Spark Branch

[jira] [Updated] (HIVE-8780) insert1.q and ppd_join4.q hangs with hadoop-1 [Spark Branch]

2014-11-11 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8780: Attachment: (was: 8780.1-spark.patch) insert1.q and ppd_join4.q hangs with hadoop-1 [Spark

[jira] [Updated] (HIVE-8780) insert1.q and ppd_join4.q hangs with hadoop-1 [Spark Branch]

2014-11-11 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8780: Status: Patch Available (was: Open) insert1.q and ppd_join4.q hangs with hadoop-1 [Spark Branch

[jira] [Assigned] (HIVE-8780) insert1.q and ppd_join4.q hangs with hadoop-1 [Spark Branch]

2014-11-11 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li reassigned HIVE-8780: --- Assignee: Chengxiang Li insert1.q and ppd_join4.q hangs with hadoop-1 [Spark Branch

Review Request 27908: HIVE-8780 insert1.q hangs with hadoop-1

2014-11-11 Thread chengxiang li
://reviews.apache.org/r/27908/diff/ Testing --- Thanks, chengxiang li

[jira] [Updated] (HIVE-8548) Integrate with remote Spark context after HIVE-8528 [Spark Branch]

2014-11-11 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8548: Description: With HIVE-8528, HiverSever2 should use remote Spark context to submit job and monitor

[jira] [Updated] (HIVE-8548) Integrate with remote Spark context after HIVE-8528 [Spark Branch]

2014-11-11 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8548: Issue Type: Bug (was: Sub-task) Parent: (was: HIVE-7292) Integrate with remote Spark

[jira] [Created] (HIVE-8833) Unify spark client API and implement remote spark client.

2014-11-11 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-8833: --- Summary: Unify spark client API and implement remote spark client. Key: HIVE-8833 URL: https://issues.apache.org/jira/browse/HIVE-8833 Project: Hive Issue

[jira] [Created] (HIVE-8834) enable job progress monitoring of Remote Spark Context

2014-11-11 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-8834: --- Summary: enable job progress monitoring of Remote Spark Context Key: HIVE-8834 URL: https://issues.apache.org/jira/browse/HIVE-8834 Project: Hive Issue Type

[jira] [Updated] (HIVE-8834) enable job progress monitoring of Remote Spark Context

2014-11-11 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8834: Assignee: (was: Chengxiang Li) enable job progress monitoring of Remote Spark Context

[jira] [Updated] (HIVE-8574) Enhance metrics gathering in Spark Client [Spark Branch]

2014-11-11 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8574: Issue Type: Bug (was: Sub-task) Parent: (was: HIVE-7292) Enhance metrics gathering

[jira] [Updated] (HIVE-8834) enable job progress monitoring of Remote Spark Context[Spark Branch]

2014-11-11 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8834: Summary: enable job progress monitoring of Remote Spark Context[Spark Branch] (was: enable job

[jira] [Updated] (HIVE-8833) Unify spark client API and implement remote spark client.[Spark Branch]

2014-11-11 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8833: Summary: Unify spark client API and implement remote spark client.[Spark Branch] (was: Unify spark

[jira] [Updated] (HIVE-8574) Enhance metrics gathering in Spark Client [Spark Branch]

2014-11-11 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8574: Issue Type: Sub-task (was: Bug) Parent: HIVE-8548 Enhance metrics gathering in Spark

[jira] [Created] (HIVE-8835) identify dependency scope for Remote Spark Context.[Spark Branch]

2014-11-11 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-8835: --- Summary: identify dependency scope for Remote Spark Context.[Spark Branch] Key: HIVE-8835 URL: https://issues.apache.org/jira/browse/HIVE-8835 Project: Hive

[jira] [Updated] (HIVE-7142) Hive multi serialization encoding support

2014-11-10 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7142: Labels: (was: TODOC14) Hive multi serialization encoding support

[jira] [Commented] (HIVE-7142) Hive multi serialization encoding support

2014-11-10 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205971#comment-14205971 ] Chengxiang Li commented on HIVE-7142: - Hi, [~leftylev], I've documented it at [Hive

Re: Review Request 27720: HIVE-8777 should only register used operator counters.[Spark Branch]

2014-11-07 Thread chengxiang li
--- On 十一月 7, 2014, 5:27 a.m., chengxiang li wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27720

Re: Review Request 27720: HIVE-8777 should only register used operator counters.[Spark Branch]

2014-11-07 Thread chengxiang li
are expecting and avoid future breakage. chengxiang li wrote: Thanks,xuefu.the hive operator level counters is used during spark job execution,so our current tests should have covered this patch change.but for table statistic collection, as you know that we use fs as default counter storage

[jira] [Commented] (HIVE-8548) Integrate with remote Spark context after HIVE-8528 [Spark Branch]

2014-11-06 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200155#comment-14200155 ] Chengxiang Li commented on HIVE-8548: - [~xuefuz], if we set spark.master as local, hive

[jira] [Created] (HIVE-8777) Should only register used counters in SparkCounters[Spark Branch]

2014-11-06 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-8777: --- Summary: Should only register used counters in SparkCounters[Spark Branch] Key: HIVE-8777 URL: https://issues.apache.org/jira/browse/HIVE-8777 Project: Hive

[jira] [Updated] (HIVE-8777) Should only register used counters in SparkCounters[Spark Branch]

2014-11-06 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8777: Attachment: HIVE-8777.1-spark.patch Should only register used counters in SparkCounters[Spark

Review Request 27720: HIVE-8777 should only register used operator counters.[Spark Branch]

2014-11-06 Thread chengxiang li
66fd6b6 Diff: https://reviews.apache.org/r/27720/diff/ Testing --- Thanks, chengxiang li

[jira] [Updated] (HIVE-8777) Should only register used counters in SparkCounters[Spark Branch]

2014-11-06 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8777: Status: Patch Available (was: Open) Should only register used counters in SparkCounters[Spark

[jira] [Commented] (HIVE-8780) insert1.q and ppd_join4.q hangs with hadoop-1 [Spark Branch]

2014-11-06 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201649#comment-14201649 ] Chengxiang Li commented on HIVE-8780: - Hi, [~jxiang], SparkJobMonitor check job state

[jira] [Commented] (HIVE-8548) Integrate with remote Spark context after HIVE-8528 [Spark Branch]

2014-11-06 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201748#comment-14201748 ] Chengxiang Li commented on HIVE-8548: - Hi [~xuefuz], I agree with your point

[jira] [Assigned] (HIVE-8726) Collect Spark TaskMetrics and build job statistic[Spark Branch]

2014-11-05 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li reassigned HIVE-8726: --- Assignee: Chengxiang Li Collect Spark TaskMetrics and build job statistic[Spark Branch

[jira] [Updated] (HIVE-8726) Collect Spark TaskMetrics and build job statistic[Spark Branch]

2014-11-05 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8726: Attachment: HIVE-8726.1-spark.patch Collect Spark TaskMetrics and build job statistic[Spark Branch

Review Request 27672: HIVE-8726 Collect Spark TaskMetrics and build job statistic[Spark Branch]

2014-11-05 Thread chengxiang li
/ Testing --- Thanks, chengxiang li

Re: Review Request 27672: HIVE-8726 Collect Spark TaskMetrics and build job statistic[Spark Branch]

2014-11-05 Thread chengxiang li
://reviews.apache.org/r/27672/diff/ Testing --- Thanks, chengxiang li

[jira] [Updated] (HIVE-8726) Collect Spark TaskMetrics and build job statistic[Spark Branch]

2014-11-05 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8726: Status: Patch Available (was: Open) Collect Spark TaskMetrics and build job statistic[Spark Branch

[jira] [Created] (HIVE-8725) spark-client build failed sometime.[Spark Branch]

2014-11-04 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-8725: --- Summary: spark-client build failed sometime.[Spark Branch] Key: HIVE-8725 URL: https://issues.apache.org/jira/browse/HIVE-8725 Project: Hive Issue Type: Sub

[jira] [Updated] (HIVE-8725) spark-client build failed sometime.[Spark Branch]

2014-11-04 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8725: Attachment: HIVE-8725.1-spark.patch spark-client build failed sometime.[Spark Branch

[jira] [Updated] (HIVE-8725) spark-client build failed sometimes.[Spark Branch]

2014-11-04 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8725: Summary: spark-client build failed sometimes.[Spark Branch] (was: spark-client build failed

[jira] [Updated] (HIVE-8725) spark-client build failed sometime.[Spark Branch]

2014-11-04 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8725: Status: Patch Available (was: Open) spark-client build failed sometime.[Spark Branch

[jira] [Updated] (HIVE-8670) Combine Hive Operator statistic and Spark Metric to an uniformed query statistic.[Spark Branch]

2014-11-04 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-8670: Attachment: HIVE-8670.1-spark.patch Identified job statistic API and statistic builder logic

Review Request 27569: HIVE-8670 Combine Hive Operator statistic and Spark Metric to an uniformed query statistic.[Spark Branch]

2014-11-04 Thread chengxiang li
/diff/ Testing --- Thanks, chengxiang li

<    1   2   3   4   5   6   7   8   >