[GitHub] spark pull request: [SPARK-7634][SQL] thrift server UI optimizatio...
Github user luogankun closed the pull request at: https://github.com/apache/spark/pull/6148 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-7634][SQL] thrift server UI optimizatio...
GitHub user luogankun opened a pull request: https://github.com/apache/spark/pull/6148 [SPARK-7634][SQL] thrift server UI optimization optimization description: 1. Session Statistics : order by start time desc; 2. distinguish offline sessions from online sessions; ![thriftserver](https://cloud.githubusercontent.com/assets/6646989/7631946/0e31880e-fa7b-11e4-85d9-3d2eee2f5984.jpg) You can merge this pull request into a Git repository by running: $ git pull https://github.com/luogankun/spark SPARK-7634 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/6148.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #6148 commit acf685508aa766bc3b9f310ade67249076e834fd Author: luogankun luogan...@gmail.com Date: 2015-05-14T12:19:08Z [SPARK-7634][SQL] thrift server UI optimization --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5239][CORE]JdbcRDD throws java.lang.Ab...
Github user luogankun commented on the pull request: https://github.com/apache/spark/pull/4033#issuecomment-73538418 The stacktrace message of all failure testcase are: `sbt.ForkMain$ForkError: Futures timed out after [1 minute]`, whether related Jenkins? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5239][CORE]JdbcRDD throws java.lang.Ab...
Github user luogankun commented on the pull request: https://github.com/apache/spark/pull/4033#issuecomment-73533646 @srowen To do other things, forgot to resubmit a new PR after close the PR. Thanks for your help. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5239][CORE]JdbcRDD throws java.lang.Ab...
Github user luogankun closed the pull request at: https://github.com/apache/spark/pull/4033 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5239][CORE]JdbcRDD throws java.lang.Ab...
Github user luogankun commented on the pull request: https://github.com/apache/spark/pull/4033#issuecomment-73445396 Close the PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5239][CORE]JdbcRDD throws java.lang.Ab...
GitHub user luogankun opened a pull request: https://github.com/apache/spark/pull/4033 [SPARK-5239][CORE]JdbcRDD throws java.lang.AbstractMethodError: oracle.jdbc.driver.xx.isClosed()Z `rs.isClosed()` will throws: ``` Exception in thread main java.lang.AbstractMethodError: oracle.jdbc.driver.OracleResultSetImpl.isClosed()Z ``` Similarly,`stmt.isClosed()` will throws ``` Exception in thread main java.lang.AbstractMethodError: oracle.jdbc.driver.T4CPreparedStatement.isClosed()Z ``` Above exception is throwing because isClosed() is not implemented in the OracleResultSetImpl class which implements the ResultSet Interface in Ojdbc14.jar, I think use below condition to check whether resultset is null or not is enough ``` if (null != rs) { rs.close() } ``` You can merge this pull request into a Git repository by running: $ git pull https://github.com/luogankun/spark SPARK-5239 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/4033.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #4033 commit d8c61d648208cd7b8f7b37d3b615d895e7857771 Author: luogankun luogan...@gmail.com Date: 2015-01-14T06:13:40Z [SPARK-5239][CORE]JdbcRDD throws 'java.lang.AbstractMethodError: oracle.jdbc.driver.xx.isClosed()Z' --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5141][SQL]CaseInsensitiveMap throws jav...
GitHub user luogankun reopened a pull request: https://github.com/apache/spark/pull/3944 [SPARK-5141][SQL]CaseInsensitiveMap throws java.io.NotSerializableException CaseInsensitiveMap throws java.io.NotSerializableException. You can merge this pull request into a Git repository by running: $ git pull https://github.com/luogankun/spark SPARK-5141 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/3944.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3944 commit b6d63d5b91cc2e558ecd5b984d312aa0ee9d6f32 Author: luogankun luogan...@gmail.com Date: 2015-01-08T08:19:23Z [SPARK-5141]CaseInsensitiveMap throws java.io.NotSerializableException --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5141][SQL]CaseInsensitiveMap throws jav...
Github user luogankun commented on the pull request: https://github.com/apache/spark/pull/3944#issuecomment-69313874 According to Yin Huai in https://issues.apache.org/jira/browse/SPARK-5141 , set jdbcProps `transient`. Resolved this issue. I will close the pr. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5141][SQL]CaseInsensitiveMap throws jav...
Github user luogankun closed the pull request at: https://github.com/apache/spark/pull/3944 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-5141][SQL]CaseInsensitiveMap throws jav...
GitHub user luogankun opened a pull request: https://github.com/apache/spark/pull/3944 [SPARK-5141][SQL]CaseInsensitiveMap throws java.io.NotSerializableException CaseInsensitiveMap throws java.io.NotSerializableException. You can merge this pull request into a Git repository by running: $ git pull https://github.com/luogankun/spark SPARK-5141 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/3944.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3944 commit b6d63d5b91cc2e558ecd5b984d312aa0ee9d6f32 Author: luogankun luogan...@gmail.com Date: 2015-01-08T08:19:23Z [SPARK-5141]CaseInsensitiveMap throws java.io.NotSerializableException --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4916][SQL][DOCS]Update SQL programming ...
GitHub user luogankun opened a pull request: https://github.com/apache/spark/pull/3759 [SPARK-4916][SQL][DOCS]Update SQL programming guide about cache section `SchemeRDD.cache()` now uses in-memory columnar storage. You can merge this pull request into a Git repository by running: $ git pull https://github.com/luogankun/spark SPARK-4916 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/3759.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3759 commit 99b23365ceccb1a2dde4ac4dc500f9ff9aedb239 Author: luogankun luogan...@gmail.com Date: 2014-12-22T08:01:31Z [SPARK-4916]Update SQL programming guide commit 0b93785a3d68ccdc4825244eda439d441fab0672 Author: luogankun luogan...@gmail.com Date: 2014-12-22T08:11:42Z [SPARK-4916]Update SQL programming guide --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4930][SQL][DOCS]Update SQL programming ...
GitHub user luogankun opened a pull request: https://github.com/apache/spark/pull/3773 [SPARK-4930][SQL][DOCS]Update SQL programming guide, CACHE TABLE is eager `CACHE TABLE tbl` is now __eager__ by default not __lazy__ You can merge this pull request into a Git repository by running: $ git pull https://github.com/luogankun/spark SPARK-4930 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/3773.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3773 commit bffe0e87a420661dcc1cf41787bf98bf4252 Author: luogankun luogan...@gmail.com Date: 2014-12-23T05:52:57Z [SPARK-4930][SQL][DOCS]Update SQL programming guide, CACHE TABLE tbl is eager --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-4930][SQL][DOCS]Update SQL programming ...
Github user luogankun commented on the pull request: https://github.com/apache/spark/pull/3773#issuecomment-67924321 ok --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-3945]Properties of hive-site.xml is inv...
Github user luogankun commented on the pull request: https://github.com/apache/spark/pull/2800#issuecomment-59348084 @liancheng Tests timed out! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-3945]Properties of hive-site.xml is inv...
Github user luogankun commented on the pull request: https://github.com/apache/spark/pull/2800#issuecomment-59183382 @liancheng --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-3945]Write properties of hive-site.xml ...
GitHub user luogankun opened a pull request: https://github.com/apache/spark/pull/2800 [SPARK-3945]Write properties of hive-site.xml to HiveContext when initil... Write properties of hive-site.xml to HiveContext when initilize session state In SparkSQLEnv.scala The method of SparkSQLEnv.init() in HiveThriftServer2.scala cann't write the properties of hive-site.xml to HiveContext example: hive-site.xml property namespark.sql.shuffle.partititions/name value99/value /property You can merge this pull request into a Git repository by running: $ git pull https://github.com/luogankun/spark SPARK-3945 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/2800.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #2800 commit 3679efc5eb6c037769ed4032f0a93d7e56ed9b8c Author: luogankun luogan...@gmail.com Date: 2014-10-14T10:58:39Z [SPARK-3945]Write properties of hive-site.xml to HiveContext when initilize session state In SparkSQLEnv.scala --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-3065][SQL] Add locale setting to fix re...
Github user luogankun commented on the pull request: https://github.com/apache/spark/pull/1968#issuecomment-52880789 @liancheng Now I need to do what? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-3065][SQL] Add locale setting to fix re...
Github user luogankun commented on the pull request: https://github.com/apache/spark/pull/1968#issuecomment-52445779 @marmbrus From the console log, unit tests failed causes not my case, but hive thrift server. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-3065][SQL] Add Locale setting to HiveCo...
GitHub user luogankun opened a pull request: https://github.com/apache/spark/pull/1968 [SPARK-3065][SQL] Add Locale setting to HiveCompatibilitySuite to fix run udf_unix_timestamp with not America/Los_Angeles TimeZone When run the udf_unix_timestamp of org.apache.spark.sql.hive.execution.HiveCompatibilitySuite testcase with not America/Los_Angeles TimeZone throws error. [https://issues.apache.org/jira/browse/SPARK-3065] add locale setting on beforeAll and afterAll method to fix the bug of HiveCompatibilitySuite testcase You can merge this pull request into a Git repository by running: $ git pull https://github.com/luogankun/spark SPARK-3065 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/1968.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1968 commit 0a25e3a4f1cb80e027ee0fd05fd898651a3f7074 Author: luogankun luogan...@gmail.com Date: 2014-08-15T07:31:47Z [SPARK-3065][SQL] Add Locale setting to HiveCompatibilitySuite commit c167832d161dd559a67061094d77fa454ec24fa8 Author: luogankun luogan...@gmail.com Date: 2014-08-15T09:07:32Z [SPARK-3065][SQL] Add Locale setting to HiveCompatibilitySuite --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org