[GitHub] spark issue #18940: SPARK-21501 Change CacheLoader to limit entries based on...

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18940 nit: title should be "`[SPARK-21501] ...`". --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18926: [SPARK-21712] [PySpark] Clarify type error for Column.su...

Github user nchammas commented on the issue: https://github.com/apache/spark/pull/18926 It's cleaner but less specific. Unless we branch on whether `startPos` and `length` are the same type, we will give the same error message for mixed types and for unsupported types. That seems

[GitHub] spark issue #18488: [SPARK-21255][SQL][WIP] Fixed NPE when creating encoder ...

Github user mike0sv commented on the issue: https://github.com/apache/spark/pull/18488 @srowen @HyukjinKwon , retest this please :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16648: [SPARK-18016][SQL][CATALYST] Code Generation: Constant P...

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/16648 kindly ping @bdrillard --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #18640: [SPARK-21422][BUILD] Depend on Apache ORC 1.4.0

Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/18640#discussion_r133255040 --- Diff: sql/core/pom.xml --- @@ -87,6 +87,16 @@ + org.apache.orc + orc-core + ${orc.classifier}

[GitHub] spark issue #18907: [SPARK-18464][SQL][followup] support old table which doe...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18907 **[Test build #80682 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80682/testReport)** for PR 18907 at commit

[GitHub] spark pull request #18933: [WIP][SPARK-21722][SQL][PYTHON] Enable timezone-a...

Github user icexelloss commented on a diff in the pull request: https://github.com/apache/spark/pull/18933#discussion_r133229705 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -912,6 +912,14 @@ object SQLConf { .intConf

[GitHub] spark issue #18926: [SPARK-21712] [PySpark] Clarify type error for Column.su...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18926 ```Python if isinstance(startPos, int) and isinstance(length, int): jc = self._jc.substr(startPos, length) elif isinstance(startPos, Column) and

[GitHub] spark pull request #18943: [SPARK-21731][build] Upgrade scalastyle to 0.9.

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/18943#discussion_r133233495 --- Diff: examples/src/main/scala/org/apache/spark/examples/ml/BucketedRandomProjectionLSHExample.scala --- @@ -21,9 +21,9 @@ package

[GitHub] spark issue #18266: [SPARK-20427][SQL] Read JDBC table use custom schema

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18266 The example in the PR description looks a little bit confusing. ```Scala val dfRead = spark.read.schema(schema).jdbc(jdbcUrl, "tableWithCustomSchema", new Properties()) ```

[GitHub] spark issue #18266: [SPARK-20427][SQL] Read JDBC table use custom schema

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18266 Users should be allowed to specify the schema from the table properties by using DDL-like strings. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #18918: [SPARK-21707][SQL]Improvement a special case for non-det...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18918 **[Test build #80693 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80693/testReport)** for PR 18918 at commit

[GitHub] spark issue #11494: [SPARK-10399][CORE][SQL] Introduce OffHeapMemoryBlock to...

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/11494 kindly ping @yzotov --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18940: SPARK-21501 Change CacheLoader to limit entries based on...

Github user redsanket commented on the issue: https://github.com/apache/spark/pull/18940 @dbolshak there were no unit tests for google cache implementation here before, I could add a simple test to check for cache behavior if it is necessary but ideally a scale test is necessary to

[GitHub] spark issue #18421: [SPARK-21213][SQL] Support collecting partition-level st...

Github user mbasmanova commented on the issue: https://github.com/apache/spark/pull/18421 ping @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #18946: [SPARK-19471][SQL]AggregationIterator does not in...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18946 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18907: [SPARK-18464][SQL][followup] support old table which doe...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18907 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #18930: [SPARK-21677][SQL] json_tuple throws NullPointExc...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18930#discussion_r133249207 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala --- @@ -2034,4 +2034,25 @@ class JsonSuite extends

[GitHub] spark issue #18950: [SPARK-20589][Core][Scheduler] Allow limiting task concu...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18950 **[Test build #80690 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80690/testReport)** for PR 18950 at commit

[GitHub] spark pull request #18933: [WIP][SPARK-21722][SQL][PYTHON] Enable timezone-a...

Github user BryanCutler commented on a diff in the pull request: https://github.com/apache/spark/pull/18933#discussion_r133255672 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -912,6 +912,14 @@ object SQLConf { .intConf

[GitHub] spark pull request #18933: [WIP][SPARK-21722][SQL][PYTHON] Enable timezone-a...

Github user BryanCutler commented on a diff in the pull request: https://github.com/apache/spark/pull/18933#discussion_r133254340 --- Diff: python/pyspark/sql/tests.py --- @@ -2507,6 +2507,37 @@ def test_to_pandas(self): self.assertEquals(types[2], np.bool)

[GitHub] spark issue #18918: [SPARK-21707][SQL]Improvement a special case for non-det...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18918 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80693/ Test FAILed. ---

[GitHub] spark pull request #18877: [SPARK-17742][core] Handle child process exit in ...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18877 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #18940: SPARK-21501 Change CacheLoader to limit entries b...

Github user redsanket commented on a diff in the pull request: https://github.com/apache/spark/pull/18940#discussion_r133220047 --- Diff: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleBlockResolver.java --- @@ -104,15 +105,22 @@ public

[GitHub] spark issue #18622: [SPARK-21340] Bring pyspark BinaryClassificationMetrics ...

Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/18622 @srowen any comment on this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17373: [SPARK-12664][ML] Expose probability in mlp model

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17373 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17373: [SPARK-12664][ML] Expose probability in mlp model

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17373 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80689/ Test PASSed. ---

[GitHub] spark pull request #18907: [SPARK-18464][SQL][followup] support old table wh...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18907 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18649: [SPARK-21395][SQL] Spark SQL hive-thriftserver doesn't r...

Github user debugger87 commented on the issue: https://github.com/apache/spark/pull/18649 @dilipbiswal Thanks for your reply. In my eyes, there have been some mechanism or configuration to control the number of opening files generated by SQL Operation. e.g: ```

[GitHub] spark pull request #18855: [SPARK-3151] [Block Manager] DiskStore.getBytes f...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/18855#discussion_r133232857 --- Diff: core/src/test/scala/org/apache/spark/storage/BlockManagerSuite.scala --- @@ -1415,6 +1415,79 @@ class BlockManagerSuite extends SparkFunSuite with

[GitHub] spark pull request #18849: [SPARK-21617][SQL] Store correct table metadata w...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/18849#discussion_r133236830 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -1175,6 +1205,27 @@ private[spark] class

[GitHub] spark issue #18855: [SPARK-3151] [Block Manager] DiskStore.getBytes fails fo...

Github user eyalfa commented on the issue: https://github.com/apache/spark/pull/18855 Funny enough, that's the approach I've chosen. On Aug 15, 2017 19:17, "Marcelo Vanzin" wrote: > *@vanzin* commented on this pull request. >

[GitHub] spark pull request #18266: [SPARK-20427][SQL] Read JDBC table use custom sch...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18266#discussion_r133239599 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRelation.scala --- @@ -111,7 +111,22 @@ private[sql] case class

[GitHub] spark issue #18849: [SPARK-21617][SQL] Store correct table metadata when alt...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18849 **[Test build #80694 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80694/testReport)** for PR 18849 at commit

[GitHub] spark issue #18930: [SPARK-21677][SQL] json_tuple throws NullPointException ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18930 **[Test build #80688 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80688/testReport)** for PR 18930 at commit

[GitHub] spark pull request #18664: [SPARK-21375][PYSPARK][SQL][WIP] Add Date and Tim...

Github user BryanCutler commented on a diff in the pull request: https://github.com/apache/spark/pull/18664#discussion_r133261665 --- Diff: python/pyspark/sql/tests.py --- @@ -3036,6 +3052,9 @@ def test_toPandas_arrow_toggle(self): pdf = df.toPandas()

[GitHub] spark issue #18918: [SPARK-21707][SQL]Improvement a special case for non-det...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18918 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18918: [SPARK-21707][SQL]Improvement a special case for non-det...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18918 **[Test build #80693 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80693/testReport)** for PR 18918 at commit

[GitHub] spark issue #18952: [MINOR] Fix a typo in the method name `UserDefinedFuncti...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18952 **[Test build #80695 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80695/testReport)** for PR 18952 at commit

[GitHub] spark issue #18877: [SPARK-17742][core] Handle child process exit in SparkLa...

Github user vanzin commented on the issue: https://github.com/apache/spark/pull/18877 Alright, merging this to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18940: SPARK-21501 Change CacheLoader to limit entries based on...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18940 **[Test build #80691 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80691/testReport)** for PR 18940 at commit

[GitHub] spark issue #18943: [SPARK-21731][build][test-maven] Upgrade scalastyle to 0...

Github user vanzin commented on the issue: https://github.com/apache/spark/pull/18943 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18940: [SPARK-21501] Change CacheLoader to limit entries based ...

Github user redsanket commented on the issue: https://github.com/apache/spark/pull/18940 @kiszk I dont think that would be ideal, it is better to backport the feature itself to a desired version or branch, having two conflicting configs for the same task is not ideal, if that is what

[GitHub] spark issue #18947: [SPARK-21721][SQL][Backport-2.1] Clear FileSystem delete...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18947 @viirya Could you close it? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18930: [SPARK-21677][SQL] json_tuple throws NullPointException ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18930 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80688/ Test PASSed. ---

[GitHub] spark issue #18421: [SPARK-21213][SQL] Support collecting partition-level st...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18421 This is just to make it consistent with the partition spec in our current INSERT statement. Could you justify why we need to make them inconsistent? Thanks! Also cc @sameeragarwal

[GitHub] spark issue #18930: [SPARK-21677][SQL] json_tuple throws NullPointException ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18930 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18949: [SPARK-12961][CORE][FOLLOW-UP] Remove wrapper code for S...

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18949 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #18940: [SPARK-21501] Change CacheLoader to limit entries based ...

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18940 @redsanket I am thinking about the case that the same configuration file, which explicitly sets a value (e.g. 4096) into `spark.shuffle.service.index.cache.entries`, is used in Spark 2.3. The

[GitHub] spark issue #18641: [SPARK-21413][SQL] Fix 64KB JVM bytecode limit problem i...

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18641 ping @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #18798: [SPARK-19634][ML] Multivariate summarizer - dataframes A...

Github user thunterdb commented on the issue: https://github.com/apache/spark/pull/18798 Thank you @yanboliang. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18940: SPARK-21501 Change CacheLoader to limit entries based on...

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18940 I like this feature. For backward compatibility, how about referring to `spark.shuffle.service.index.cache.entries` only if `spark.shuffle.service.index.cache.entries` is explicitly declared.

[GitHub] spark issue #18907: [SPARK-18464][SQL][followup] support old table which doe...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18907 Thanks! Merging to master. Hit conflicts when trying to merge to the previous versions. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #18943: [SPARK-21731][build][test-maven] Upgrade scalastyle to 0...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18943 **[Test build #80692 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80692/testReport)** for PR 18943 at commit

[GitHub] spark issue #18951: [SPARK-21738] Thriftserver doesn't cancel jobs when sess...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18951 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #18952: [MINOR] Fix a typo in the method name `UserDefine...

GitHub user jiangxb1987 opened a pull request: https://github.com/apache/spark/pull/18952 [MINOR] Fix a typo in the method name `UserDefinedFunction.asNonNullabe` ## What changes were proposed in this pull request? The method name `asNonNullabe` should be `asNonNullable`.

[GitHub] spark issue #18947: [SPARK-21721][SQL][Backport-2.1] Clear FileSystem delete...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18947 LGTM Merging to 2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #18907: [SPARK-18464][SQL][followup] support old table which doe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18907 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80682/ Test PASSed. ---

[GitHub] spark issue #18907: [SPARK-18464][SQL][followup] support old table which doe...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18907 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18329: [SPARK-19909][SS] Disabling the usage of a temporary dir...

Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/18329 @zsxwing @tdas any comment on this? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #18849: [SPARK-21617][SQL] Store correct table metadata w...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/18849#discussion_r133236101 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -342,6 +359,12 @@ private[spark] class

[GitHub] spark pull request #18266: [SPARK-20427][SQL] Read JDBC table use custom sch...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18266#discussion_r133235997 --- Diff: external/docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/OracleIntegrationSuite.scala --- @@ -268,4 +275,44 @@ class

[GitHub] spark pull request #18266: [SPARK-20427][SQL] Read JDBC table use custom sch...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18266#discussion_r133239835 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRelation.scala --- @@ -111,7 +111,22 @@ private[sql] case class

[GitHub] spark pull request #18266: [SPARK-20427][SQL] Read JDBC table use custom sch...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18266#discussion_r133239924 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRelation.scala --- @@ -111,7 +111,22 @@ private[sql] case class

[GitHub] spark pull request #18640: [SPARK-21422][BUILD] Depend on Apache ORC 1.4.0

Github user omalley commented on a diff in the pull request: https://github.com/apache/spark/pull/18640#discussion_r133248648 --- Diff: sql/core/pom.xml --- @@ -87,6 +87,16 @@ + org.apache.orc + orc-core + ${orc.classifier}

[GitHub] spark issue #18940: [SPARK-21501] Change CacheLoader to limit entries based ...

Github user vanzin commented on the issue: https://github.com/apache/spark/pull/18940 If you're removing a public config, you should at least add it to `SparkConf.deprecatedConfigs`. It would be nice, but not required, to have some kind of mapping of the old value to the new (in

[GitHub] spark issue #18946: [SPARK-19471][SQL]AggregationIterator does not initializ...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18946 LGTM Thanks! Merging to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17373: [SPARK-12664][ML] Expose probability in mlp model

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17373 **[Test build #80689 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80689/testReport)** for PR 17373 at commit

[GitHub] spark pull request #18951: [SPARK-21738] Thriftserver doesn't cancel jobs wh...

GitHub user mgaido91 opened a pull request: https://github.com/apache/spark/pull/18951 [SPARK-21738] Thriftserver doesn't cancel jobs when session is closed ## What changes were proposed in this pull request? When a session is closed the Thriftserver doesn't cancel the jobs

[GitHub] spark pull request #18266: [SPARK-20427][SQL] Read JDBC table use custom sch...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18266#discussion_r133235311 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala --- @@ -197,11 +197,13 @@ class DataFrameReader private[sql](sparkSession:

[GitHub] spark issue #18940: [SPARK-21501] Change CacheLoader to limit entries based ...

Github user redsanket commented on the issue: https://github.com/apache/spark/pull/18940 @kiszk wouldn't the updated release notes/docs take care of that, which configs can no longer be used and which are not. I don't mind adding a warning msg saying please use another cache.size

[GitHub] spark issue #18950: [SPARK-20589][Core][Scheduler] Allow limiting task concu...

Github user dhruve commented on the issue: https://github.com/apache/spark/pull/18950 @kayousterhout @squito Can you review this PR ? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #18592: [SPARK-21368][SQL] TPCDSQueryBenchmark can't refer query...

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18592 gentle ping @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18950: [SPARK-20589][Core][Scheduler] Allow limiting task concu...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18950 **[Test build #80690 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80690/testReport)** for PR 18950 at commit

[GitHub] spark issue #18488: [SPARK-21255][SQL][WIP] Fixed NPE when creating encoder ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18488 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80685/ Test FAILed. ---

[GitHub] spark issue #18488: [SPARK-21255][SQL][WIP] Fixed NPE when creating encoder ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18488 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18488: [SPARK-21255][SQL][WIP] Fixed NPE when creating encoder ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18488 **[Test build #80685 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80685/testReport)** for PR 18488 at commit

[GitHub] spark issue #18942: [BACKPORT-2.1][SPARK-19372][SQL] Fix throwing a Java exc...

Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18942 @poplav it looks good @gatorsmile Do you think it is ok for backport now? The previous commit included unnecessary changes. --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #18950: [SPARK-20589][Core][Scheduler] Allow limiting task concu...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18950 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18950: [SPARK-20589][Core][Scheduler] Allow limiting task concu...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18950 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80690/ Test PASSed. ---

[GitHub] spark issue #18787: [SPARK-21583][SQL] Create a ColumnarBatch from ArrowColu...

Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18787 Yes, I agree with changing the interfaces as you suggest @cloud-fan , is there currently a JIRA open for that? I'm ok with holding off if it's planned to be soon, but I would like to get

[GitHub] spark issue #18940: [SPARK-21501] Change CacheLoader to limit entries based ...

Github user redsanket commented on the issue: https://github.com/apache/spark/pull/18940 Thanks @vanzin @kiszk will do, makes sense to me now --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #18519: [SPARK-16742] Mesos Kerberos Support

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/18519#discussion_r133290641 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala --- @@ -95,6 +99,12 @@ class

[GitHub] spark pull request #18887: [SPARK-20642][core] Store FsHistoryProvider listi...

Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/18887#discussion_r133316362 --- Diff: scalastyle-config.xml --- @@ -86,7 +86,7 @@ This file is divided into 3 sections: - + --- End diff --

[GitHub] spark pull request #18887: [SPARK-20642][core] Store FsHistoryProvider listi...

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/18887#discussion_r133319377 --- Diff: docs/monitoring.md --- @@ -220,6 +220,13 @@ The history server can be configured as follows: Number of threads that will be used by

[GitHub] spark pull request #15770: [SPARK-15784][ML]:Add Power Iteration Clustering ...

Github user wangmiao1981 commented on a diff in the pull request: https://github.com/apache/spark/pull/15770#discussion_r133271527 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/PowerIterationClustering.scala --- @@ -0,0 +1,213 @@ +/* + * Licensed to the

[GitHub] spark issue #18849: [SPARK-21617][SQL] Store correct table metadata when alt...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18849 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80694/ Test PASSed. ---

[GitHub] spark issue #18849: [SPARK-21617][SQL] Store correct table metadata when alt...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18849 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15770: [SPARK-15784][ML]:Add Power Iteration Clustering to spar...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15770 **[Test build #80698 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80698/testReport)** for PR 15770 at commit

[GitHub] spark issue #15770: [SPARK-15784][ML]:Add Power Iteration Clustering to spar...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15770 **[Test build #80699 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80699/testReport)** for PR 15770 at commit

[GitHub] spark issue #15770: [SPARK-15784][ML]:Add Power Iteration Clustering to spar...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15770 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18950: [SPARK-20589][Core][Scheduler] Allow limiting tas...

Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/18950#discussion_r133311545 --- Diff: core/src/main/scala/org/apache/spark/ExecutorAllocationManager.scala --- @@ -602,6 +604,21 @@ private[spark] class ExecutorAllocationManager(

[GitHub] spark issue #15770: [SPARK-15784][ML]:Add Power Iteration Clustering to spar...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15770 **[Test build #80702 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80702/testReport)** for PR 15770 at commit

[GitHub] spark issue #15770: [SPARK-15784][ML]:Add Power Iteration Clustering to spar...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15770 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15770: [SPARK-15784][ML]:Add Power Iteration Clustering to spar...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15770 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80702/ Test FAILed. ---

[GitHub] spark issue #18940: [SPARK-21501] Change CacheLoader to limit entries based ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18940 **[Test build #80691 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/80691/testReport)** for PR 18940 at commit

[GitHub] spark issue #18942: [BACKPORT-2.1][SPARK-19372][SQL] Fix throwing a Java exc...

Github user poplav commented on the issue: https://github.com/apache/spark/pull/18942 Was this working in 2.0 in the first place? I want to get this into 2.1.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #18519: [SPARK-16742] Mesos Kerberos Support

Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/18519#discussion_r133290499 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala --- @@ -95,6 +99,12 @@ class

[GitHub] spark issue #15770: [SPARK-15784][ML]:Add Power Iteration Clustering to spar...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15770 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/80699/ Test FAILed. ---

[GitHub] spark issue #15770: [SPARK-15784][ML]:Add Power Iteration Clustering to spar...

Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/15770 Jenkins, retest please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

  1   2   3   4   5   >