[jira] [Updated] (SPARK-19007) Speedup and optimize the GradientBoostedTrees in the "data>memory" scene

[ https://issues.apache.org/jira/browse/SPARK-19007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangdenghui updated SPARK-19007: - Description: Test data：80G CTR training data from

[jira] [Updated] (SPARK-19004) Fix `JDBCWriteSuite.testH2Dialect` by removing `getCatalystType`

[ https://issues.apache.org/jira/browse/SPARK-19004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-19004: -- Description: JDBCSuite and JDBCWriterSuite have its own testH2Dialect for their testing

[jira] [Updated] (SPARK-19004) Fix `JDBCWriteSuite.testH2Dialect` by removing `getCatalystType`

[ https://issues.apache.org/jira/browse/SPARK-19004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-19004: -- Summary: Fix `JDBCWriteSuite.testH2Dialect` by removing `getCatalystType` (was: Fix

[jira] [Assigned] (SPARK-19007) Speedup and optimize the GradientBoostedTrees in the "data>memory" scene

[ https://issues.apache.org/jira/browse/SPARK-19007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19007: Assignee: Apache Spark > Speedup and optimize the GradientBoostedTrees in the

[jira] [Commented] (SPARK-19007) Speedup and optimize the GradientBoostedTrees in the "data>memory" scene

[ https://issues.apache.org/jira/browse/SPARK-19007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779790#comment-15779790 ] Apache Spark commented on SPARK-19007: -- User 'zdh2292390' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19007) Speedup and optimize the GradientBoostedTrees in the "data>memory" scene

[ https://issues.apache.org/jira/browse/SPARK-19007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19007: Assignee: (was: Apache Spark) > Speedup and optimize the GradientBoostedTrees in the

[jira] [Commented] (SPARK-15044) spark-sql will throw "input path does not exist" exception if it handles a partition which exists in hive table, but the path is removed manually

[ https://issues.apache.org/jira/browse/SPARK-15044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779766#comment-15779766 ] Yuming Wang commented on SPARK-15044: - I've tested on v2.1.0-rc5, it works fine if

[jira] [Assigned] (SPARK-19009) Add doc for Streaming Rest API

[ https://issues.apache.org/jira/browse/SPARK-19009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19009: Assignee: (was: Apache Spark) > Add doc for Streaming Rest API >

[jira] [Commented] (SPARK-19009) Add doc for Streaming Rest API

[ https://issues.apache.org/jira/browse/SPARK-19009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779762#comment-15779762 ] Apache Spark commented on SPARK-19009: -- User 'uncleGen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19009) Add doc for Streaming Rest API

[ https://issues.apache.org/jira/browse/SPARK-19009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19009: Assignee: Apache Spark > Add doc for Streaming Rest API > --

[jira] [Commented] (SPARK-18710) Add offset to GeneralizedLinearRegression models

[ https://issues.apache.org/jira/browse/SPARK-18710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779760#comment-15779760 ] Wayne Zhang commented on SPARK-18710: - Thanks for the comment, Yanbo. In IRLS, the fit method expects

[jira] [Created] (SPARK-19009) Add doc for Streaming Rest API

Genmao Yu created SPARK-19009: - Summary: Add doc for Streaming Rest API Key: SPARK-19009 URL: https://issues.apache.org/jira/browse/SPARK-19009 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-19007) Speedup and optimize the GradientBoostedTrees in the "data>memory" scene

[ https://issues.apache.org/jira/browse/SPARK-19007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangdenghui updated SPARK-19007: - Description: Test data：80G CTR training data from

[jira] [Commented] (SPARK-18955) Add ability to emit kafka events to DStream or KafkaDStream

[ https://issues.apache.org/jira/browse/SPARK-18955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779554#comment-15779554 ] Russell Jurney commented on SPARK-18955: Can I please get feedback as to whether this patch would

[jira] [Commented] (SPARK-19008) Avoid boxing/unboxing overhead of calling a lambda with primitive type from Dataset program

[ https://issues.apache.org/jira/browse/SPARK-19008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779544#comment-15779544 ] Kazuaki Ishizaki commented on SPARK-19008: -- I will work for this > Avoid boxing/unboxing

[jira] [Updated] (SPARK-19008) Avoid boxing/unboxing overhead of calling a lambda with primitive type from Dataset program

[ https://issues.apache.org/jira/browse/SPARK-19008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-19008: - Description: In a

[jira] [Created] (SPARK-19008) Avoid boxing/unboxing overhead of calling a lambda with primitive type from Dataset program

Kazuaki Ishizaki created SPARK-19008: Summary: Avoid boxing/unboxing overhead of calling a lambda with primitive type from Dataset program Key: SPARK-19008 URL:

[jira] [Updated] (SPARK-19007) Speedup and optimize the GradientBoostedTrees in the "data>memory" scene

[ https://issues.apache.org/jira/browse/SPARK-19007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangdenghui updated SPARK-19007: - Description: Test data：80G CTR training data from

[jira] [Created] (SPARK-19007) Speedup and optimize the GradientBoostedTrees in the "data>memory" scene

zhangdenghui created SPARK-19007: Summary: Speedup and optimize the GradientBoostedTrees in the "data>memory" scene Key: SPARK-19007 URL: https://issues.apache.org/jira/browse/SPARK-19007 Project:

[jira] [Commented] (SPARK-18931) Create empty staging directory in partitioned table on insert

[ https://issues.apache.org/jira/browse/SPARK-18931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779439#comment-15779439 ] Hyukjin Kwon commented on SPARK-18931: -- Could we resolve this as a duplicate? > Create empty

[jira] [Commented] (SPARK-3528) Reading data from file:/// should be called NODE_LOCAL not PROCESS_LOCAL

[ https://issues.apache.org/jira/browse/SPARK-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779436#comment-15779436 ] Umesh Chaudhary commented on SPARK-3528: [~gip] looks like when we provide file:/// as URI,

[jira] [Commented] (SPARK-18997) Recommended upgrade libthrift to 0.9.3

[ https://issues.apache.org/jira/browse/SPARK-18997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779389#comment-15779389 ] meiyoula commented on SPARK-18997: -- I think it is mainly consist in Hive. Now Hive has upgrade to 0.9.3

[jira] [Updated] (SPARK-19002) Check pep8 against dev/*.py scripts

[ https://issues.apache.org/jira/browse/SPARK-19002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-19002: - Summary: Check pep8 against dev/*.py scripts (was: Check pep8 against merge_spark_pr.py script)

[jira] [Updated] (SPARK-19002) Check pep8 against dev/*.py scripts

[ https://issues.apache.org/jira/browse/SPARK-19002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-19002: - Description: We can check pep8 against dev/*.py scripts. There are already several python

[jira] [Assigned] (SPARK-19006) should mentioned the max value allowed for spark.kryoserializer.buffer.max in doc

[ https://issues.apache.org/jira/browse/SPARK-19006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19006: Assignee: Apache Spark > should mentioned the max value allowed for

[jira] [Assigned] (SPARK-19006) should mentioned the max value allowed for spark.kryoserializer.buffer.max in doc

[ https://issues.apache.org/jira/browse/SPARK-19006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19006: Assignee: (was: Apache Spark) > should mentioned the max value allowed for

[jira] [Commented] (SPARK-19006) should mentioned the max value allowed for spark.kryoserializer.buffer.max in doc

[ https://issues.apache.org/jira/browse/SPARK-19006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779334#comment-15779334 ] Apache Spark commented on SPARK-19006: -- User 'cnZach' has created a pull request for this issue:

[jira] [Updated] (SPARK-19006) should mentioned the max value allowed for spark.kryoserializer.buffer.max in doc

[ https://issues.apache.org/jira/browse/SPARK-19006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuexin Zhang updated SPARK-19006: - Description: On configuration doc page:https://spark.apache.org/docs/latest/configuration.html

[jira] [Commented] (SPARK-17984) Add support for numa aware feature

[ https://issues.apache.org/jira/browse/SPARK-17984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779305#comment-15779305 ] Apache Spark commented on SPARK-17984: -- User 'xiaochang-wu' has created a pull request for this

[jira] [Created] (SPARK-19006) should mentioned the max value allowed for spark.kryoserializer.buffer.max in doc

Yuexin Zhang created SPARK-19006: Summary: should mentioned the max value allowed for spark.kryoserializer.buffer.max in doc Key: SPARK-19006 URL: https://issues.apache.org/jira/browse/SPARK-19006

[jira] [Commented] (SPARK-14083) Analyze JVM bytecode and turn closures into Catalyst expressions

[ https://issues.apache.org/jira/browse/SPARK-14083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779288#comment-15779288 ] Kazuaki Ishizaki commented on SPARK-14083: --

[jira] [Assigned] (SPARK-19005) Keep column ordering when a schema is explicitly specified

[ https://issues.apache.org/jira/browse/SPARK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19005: Assignee: Apache Spark > Keep column ordering when a schema is explicitly specified >

[jira] [Commented] (SPARK-19005) Keep column ordering when a schema is explicitly specified

[ https://issues.apache.org/jira/browse/SPARK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779235#comment-15779235 ] Apache Spark commented on SPARK-19005: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19005) Keep column ordering when a schema is explicitly specified

[ https://issues.apache.org/jira/browse/SPARK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19005: Assignee: (was: Apache Spark) > Keep column ordering when a schema is explicitly

[jira] [Created] (SPARK-19005) Keep column ordering when a schema is explicitly specified

Takeshi Yamamuro created SPARK-19005: Summary: Keep column ordering when a schema is explicitly specified Key: SPARK-19005 URL: https://issues.apache.org/jira/browse/SPARK-19005 Project: Spark

[jira] [Commented] (SPARK-18991) Change ContextCleaner.referenceBuffer to ConcurrentHashMap to make it faster

[ https://issues.apache.org/jira/browse/SPARK-18991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15779002#comment-15779002 ] Shixiong Zhu commented on SPARK-18991: -- [~prashant_] FYI, this may also be necessary for your Kafka

[jira] [Commented] (SPARK-18997) Recommended upgrade libthrift to 0.9.3

[ https://issues.apache.org/jira/browse/SPARK-18997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15778946#comment-15778946 ] Dongjoon Hyun commented on SPARK-18997: --- +1 > Recommended upgrade libthrift to 0.9.3 >

[jira] [Comment Edited] (SPARK-19000) Spark beeline: table was created at default database even though specifing a database name

[ https://issues.apache.org/jira/browse/SPARK-19000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15778943#comment-15778943 ] Dongjoon Hyun edited comment on SPARK-19000 at 12/26/16 8:32 PM: - Thank

[jira] [Resolved] (SPARK-19000) Spark beeline: table was created at default database even though specifing a database name

[ https://issues.apache.org/jira/browse/SPARK-19000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-19000. --- Resolution: Duplicate > Spark beeline: table was created at default database even though

[jira] [Commented] (SPARK-19000) Spark beeline: table was created at default database even though specifing a database name

[ https://issues.apache.org/jira/browse/SPARK-19000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15778943#comment-15778943 ] Dongjoon Hyun commented on SPARK-19000: --- Thank you for reporting, [~ouyangxc]. Yep. It was correct.

[jira] [Resolved] (SPARK-18989) DESC TABLE should not fail with format class not found

[ https://issues.apache.org/jira/browse/SPARK-18989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-18989. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16388

[jira] [Assigned] (SPARK-19004) Fix `testH2Dialect` by removing `getCatalystType`

[ https://issues.apache.org/jira/browse/SPARK-19004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19004: Assignee: (was: Apache Spark) > Fix `testH2Dialect` by removing `getCatalystType` >

[jira] [Commented] (SPARK-19004) Fix `testH2Dialect` by removing `getCatalystType`

[ https://issues.apache.org/jira/browse/SPARK-19004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15778847#comment-15778847 ] Apache Spark commented on SPARK-19004: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-19004) Fix `testH2Dialect` by removing `getCatalystType`

[ https://issues.apache.org/jira/browse/SPARK-19004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19004: Assignee: Apache Spark > Fix `testH2Dialect` by removing `getCatalystType` >

[jira] [Created] (SPARK-19004) Fix `testH2Dialect` by removing `getCatalystType`

Dongjoon Hyun created SPARK-19004: - Summary: Fix `testH2Dialect` by removing `getCatalystType` Key: SPARK-19004 URL: https://issues.apache.org/jira/browse/SPARK-19004 Project: Spark Issue

[jira] [Assigned] (SPARK-19003) Add Java examples in "Spark Streaming Guide", section "Design Patterns for using foreachRDD"

[ https://issues.apache.org/jira/browse/SPARK-19003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19003: Assignee: (was: Apache Spark) > Add Java examples in "Spark Streaming Guide",

[jira] [Commented] (SPARK-19003) Add Java examples in "Spark Streaming Guide", section "Design Patterns for using foreachRDD"

[ https://issues.apache.org/jira/browse/SPARK-19003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15778698#comment-15778698 ] Apache Spark commented on SPARK-19003: -- User 'adesharatushar' has created a pull request for this

[jira] [Assigned] (SPARK-19003) Add Java examples in "Spark Streaming Guide", section "Design Patterns for using foreachRDD"

[ https://issues.apache.org/jira/browse/SPARK-19003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19003: Assignee: Apache Spark > Add Java examples in "Spark Streaming Guide", section "Design

[jira] [Commented] (SPARK-19003) Add Java examples in "Spark Streaming Guide", section "Design Patterns for using foreachRDD"

[ https://issues.apache.org/jira/browse/SPARK-19003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15778699#comment-15778699 ] Tushar Adeshara commented on SPARK-19003: - Pull request

[jira] [Created] (SPARK-19003) Add Java examples in "Spark Streaming Guide", section "Design Patterns for using foreachRDD"

Tushar Adeshara created SPARK-19003: --- Summary: Add Java examples in "Spark Streaming Guide", section "Design Patterns for using foreachRDD" Key: SPARK-19003 URL:

[jira] [Resolved] (SPARK-18980) implement Aggregator with TypedImperativeAggregate

[ https://issues.apache.org/jira/browse/SPARK-18980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-18980. - Resolution: Fixed Fix Version/s: 2.2.0 > implement Aggregator with

[jira] [Updated] (SPARK-19001) Worker will submit multiply CleanWorkDir and SendHeartbeat task with each RegisterWorker response

[ https://issues.apache.org/jira/browse/SPARK-19001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-19001: --- Description: h2. scene worker will submit multiply task of SendHeartbeat and CleanWorkDir if the

[jira] [Commented] (SPARK-19001) Worker will submit multiply CleanWorkDir and SendHeartbeat task with each RegisterWorker response

[ https://issues.apache.org/jira/browse/SPARK-19001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15778382#comment-15778382 ] Apache Spark commented on SPARK-19001: -- User 'liujianhuiouc' has created a pull request for this

[jira] [Assigned] (SPARK-19001) Worker will submit multiply CleanWorkDir and SendHeartbeat task with each RegisterWorker response

[ https://issues.apache.org/jira/browse/SPARK-19001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19001: Assignee: (was: Apache Spark) > Worker will submit multiply CleanWorkDir and

[jira] [Assigned] (SPARK-19001) Worker will submit multiply CleanWorkDir and SendHeartbeat task with each RegisterWorker response

[ https://issues.apache.org/jira/browse/SPARK-19001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19001: Assignee: Apache Spark > Worker will submit multiply CleanWorkDir and SendHeartbeat task

[jira] [Assigned] (SPARK-19002) Check pep8 against merge_spark_pr.py script

[ https://issues.apache.org/jira/browse/SPARK-19002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19002: Assignee: (was: Apache Spark) > Check pep8 against merge_spark_pr.py script >

[jira] [Assigned] (SPARK-19002) Check pep8 against merge_spark_pr.py script

[ https://issues.apache.org/jira/browse/SPARK-19002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19002: Assignee: Apache Spark > Check pep8 against merge_spark_pr.py script >

[jira] [Commented] (SPARK-19002) Check pep8 against merge_spark_pr.py script

[ https://issues.apache.org/jira/browse/SPARK-19002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15778313#comment-15778313 ] Apache Spark commented on SPARK-19002: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-19002) Check pep8 against merge_spark_pr.py script

Hyukjin Kwon created SPARK-19002: Summary: Check pep8 against merge_spark_pr.py script Key: SPARK-19002 URL: https://issues.apache.org/jira/browse/SPARK-19002 Project: Spark Issue Type:

[jira] [Created] (SPARK-19001) Worker will submit multiply CleanWorkDir and SendHeartbeat task with each RegisterWorker response

liujianhui created SPARK-19001: -- Summary: Worker will submit multiply CleanWorkDir and SendHeartbeat task with each RegisterWorker response Key: SPARK-19001 URL: https://issues.apache.org/jira/browse/SPARK-19001

[jira] [Created] (SPARK-19000) Spark beeline: table was created at default database even though specifing a database name

Xiaochen Ouyang created SPARK-19000: --- Summary: Spark beeline: table was created at default database even though specifing a database name Key: SPARK-19000 URL:

[jira] [Commented] (SPARK-18969) PullOutNondeterministic should work for Aggregate operator

[ https://issues.apache.org/jira/browse/SPARK-18969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15778112#comment-15778112 ] Apache Spark commented on SPARK-18969: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18819) Double alignment on ARM71 platform

[ https://issues.apache.org/jira/browse/SPARK-18819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18819: Assignee: (was: Apache Spark) > Double alignment on ARM71 platform >

[jira] [Assigned] (SPARK-18819) Double alignment on ARM71 platform

[ https://issues.apache.org/jira/browse/SPARK-18819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18819: Assignee: Apache Spark > Double alignment on ARM71 platform >

[jira] [Commented] (SPARK-18819) Double alignment on ARM71 platform

[ https://issues.apache.org/jira/browse/SPARK-18819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15778107#comment-15778107 ] Apache Spark commented on SPARK-18819: -- User 'michaelkamprath' has created a pull request for this

[jira] [Commented] (SPARK-18857) SparkSQL ThriftServer hangs while extracting huge data volumes in incremental collect mode

[ https://issues.apache.org/jira/browse/SPARK-18857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15778011#comment-15778011 ] vishal agrawal commented on SPARK-18857: we have built Spark from 2.0.2 source code by changing