[jira] [Assigned] (SPARK-21934) Expose Netty memory usage via Metrics System

2017-09-20 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao reassigned SPARK-21934: --- Assignee: Saisai Shao > Expose Netty memory usage via Metrics System >

[jira] [Resolved] (SPARK-21934) Expose Netty memory usage via Metrics System

2017-09-20 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao resolved SPARK-21934. - Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19160

[jira] [Updated] (SPARK-22084) Performance regression in aggregation strategy

2017-09-20 Thread StanZhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] StanZhai updated SPARK-22084: - Labels: performance (was: ) > Performance regression in aggregation strategy >

[jira] [Updated] (SPARK-22084) Performance regression in aggregation strategy

2017-09-20 Thread StanZhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] StanZhai updated SPARK-22084: - Description: {code:sql} SELECT a, SUM(b) AS b0, SUM(b) AS b1 FROM VALUES(1, 1), (2, 2) AS (a, b) GROUP

[jira] [Created] (SPARK-22084) Performance regression in aggregation strategy

2017-09-20 Thread StanZhai (JIRA)
StanZhai created SPARK-22084: Summary: Performance regression in aggregation strategy Key: SPARK-22084 URL: https://issues.apache.org/jira/browse/SPARK-22084 Project: Spark Issue Type:

[jira] [Updated] (SPARK-22083) When dropping multiple blocks to disk, Spark should release all locks on a failure

2017-09-20 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-22083: - Summary: When dropping multiple blocks to disk, Spark should release all locks on a failure

[jira] [Commented] (SPARK-21928) ML LogisticRegression training occasionally produces java.lang.ClassNotFoundException when attempting to load custom Kryo registrator class

2017-09-20 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16174247#comment-16174247 ] Imran Rashid commented on SPARK-21928: -- I believe I figured out why things get stuck sometimes,

[jira] [Created] (SPARK-22083) When dropping multiple locks to disk, Spark should release all locks on a failure

2017-09-20 Thread Imran Rashid (JIRA)
Imran Rashid created SPARK-22083: Summary: When dropping multiple locks to disk, Spark should release all locks on a failure Key: SPARK-22083 URL: https://issues.apache.org/jira/browse/SPARK-22083

[jira] [Commented] (SPARK-22070) Spark SQL filter comparisons failing with timestamps and ISO-8601 strings

2017-09-20 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16174220#comment-16174220 ] Yuming Wang commented on SPARK-22070: - cc [~smilegator] > Spark SQL filter comparisons failing with

[jira] [Commented] (SPARK-22070) Spark SQL filter comparisons failing with timestamps and ISO-8601 strings

2017-09-20 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16174212#comment-16174212 ] Yuming Wang commented on SPARK-22070: - This can be fixed by my PR:

[jira] [Resolved] (SPARK-22082) Spelling mistake: choosen in API doc of R

2017-09-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22082. --- Resolution: Invalid As mentioned before, don't make JIRAs for a single typo, the most trivial of

[jira] [Assigned] (SPARK-22082) Spelling mistake: choosen in API doc of R

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22082: Assignee: Apache Spark > Spelling mistake: choosen in API doc of R >

[jira] [Commented] (SPARK-22082) Spelling mistake: choosen in API doc of R

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16174132#comment-16174132 ] Apache Spark commented on SPARK-22082: -- User 'zuotingbing' has created a pull request for this

[jira] [Assigned] (SPARK-22082) Spelling mistake: choosen in API doc of R

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22082: Assignee: (was: Apache Spark) > Spelling mistake: choosen in API doc of R >

[jira] [Updated] (SPARK-22082) Spelling mistake: choosen in API doc of R

2017-09-20 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-22082: Component/s: (was: MLlib) SparkR > Spelling mistake: choosen in API doc of R

[jira] [Updated] (SPARK-22082) Spelling mistake: choosen in API doc of R

2017-09-20 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-22082: Description: "choosen" should be "chosen" in API doc of R.

[jira] [Updated] (SPARK-22082) Spelling mistake: choosen in API doc of R

2017-09-20 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-22082: Attachment: 2017-09-21_100940.png > Spelling mistake: choosen in API doc of R >

[jira] [Created] (SPARK-22082) Spelling mistake: choosen in API doc of R

2017-09-20 Thread zuotingbing (JIRA)
zuotingbing created SPARK-22082: --- Summary: Spelling mistake: choosen in API doc of R Key: SPARK-22082 URL: https://issues.apache.org/jira/browse/SPARK-22082 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-22076) Expand.projections should not be a Stream

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16174040#comment-16174040 ] Apache Spark commented on SPARK-22076: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Resolved] (SPARK-21384) Spark 2.2 + YARN without spark.yarn.jars / spark.yarn.archive fails

2017-09-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-21384. Resolution: Fixed Assignee: Devaraj K Fix Version/s: 2.3.0

[jira] [Updated] (SPARK-22081) Generalized Reduced Error Logistic Regression

2017-09-20 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SPARK-22081: -- Description: Our SAS gurus are saying they would love to have "Generalized Reduced

[jira] [Updated] (SPARK-22081) Generalized Reduced Error Logistic Regression

2017-09-20 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Dautkhanov updated SPARK-22081: -- Attachment: RELR.GIF > Generalized Reduced Error Logistic Regression >

[jira] [Commented] (SPARK-18838) High latency of event processing for large jobs

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173900#comment-16173900 ] Apache Spark commented on SPARK-18838: -- User 'vanzin' has created a pull request for this issue:

[jira] [Created] (SPARK-22081) Generalized Reduced Error Logistic Regression

2017-09-20 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created SPARK-22081: - Summary: Generalized Reduced Error Logistic Regression Key: SPARK-22081 URL: https://issues.apache.org/jira/browse/SPARK-22081 Project: Spark

[jira] [Commented] (SPARK-21549) Spark fails to complete job correctly in case of OutputFormat which do not write into hdfs

2017-09-20 Thread Sergey Zhemzhitsky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173755#comment-16173755 ] Sergey Zhemzhitsky commented on SPARK-21549: [~ste...@apache.org] I've updated PR to prevent

[jira] [Comment Edited] (SPARK-12823) Cannot create UDF with StructType input

2017-09-20 Thread Simeon H.K. Fitch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173702#comment-16173702 ] Simeon H.K. Fitch edited comment on SPARK-12823 at 9/20/17 7:16 PM:

[jira] [Commented] (SPARK-12823) Cannot create UDF with StructType input

2017-09-20 Thread Simeon H.K. Fitch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173702#comment-16173702 ] Simeon H.K. Fitch commented on SPARK-12823: --- As a coda, it's interesting to note that you can

[jira] [Commented] (SPARK-12297) Add work-around for Parquet/Hive int96 timestamp bug.

2017-09-20 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173701#comment-16173701 ] Imran Rashid commented on SPARK-12297: -- In case anyone took a look at the design doc I posted a few

[jira] [Updated] (SPARK-14371) OnlineLDAOptimizer should not collect stats for each doc in mini-batch to driver

2017-09-20 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14371: -- Shepherd: Joseph K. Bradley > OnlineLDAOptimizer should not collect stats for each doc

[jira] [Commented] (SPARK-21549) Spark fails to complete job correctly in case of OutputFormat which do not write into hdfs

2017-09-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173449#comment-16173449 ] Steve Loughran commented on SPARK-21549: The {{newTaskTempFileAbsPath()}} method is an

[jira] [Resolved] (SPARK-22076) Expand.projections should not be a Stream

2017-09-20 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22076. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 > Expand.projections should not

[jira] [Commented] (SPARK-22080) Allow developers to add pre-optimisation rules

2017-09-20 Thread Sathiya Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173313#comment-16173313 ] Sathiya Kumar commented on SPARK-22080: --- Here is a PR with the proposed changes:

[jira] [Commented] (SPARK-22080) Allow developers to add pre-optimisation rules

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173309#comment-16173309 ] Apache Spark commented on SPARK-22080: -- User 'sathiyapk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22080) Allow developers to add pre-optimisation rules

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22080: Assignee: (was: Apache Spark) > Allow developers to add pre-optimisation rules >

[jira] [Assigned] (SPARK-22080) Allow developers to add pre-optimisation rules

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22080: Assignee: Apache Spark > Allow developers to add pre-optimisation rules >

[jira] [Updated] (SPARK-22072) Allow the same shell params to be used for all of the different steps in release-build

2017-09-20 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-22072: Description: The jenkins script currently sets SPARK_VERSION to different values depending on what action

[jira] [Updated] (SPARK-22072) Allow the same shell params to be used for all of the different steps in release-build

2017-09-20 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-22072: Summary: Allow the same shell params to be used for all of the different steps in release-build (was:

[jira] [Updated] (SPARK-22080) Allow developers to add pre-optimisation rules

2017-09-20 Thread Sathiya Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sathiya Kumar updated SPARK-22080: -- Description: [SPARK-9843] added support for adding custom rules for optimising LogicalPlan,

[jira] [Created] (SPARK-22080) Allow developers to add pre-optimisation rules

2017-09-20 Thread Sathiya Kumar (JIRA)
Sathiya Kumar created SPARK-22080: - Summary: Allow developers to add pre-optimisation rules Key: SPARK-22080 URL: https://issues.apache.org/jira/browse/SPARK-22080 Project: Spark Issue Type:

[jira] [Commented] (SPARK-21935) Pyspark UDF causing ExecutorLostFailure

2017-09-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173249#comment-16173249 ] Sean Owen commented on SPARK-21935: --- Yes it seems like your tasks need more memory than the

[jira] [Commented] (SPARK-21549) Spark fails to complete job correctly in case of OutputFormat which do not write into hdfs

2017-09-20 Thread Sergey Zhemzhitsky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173184#comment-16173184 ] Sergey Zhemzhitsky commented on SPARK-21549: [~mridulm80], [~WeiqingYang],

[jira] [Commented] (SPARK-21549) Spark fails to complete job correctly in case of OutputFormat which do not write into hdfs

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173175#comment-16173175 ] Apache Spark commented on SPARK-21549: -- User 'szhem' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21549) Spark fails to complete job correctly in case of OutputFormat which do not write into hdfs

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21549: Assignee: (was: Apache Spark) > Spark fails to complete job correctly in case of

[jira] [Assigned] (SPARK-21549) Spark fails to complete job correctly in case of OutputFormat which do not write into hdfs

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21549: Assignee: Apache Spark > Spark fails to complete job correctly in case of OutputFormat

[jira] [Commented] (SPARK-10925) Exception when joining DataFrames

2017-09-20 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173139#comment-16173139 ] peay commented on SPARK-10925: -- Same issue on Spark 2.1.0. I have been working around this using

[jira] [Comment Edited] (SPARK-21935) Pyspark UDF causing ExecutorLostFailure

2017-09-20 Thread Nikolaos Tsipas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173110#comment-16173110 ] Nikolaos Tsipas edited comment on SPARK-21935 at 9/20/17 12:45 PM: ---

[jira] [Commented] (SPARK-21935) Pyspark UDF causing ExecutorLostFailure

2017-09-20 Thread Nikolaos Tsipas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173110#comment-16173110 ] Nikolaos Tsipas commented on SPARK-21935: - After a few trial and error iterations managed to find

[jira] [Assigned] (SPARK-22079) Serializer in HiveOutputWriter miss loading job configuration

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22079: Assignee: (was: Apache Spark) > Serializer in HiveOutputWriter miss loading job

[jira] [Commented] (SPARK-22079) Serializer in HiveOutputWriter miss loading job configuration

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173057#comment-16173057 ] Apache Spark commented on SPARK-22079: -- User 'LantaoJin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22079) Serializer in HiveOutputWriter miss loading job configuration

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22079: Assignee: Apache Spark > Serializer in HiveOutputWriter miss loading job configuration >

[jira] [Resolved] (SPARK-22049) Confusing behavior of from_utc_timestamp and to_utc_timestamp

2017-09-20 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22049. -- Resolution: Fixed Assignee: Sean Owen Fix Version/s: 2.3.0 Fixed in

[jira] [Created] (SPARK-22079) Serializer in HiveOutputWriter miss loading job configuration

2017-09-20 Thread Lantao Jin (JIRA)
Lantao Jin created SPARK-22079: -- Summary: Serializer in HiveOutputWriter miss loading job configuration Key: SPARK-22079 URL: https://issues.apache.org/jira/browse/SPARK-22079 Project: Spark

[jira] [Reopened] (SPARK-22020) Support session local timezone

2017-09-20 Thread Navya Krishnappa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navya Krishnappa reopened SPARK-22020: -- This is not working as expected. Please refer the above-mentioned description > Support

[jira] [Resolved] (SPARK-17159) Improve FileInputDStream.findNewFiles list performance

2017-09-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved SPARK-17159. Resolution: Won't Fix Based on the feedback of https://github.com/apache/spark/pull/14731

[jira] [Commented] (SPARK-22061) Add pipeline model of SVM

2017-09-20 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172983#comment-16172983 ] Weichen Xu commented on SPARK-22061: We already have `LinearSVC` and implemented by LBFGS which is

[jira] [Comment Edited] (SPARK-22075) GBTs forgot to unpersist datasets cached by Checkpointer

2017-09-20 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172859#comment-16172859 ] zhengruifeng edited comment on SPARK-22075 at 9/20/17 9:48 AM: --- -Same issue

[jira] [Updated] (SPARK-22075) GBTs forgot to unpersist datasets cached by Checkpointer

2017-09-20 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-22075: - Summary: GBTs forgot to unpersist datasets cached by Checkpointer (was: GBTs/Pregel forgot to

[jira] [Updated] (SPARK-22075) GBTs forgot to unpersist datasets cached by Checkpointer

2017-09-20 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-22075: - Component/s: (was: GraphX) > GBTs forgot to unpersist datasets cached by Checkpointer >

[jira] [Commented] (SPARK-22066) Update checkstyle to 8.2, enable it, fix violations

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172951#comment-16172951 ] Apache Spark commented on SPARK-22066: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22063) Upgrade lintr to latest commit sha1 ID

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22063: Assignee: (was: Apache Spark) > Upgrade lintr to latest commit sha1 ID >

[jira] [Assigned] (SPARK-22063) Upgrade lintr to latest commit sha1 ID

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22063: Assignee: Apache Spark > Upgrade lintr to latest commit sha1 ID >

[jira] [Commented] (SPARK-22063) Upgrade lintr to latest commit sha1 ID

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172950#comment-16172950 ] Apache Spark commented on SPARK-22063: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-22066) Update checkstyle to 8.2, enable it, fix violations

2017-09-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22066. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19282

[jira] [Resolved] (SPARK-22028) spark-submit trips over environment variables

2017-09-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22028. --- Resolution: Not A Problem > spark-submit trips over environment variables >

[jira] [Commented] (SPARK-22077) RpcEndpointAddress fails to parse spark URL if it is an ipv6 address.

2017-09-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172889#comment-16172889 ] Sean Owen commented on SPARK-22077: --- I'm not sure whether it's that IPv6 doesn't really work here in

[jira] [Updated] (SPARK-22075) GBTs/Pregel forgot to unpersist datasets cached by Checkpointer

2017-09-20 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-22075: - Summary: GBTs/Pregel forgot to unpersist datasets cached by Checkpointer (was: GBTs forgot to

[jira] [Updated] (SPARK-22075) GBTs forgot to unpersist datasets cached by PeriodicRDDCheckpointer

2017-09-20 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-22075: - Component/s: GraphX > GBTs forgot to unpersist datasets cached by PeriodicRDDCheckpointer >

[jira] [Resolved] (SPARK-22025) Speeding up fromInternal for StructField

2017-09-20 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22025. -- Resolution: Won't Fix > Speeding up fromInternal for StructField >

[jira] [Commented] (SPARK-22075) GBTs forgot to unpersist datasets cached by PeriodicRDDCheckpointer

2017-09-20 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172859#comment-16172859 ] zhengruifeng commented on SPARK-22075: -- Same issue seems exist in {{Pregel}}, each call of

[jira] [Created] (SPARK-22078) clarify exception behaviors for all data source v2 interfaces

2017-09-20 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-22078: --- Summary: clarify exception behaviors for all data source v2 interfaces Key: SPARK-22078 URL: https://issues.apache.org/jira/browse/SPARK-22078 Project: Spark

[jira] [Created] (SPARK-22077) RpcEndpointAddress fails to parse spark URL if it is an ipv6 address.

2017-09-20 Thread Eric Vandenberg (JIRA)
Eric Vandenberg created SPARK-22077: --- Summary: RpcEndpointAddress fails to parse spark URL if it is an ipv6 address. Key: SPARK-22077 URL: https://issues.apache.org/jira/browse/SPARK-22077 Project:

[jira] [Resolved] (SPARK-21977) SinglePartition optimizations break certain Streaming Stateful Aggregation requirements

2017-09-20 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz resolved SPARK-21977. - Resolution: Fixed Fix Version/s: 2.3.0 > SinglePartition optimizations break certain

[jira] [Assigned] (SPARK-22076) Expand.projections should not be a Stream

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22076: Assignee: Wenchen Fan (was: Apache Spark) > Expand.projections should not be a Stream >

[jira] [Commented] (SPARK-22076) Expand.projections should not be a Stream

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172832#comment-16172832 ] Apache Spark commented on SPARK-22076: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22076) Expand.projections should not be a Stream

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22076: Assignee: Apache Spark (was: Wenchen Fan) > Expand.projections should not be a Stream >

[jira] [Created] (SPARK-22076) Expand.projections should not be a Stream

2017-09-20 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-22076: --- Summary: Expand.projections should not be a Stream Key: SPARK-22076 URL: https://issues.apache.org/jira/browse/SPARK-22076 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-22075) GBTs forgot to unpersist datasets cached by PeriodicRDDCheckpointer

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22075: Assignee: Apache Spark > GBTs forgot to unpersist datasets cached by

[jira] [Commented] (SPARK-22075) GBTs forgot to unpersist datasets cached by PeriodicRDDCheckpointer

2017-09-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172783#comment-16172783 ] Apache Spark commented on SPARK-22075: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-22075) GBTs forgot to unpersist datasets cached by PeriodicRDDCheckpointer

2017-09-20 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-22075: Summary: GBTs forgot to unpersist datasets cached by PeriodicRDDCheckpointer Key: SPARK-22075 URL: https://issues.apache.org/jira/browse/SPARK-22075 Project: Spark