[jira] [Resolved] (SPARK-8264) string function: substring_index

[ https://issues.apache.org/jira/browse/SPARK-8264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8264. Resolution: Fixed Fix Version/s: 1.5.0 string function: substring_index

[jira] [Updated] (SPARK-9464) Add property-based tests for UTF8String

[ https://issues.apache.org/jira/browse/SPARK-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9464: --- Shepherd: Josh Rosen Add property-based tests for UTF8String

[jira] [Resolved] (SPARK-9464) Add property-based tests for UTF8String

[ https://issues.apache.org/jira/browse/SPARK-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9464. Resolution: Fixed Assignee: Yijie Shen Fix Version/s: 1.5.0 Add property-based

[jira] [Updated] (SPARK-9215) Implement WAL-free Kinesis receiver that give at-least once guarantee

[ https://issues.apache.org/jira/browse/SPARK-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9215: - Description: Currently, the KinesisReceiver can loose some data in the case of certain failures

[jira] [Updated] (SPARK-6599) Improve usability of Kinesis-based Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-6599: - Summary: Improve usability of Kinesis-based Spark Streaming (was: Improve reliability and

[jira] [Commented] (SPARK-6599) Improve reliability and usability of Kinesis-based Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650157#comment-14650157 ] Tathagata Das commented on SPARK-6599: -- [~smartnut007] If you are looking for the

[jira] [Issue Comment Deleted] (SPARK-6599) Improve usability of Kinesis-based Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-6599: - Comment: was deleted (was: I am updating the title of this JIRA to better reflect the issue

[jira] [Updated] (SPARK-6599) Improve usability of Kinesis-based Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-6599: - Description: Usability improvements: API improvements, AWS SDK upgrades, Reliability

[jira] [Resolved] (SPARK-9358) GenerateUnsafeRowJoiner

[ https://issues.apache.org/jira/browse/SPARK-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9358. Resolution: Fixed Fix Version/s: 1.5.0 GenerateUnsafeRowJoiner ---

[jira] [Resolved] (SPARK-9030) Add Kinesis.createStream unit tests that actual sends data

[ https://issues.apache.org/jira/browse/SPARK-9030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9030. -- Resolution: Fixed Fix Version/s: 1.5.0 Add Kinesis.createStream unit tests that actual

[jira] [Resolved] (SPARK-9415) MapType should not support equality ordering

[ https://issues.apache.org/jira/browse/SPARK-9415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9415. Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 1.5.0 MapType should

[jira] [Commented] (SPARK-6599) Improve usability of Kinesis-based Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650159#comment-14650159 ] Tathagata Das commented on SPARK-6599: -- I am updating the title of this JIRA to

[jira] [Updated] (SPARK-9030) Add Kinesis.createStream unit tests that actual sends data

[ https://issues.apache.org/jira/browse/SPARK-9030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9030: - Issue Type: Test (was: Sub-task) Parent: (was: SPARK-6599) Add Kinesis.createStream

[jira] [Commented] (SPARK-8191) date/time function: to_utc_timestamp

[ https://issues.apache.org/jira/browse/SPARK-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650163#comment-14650163 ] Apache Spark commented on SPARK-8191: - User 'davies' has created a pull request for

[jira] [Commented] (SPARK-8185) date/time function: datediff

[ https://issues.apache.org/jira/browse/SPARK-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650161#comment-14650161 ] Apache Spark commented on SPARK-8185: - User 'davies' has created a pull request for

[jira] [Commented] (SPARK-8188) date/time function: from_utc_timestamp

[ https://issues.apache.org/jira/browse/SPARK-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650162#comment-14650162 ] Apache Spark commented on SPARK-8188: - User 'davies' has created a pull request for

[jira] [Updated] (SPARK-6599) Improve usability of Kinesis-based Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-6599: - Description: Usability improvements: Reliability improvements: Currently, the KinesisReceiver

[jira] [Updated] (SPARK-7139) Allow received block metadata to be saved to WAL and recovered on driver failure

[ https://issues.apache.org/jira/browse/SPARK-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7139: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-9215 Allow received block

[jira] [Updated] (SPARK-7138) Add method to BlockGenerator to add multiple records to BlockGenerator with single callback

[ https://issues.apache.org/jira/browse/SPARK-7138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7138: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-9215 Add method to BlockGenerator

[jira] [Updated] (SPARK-9514) Add EventHubsReceiver to support Spark Streaming using Azure EventHubs

[ https://issues.apache.org/jira/browse/SPARK-9514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shanyu zhao updated SPARK-9514: --- Shepherd: shanyu zhao Add EventHubsReceiver to support Spark Streaming using Azure EventHubs

[jira] [Created] (SPARK-9514) Add EventHubsReceiver to support Spark Streaming using Azure EventHubs

shanyu zhao created SPARK-9514: -- Summary: Add EventHubsReceiver to support Spark Streaming using Azure EventHubs Key: SPARK-9514 URL: https://issues.apache.org/jira/browse/SPARK-9514 Project: Spark

[jira] [Created] (SPARK-9515) Creating JavaSparkContext throws NPE

nirav patel created SPARK-9515: -- Summary: Creating JavaSparkContext throws NPE Key: SPARK-9515 URL: https://issues.apache.org/jira/browse/SPARK-9515 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-9516) Improve Thread Dump page

Nan Zhu created SPARK-9516: -- Summary: Improve Thread Dump page Key: SPARK-9516 URL: https://issues.apache.org/jira/browse/SPARK-9516 Project: Spark Issue Type: New Feature Components: Web

[jira] [Resolved] (SPARK-9433) Audit expression unit tests to test for non-foldable codegen path

[ https://issues.apache.org/jira/browse/SPARK-9433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9433. Resolution: Fixed Fix Version/s: 1.5.0 This is done now. Audit expression unit tests to

[jira] [Created] (SPARK-9517) BytesToBytesMap should encode data the same way as UnsafeExternalSorter

Reynold Xin created SPARK-9517: -- Summary: BytesToBytesMap should encode data the same way as UnsafeExternalSorter Key: SPARK-9517 URL: https://issues.apache.org/jira/browse/SPARK-9517 Project: Spark

[jira] [Resolved] (SPARK-9504) Flaky test: o.a.s.streaming.StreamingContextSuite.stop gracefully

[ https://issues.apache.org/jira/browse/SPARK-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-9504. - Resolution: Fixed Fix Version/s: 1.5.0 Flaky test:

[jira] [Resolved] (SPARK-9451) Support records larger than default page size in BytesToBytesMap

[ https://issues.apache.org/jira/browse/SPARK-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9451. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7762

[jira] [Resolved] (SPARK-9320) Add `summary` as a synonym for `describe`

[ https://issues.apache.org/jira/browse/SPARK-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9320. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-9320) Add `summary` as a synonym for `describe`

[ https://issues.apache.org/jira/browse/SPARK-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9320: - Assignee: Hossein Falaki Add `summary` as a synonym for `describe`

[jira] [Updated] (SPARK-9318) Add `merge` as synonym for join

[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9318: - Assignee: Hossein Falaki Add `merge` as synonym for join

[jira] [Commented] (SPARK-6599) Improve reliability and usability of Kinesis-based Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650054#comment-14650054 ] Arun Ramakrishnan commented on SPARK-6599: -- [~tdas] Curious about the design docs

[jira] [Commented] (SPARK-9516) Improve Thread Dump page

[ https://issues.apache.org/jira/browse/SPARK-9516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650090#comment-14650090 ] Nan Zhu commented on SPARK-9516: I can work on it after finishing SPARK-8416 Improve

[jira] [Resolved] (SPARK-8936) Hyperparameter estimation in LDA

[ https://issues.apache.org/jira/browse/SPARK-8936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-8936. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7836

[jira] [Resolved] (SPARK-9318) Add `merge` as synonym for join

[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9318. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Assigned] (SPARK-9517) BytesToBytesMap should encode data the same way as UnsafeExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-9517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9517: --- Assignee: Apache Spark (was: Reynold Xin) BytesToBytesMap should encode data the same way

[jira] [Assigned] (SPARK-9517) BytesToBytesMap should encode data the same way as UnsafeExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-9517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9517: --- Assignee: Reynold Xin (was: Apache Spark) BytesToBytesMap should encode data the same way

[jira] [Commented] (SPARK-9517) BytesToBytesMap should encode data the same way as UnsafeExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-9517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14650109#comment-14650109 ] Apache Spark commented on SPARK-9517: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649150#comment-14649150 ] Sudhakar Thota commented on SPARK-8333: --- I verified this using val sqlContext = new

[jira] [Resolved] (SPARK-9485) Failed to connect to yarn / spark-submit --master yarn-client

[ https://issues.apache.org/jira/browse/SPARK-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9485. -- Resolution: Cannot Reproduce Failed to connect to yarn / spark-submit --master yarn-client

[jira] [Updated] (SPARK-9477) Adding IBM Platform Application Service Controller into Spark documentation as a supported Cluster Manager (beside Yarn and Mesos).

[ https://issues.apache.org/jira/browse/SPARK-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9477: - Assignee: Sean Owen Adding IBM Platform Application Service Controller into Spark documentation as a

[jira] [Resolved] (SPARK-9477) Adding IBM Platform Application Service Controller into Spark documentation as a supported Cluster Manager (beside Yarn and Mesos).

[ https://issues.apache.org/jira/browse/SPARK-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9477. -- Resolution: Fixed Fix Version/s: (was: 1.4.1) 1.5.0 Added to

[jira] [Commented] (SPARK-9464) Add property-based tests for UTF8String

[ https://issues.apache.org/jira/browse/SPARK-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649291#comment-14649291 ] Apache Spark commented on SPARK-9464: - User 'yjshen' has created a pull request for

[jira] [Commented] (SPARK-5155) Python API for MQTT streaming

[ https://issues.apache.org/jira/browse/SPARK-5155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649435#comment-14649435 ] Apache Spark commented on SPARK-5155: - User 'zsxwing' has created a pull request for

[jira] [Commented] (SPARK-9141) DataFrame recomputed instead of using cached parent.

[ https://issues.apache.org/jira/browse/SPARK-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649437#comment-14649437 ] Justin Uang commented on SPARK-9141: (Taken from spark dev email:

[jira] [Resolved] (SPARK-9497) Flaky test: DistributedSuite failed after the test of repeatedly failing task that crashes JVM

[ https://issues.apache.org/jira/browse/SPARK-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-9497. --- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.5.0 Flaky test:

[jira] [Commented] (SPARK-9510) Fix remaining SparkR style violations

[ https://issues.apache.org/jira/browse/SPARK-9510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649449#comment-14649449 ] Apache Spark commented on SPARK-9510: - User 'shivaram' has created a pull request for

[jira] [Commented] (SPARK-5754) Spark AM not launching on Windows

[ https://issues.apache.org/jira/browse/SPARK-5754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649364#comment-14649364 ] Carsten Blank commented on SPARK-5754: -- Thanks, I will put in more time and come up

[jira] [Updated] (SPARK-9231) DistributedLDAModel method for top topics per document

[ https://issues.apache.org/jira/browse/SPARK-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9231: - Assignee: yuhao yang DistributedLDAModel method for top topics per document

[jira] [Commented] (SPARK-9497) Flaky test: DistributedSuite failed after the test of repeatedly failing task that crashes JVM

[ https://issues.apache.org/jira/browse/SPARK-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649371#comment-14649371 ] Yin Huai commented on SPARK-9497: - I am not sure if it is related. Maybe now. I will keep

[jira] [Updated] (SPARK-9446) Clear Active SparkContext in stop() method

[ https://issues.apache.org/jira/browse/SPARK-9446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9446: - Shepherd: Sean Owen Clear Active SparkContext in stop() method

[jira] [Assigned] (SPARK-9233) Enable code-gen in window function unit tests

[ https://issues.apache.org/jira/browse/SPARK-9233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9233: --- Assignee: (was: Apache Spark) Enable code-gen in window function unit tests

[jira] [Resolved] (SPARK-9053) Fix spaces around parens, infix operators etc.

[ https://issues.apache.org/jira/browse/SPARK-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9053. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-9053) Fix spaces around parens, infix operators etc.

[ https://issues.apache.org/jira/browse/SPARK-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9053: - Assignee: Yu Ishikawa Fix spaces around parens, infix operators etc.

[jira] [Created] (SPARK-9510) Fix remaining SparkR style violations

Shivaram Venkataraman created SPARK-9510: Summary: Fix remaining SparkR style violations Key: SPARK-9510 URL: https://issues.apache.org/jira/browse/SPARK-9510 Project: Spark Issue

[jira] [Created] (SPARK-9508) Align graphx programming guide with the updated Pregel code

Alexander Ulanov created SPARK-9508: --- Summary: Align graphx programming guide with the updated Pregel code Key: SPARK-9508 URL: https://issues.apache.org/jira/browse/SPARK-9508 Project: Spark

[jira] [Commented] (SPARK-9508) Align graphx programming guide with the updated Pregel code

[ https://issues.apache.org/jira/browse/SPARK-9508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649343#comment-14649343 ] Apache Spark commented on SPARK-9508: - User 'avulanov' has created a pull request for

[jira] [Assigned] (SPARK-9508) Align graphx programming guide with the updated Pregel code

[ https://issues.apache.org/jira/browse/SPARK-9508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9508: --- Assignee: (was: Apache Spark) Align graphx programming guide with the updated Pregel

[jira] [Assigned] (SPARK-9233) Enable code-gen in window function unit tests

[ https://issues.apache.org/jira/browse/SPARK-9233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9233: --- Assignee: Apache Spark Enable code-gen in window function unit tests

[jira] [Commented] (SPARK-9233) Enable code-gen in window function unit tests

[ https://issues.apache.org/jira/browse/SPARK-9233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649397#comment-14649397 ] Apache Spark commented on SPARK-9233: - User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-9490) MLlib evaluation metrics guide example python code uses deprecated print statement

[ https://issues.apache.org/jira/browse/SPARK-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-9490: Assignee: Sean Owen MLlib evaluation metrics guide example python code uses deprecated print

[jira] [Commented] (SPARK-9140) Replace TimeTracker by Stopwatch

[ https://issues.apache.org/jira/browse/SPARK-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649417#comment-14649417 ] yuhao yang commented on SPARK-9140: --- I'd like to start on this and send a PR tomorrow.

[jira] [Created] (SPARK-9509) AppClient.stop() may throw an exception

Kay Ousterhout created SPARK-9509: - Summary: AppClient.stop() may throw an exception Key: SPARK-9509 URL: https://issues.apache.org/jira/browse/SPARK-9509 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-9510) Fix remaining SparkR style violations

[ https://issues.apache.org/jira/browse/SPARK-9510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9510: --- Assignee: Apache Spark Fix remaining SparkR style violations

[jira] [Assigned] (SPARK-9510) Fix remaining SparkR style violations

[ https://issues.apache.org/jira/browse/SPARK-9510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9510: --- Assignee: (was: Apache Spark) Fix remaining SparkR style violations

[jira] [Resolved] (SPARK-9500) Add TernaryExpression to simplify implementations

[ https://issues.apache.org/jira/browse/SPARK-9500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9500. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7816

[jira] [Assigned] (SPARK-9508) Align graphx programming guide with the updated Pregel code

[ https://issues.apache.org/jira/browse/SPARK-9508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9508: --- Assignee: Apache Spark Align graphx programming guide with the updated Pregel code

[jira] [Resolved] (SPARK-9509) AppClient.stop() may throw an exception

[ https://issues.apache.org/jira/browse/SPARK-9509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-9509. --- Resolution: Fixed Fix Version/s: 1.5.0 AppClient.stop() may throw an exception

[jira] [Commented] (SPARK-9483) UTF8String.getPrefix only works in little-endian order

[ https://issues.apache.org/jira/browse/SPARK-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649461#comment-14649461 ] Matthew Brandyberry commented on SPARK-9483: I will take care of this.

[jira] [Commented] (SPARK-9499) Possible file handle leak in spilling/sort code

[ https://issues.apache.org/jira/browse/SPARK-9499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649604#comment-14649604 ] Josh Rosen commented on SPARK-9499: --- Looking at the {{lsof}} dump attached to the

[jira] [Created] (SPARK-9511) Table names starting with numbers no longer supported

Michael Armbrust created SPARK-9511: --- Summary: Table names starting with numbers no longer supported Key: SPARK-9511 URL: https://issues.apache.org/jira/browse/SPARK-9511 Project: Spark

[jira] [Commented] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649532#comment-14649532 ] Apache Spark commented on SPARK-9279: - User 'danielli90' has created a pull request

[jira] [Commented] (SPARK-9499) Possible file handle leak in spilling/sort code

[ https://issues.apache.org/jira/browse/SPARK-9499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649645#comment-14649645 ] Josh Rosen commented on SPARK-9499: --- In fact, it looks like the majority of open files

[jira] [Commented] (SPARK-9446) Clear Active SparkContext in stop() method

[ https://issues.apache.org/jira/browse/SPARK-9446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649497#comment-14649497 ] Sean Owen commented on SPARK-9446: -- Resolved by https://github.com/apache/spark/pull/7756

[jira] [Resolved] (SPARK-9446) Clear Active SparkContext in stop() method

[ https://issues.apache.org/jira/browse/SPARK-9446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9446. -- Resolution: Fixed Assignee: Ted Yu Fix Version/s: 1.5.0 1.4.2 Clear

[jira] [Updated] (SPARK-9414) HiveContext:saveAsTable creates wrong partition for existing hive table(append mode)

[ https://issues.apache.org/jira/browse/SPARK-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9414: Description: Raising this bug because I found this issue was ready reported on Apache mail

[jira] [Resolved] (SPARK-9471) Multilayer perceptron

[ https://issues.apache.org/jira/browse/SPARK-9471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9471. -- Resolution: Fixed Fix Version/s: (was: 1.4.0) 1.5.0 Issue

[jira] [Updated] (SPARK-9471) Multilayer perceptron classifier

[ https://issues.apache.org/jira/browse/SPARK-9471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9471: - Summary: Multilayer perceptron classifier (was: Multilayer perceptron ) Multilayer perceptron

[jira] [Commented] (SPARK-4366) Aggregation Improvement

[ https://issues.apache.org/jira/browse/SPARK-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649488#comment-14649488 ] Yin Huai commented on SPARK-4366: - Just a note to myself. Seems we need to project fields

[jira] [Commented] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649603#comment-14649603 ] Sean Owen commented on SPARK-9279: -- No, that's not the issue, even if I don't think it's

[jira] [Updated] (SPARK-9471) Multilayer perceptron

[ https://issues.apache.org/jira/browse/SPARK-9471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9471: - Assignee: Alexander Ulanov Multilayer perceptron -- Key:

[jira] [Resolved] (SPARK-9231) DistributedLDAModel method for top topics per document

[ https://issues.apache.org/jira/browse/SPARK-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9231. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7785

[jira] [Resolved] (SPARK-8564) Add the Python API for Kinesis

[ https://issues.apache.org/jira/browse/SPARK-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-8564. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.5.0 Add the Python

[jira] [Resolved] (SPARK-9246) DistributedLDAModel predict top docs per topic

[ https://issues.apache.org/jira/browse/SPARK-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9246. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7769

[jira] [Commented] (SPARK-7953) Spark should cleanup output dir if job fails

[ https://issues.apache.org/jira/browse/SPARK-7953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649749#comment-14649749 ] Sameer Abhyankar commented on SPARK-7953: - I would like to work on this if it is

[jira] [Commented] (SPARK-7791) Set user for executors in standalone-mode

[ https://issues.apache.org/jira/browse/SPARK-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649753#comment-14649753 ] Niels Becker commented on SPARK-7791: - I run into the same problem saving a dataframe

[jira] [Assigned] (SPARK-9459) avoid copy for UTF8String during unsafe sorting

[ https://issues.apache.org/jira/browse/SPARK-9459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9459: --- Assignee: Apache Spark (was: Davies Liu) avoid copy for UTF8String during unsafe sorting

[jira] [Commented] (SPARK-9459) avoid copy for UTF8String during unsafe sorting

[ https://issues.apache.org/jira/browse/SPARK-9459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649806#comment-14649806 ] Apache Spark commented on SPARK-9459: - User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-9459) avoid copy for UTF8String during unsafe sorting

[ https://issues.apache.org/jira/browse/SPARK-9459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9459: --- Assignee: Davies Liu (was: Apache Spark) avoid copy for UTF8String during unsafe sorting

[jira] [Resolved] (SPARK-9490) MLlib evaluation metrics guide example python code uses deprecated print statement

[ https://issues.apache.org/jira/browse/SPARK-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9490. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7822

[jira] [Resolved] (SPARK-6885) Decision trees: predict class probabilities

[ https://issues.apache.org/jira/browse/SPARK-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-6885. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7694

[jira] [Resolved] (SPARK-8979) Implement a PIDRateEstimator

[ https://issues.apache.org/jira/browse/SPARK-8979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-8979. -- Resolution: Fixed Assignee: Iulian Dragos Implement a PIDRateEstimator

[jira] [Resolved] (SPARK-9202) Worker should not have data structures which grow without bound

[ https://issues.apache.org/jira/browse/SPARK-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9202. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7714

[jira] [Assigned] (SPARK-7400) PortableDataStream UDT

[ https://issues.apache.org/jira/browse/SPARK-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7400: --- Assignee: (was: Apache Spark) PortableDataStream UDT --

[jira] [Commented] (SPARK-8360) Streaming DataFrames

[ https://issues.apache.org/jira/browse/SPARK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649729#comment-14649729 ] Joseph Batchik commented on SPARK-8360: --- Would streaming DataFrames replace

[jira] [Commented] (SPARK-7400) PortableDataStream UDT

[ https://issues.apache.org/jira/browse/SPARK-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649734#comment-14649734 ] Apache Spark commented on SPARK-7400: - User 'feynmanliang' has created a pull request

[jira] [Assigned] (SPARK-5133) Feature Importance for Random Forests

[ https://issues.apache.org/jira/browse/SPARK-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5133: --- Assignee: Apache Spark (was: Joseph K. Bradley) Feature Importance for Random Forests

[jira] [Commented] (SPARK-5133) Feature Importance for Random Forests

[ https://issues.apache.org/jira/browse/SPARK-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649740#comment-14649740 ] Joseph K. Bradley commented on SPARK-5133: -- [~namma] I just sent a PR:

[jira] [Commented] (SPARK-7400) PortableDataStream UDT

[ https://issues.apache.org/jira/browse/SPARK-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649759#comment-14649759 ] Eron Wright commented on SPARK-7400: - [~fliang] Seems that PR 7837 is erroneously

[jira] [Resolved] (SPARK-9308) ml.NaiveBayesModel support predicting class probabilities

[ https://issues.apache.org/jira/browse/SPARK-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9308. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7672

[jira] [Commented] (SPARK-9056) Rename configuration `spark.streaming.minRememberDuration` to `spark.streaming.fileStream.minRememberDuration`

[ https://issues.apache.org/jira/browse/SPARK-9056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649772#comment-14649772 ] Sameer Abhyankar commented on SPARK-9056: - Thanks all. Rename configuration

  1   2   3   >