[jira] [Updated] (SPARK-9611) UnsafeFixedWidthAggregationMap.destructAndCreateExternalSorter will add an empty entry to if the map is empty.

[ https://issues.apache.org/jira/browse/SPARK-9611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9611: -- Shepherd: Josh Rosen UnsafeFixedWidthAggregationMap.destructAndCreateExternalSorter will add an

[jira] [Resolved] (SPARK-9119) In some cases, we may save wrong decimal values to parquet

[ https://issues.apache.org/jira/browse/SPARK-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9119. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7925

[jira] [Resolved] (SPARK-8359) Spark SQL Decimal type precision loss on multiplication

[ https://issues.apache.org/jira/browse/SPARK-8359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8359. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7925

[jira] [Created] (SPARK-9627) SQL job failed if the dataframe is cached

Davies Liu created SPARK-9627: - Summary: SQL job failed if the dataframe is cached Key: SPARK-9627 URL: https://issues.apache.org/jira/browse/SPARK-9627 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-9046) Decimal type support improvement and bug fix

[ https://issues.apache.org/jira/browse/SPARK-9046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9046. Resolution: Fixed Fix Version/s: 1.5.0 Decimal type support improvement and bug fix

[jira] [Created] (SPARK-9628) Rename Int and Long to SQLDate SQLTimestamp In DateTimeUtils

Yijie Shen created SPARK-9628: - Summary: Rename Int and Long to SQLDate SQLTimestamp In DateTimeUtils Key: SPARK-9628 URL: https://issues.apache.org/jira/browse/SPARK-9628 Project: Spark Issue

[jira] [Assigned] (SPARK-9628) Rename Int and Long to SQLDate SQLTimestamp In DateTimeUtils

[ https://issues.apache.org/jira/browse/SPARK-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9628: --- Assignee: Apache Spark Rename Int and Long to SQLDate SQLTimestamp In DateTimeUtils

[jira] [Commented] (SPARK-9628) Rename Int and Long to SQLDate SQLTimestamp In DateTimeUtils

[ https://issues.apache.org/jira/browse/SPARK-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654900#comment-14654900 ] Apache Spark commented on SPARK-9628: - User 'yjshen' has created a pull request for

[jira] [Assigned] (SPARK-9628) Rename Int and Long to SQLDate SQLTimestamp In DateTimeUtils

[ https://issues.apache.org/jira/browse/SPARK-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9628: --- Assignee: (was: Apache Spark) Rename Int and Long to SQLDate SQLTimestamp In

[jira] [Updated] (SPARK-6212) The EXPLAIN output of CTAS only shows the analyzed plan

[ https://issues.apache.org/jira/browse/SPARK-6212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6212: --- Assignee: Yijie Shen The EXPLAIN output of CTAS only shows the analyzed plan

[jira] [Created] (SPARK-9629) Client session timed out, have not heard from server in

zengqiuyang created SPARK-9629: -- Summary: Client session timed out, have not heard from server in Key: SPARK-9629 URL: https://issues.apache.org/jira/browse/SPARK-9629 Project: Spark Issue

[jira] [Updated] (SPARK-9617) Implement json_tuple

[ https://issues.apache.org/jira/browse/SPARK-9617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9617: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-9571 Implement json_tuple

[jira] [Updated] (SPARK-9618) SQLContext.read.schema().parquet() ignores the supplied schema

[ https://issues.apache.org/jira/browse/SPARK-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9618: --- Assignee: Nathan Howell Target Version/s: 1.5.0 SQLContext.read.schema().parquet()

[jira] [Commented] (SPARK-6488) Support addition/multiplication in PySpark's BlockMatrix

[ https://issues.apache.org/jira/browse/SPARK-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654906#comment-14654906 ] Mike Dusenberry commented on SPARK-6488: I'd like to work on this one as well.

[jira] [Updated] (SPARK-8930) Throw a AnalysisException with meaningful messages when DataFrame#explode takes a star in expressions

[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-8930: Summary: Throw a AnalysisException with meaningful messages when DataFrame#explode takes a

[jira] [Updated] (SPARK-8930) Throw a AnalysisException with meaningful messages when DataFrame#explode takes a star in expressions

[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-8930: Description: The current implementation throws an exception with meaningless messages if

[jira] [Updated] (SPARK-8930) Throw a AnalysisException with meaningful messages if DataFrame#explode takes a star in expressions

[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-8930: Summary: Throw a AnalysisException with meaningful messages if DataFrame#explode takes a

[jira] [Updated] (SPARK-8930) Throw a AnalysisException with meaningful messages if DataFrame#explode takes a star in expressions

[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-8930: Description: The current implementation throws an exception with meaningless messages if

[jira] [Updated] (SPARK-8930) Throw a AnalysisException with meaningful messages if DataFrame#explode takes a star in expressions

[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8930: --- Target Version/s: 1.5.0 Throw a AnalysisException with meaningful messages if DataFrame#explode

[jira] [Updated] (SPARK-9629) Client session timed out, have not heard from server in

[ https://issues.apache.org/jira/browse/SPARK-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengqiuyang updated SPARK-9629: --- Environment: spark1.4.1./make-distribution.sh --tgz -Dhadoop.version=2.5.2 -Dyarn.version=2.5.2

[jira] [Created] (SPARK-9630) Cleanup Hybrid Aggregate Operator.

Yin Huai created SPARK-9630: --- Summary: Cleanup Hybrid Aggregate Operator. Key: SPARK-9630 URL: https://issues.apache.org/jira/browse/SPARK-9630 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-9630) Cleanup Hybrid Aggregate Operator.

[ https://issues.apache.org/jira/browse/SPARK-9630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9630: --- Assignee: Apache Spark (was: Yin Huai) Cleanup Hybrid Aggregate Operator.

[jira] [Assigned] (SPARK-9630) Cleanup Hybrid Aggregate Operator.

[ https://issues.apache.org/jira/browse/SPARK-9630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9630: --- Assignee: Yin Huai (was: Apache Spark) Cleanup Hybrid Aggregate Operator.

[jira] [Commented] (SPARK-9630) Cleanup Hybrid Aggregate Operator.

[ https://issues.apache.org/jira/browse/SPARK-9630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654924#comment-14654924 ] Apache Spark commented on SPARK-9630: - User 'yhuai' has created a pull request for

[jira] [Commented] (SPARK-9240) Hybrid aggregate operator using unsafe row

[ https://issues.apache.org/jira/browse/SPARK-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654925#comment-14654925 ] Apache Spark commented on SPARK-9240: - User 'yhuai' has created a pull request for

[jira] [Created] (SPARK-9631) Giant pile of parquet log when trying to read local data

Reynold Xin created SPARK-9631: -- Summary: Giant pile of parquet log when trying to read local data Key: SPARK-9631 URL: https://issues.apache.org/jira/browse/SPARK-9631 Project: Spark Issue

[jira] [Commented] (SPARK-9631) Giant pile of parquet log when trying to read local data

[ https://issues.apache.org/jira/browse/SPARK-9631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654933#comment-14654933 ] Reynold Xin commented on SPARK-9631: FYI this was running PySpark. Giant pile of

[jira] [Resolved] (SPARK-9215) Implement WAL-free Kinesis receiver that give at-least once guarantee

[ https://issues.apache.org/jira/browse/SPARK-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9215. -- Resolution: Fixed Fix Version/s: 1.5.0 Implement WAL-free Kinesis receiver that give

[jira] [Resolved] (SPARK-9217) Update Kinesis Receiver to record sequence numbers

[ https://issues.apache.org/jira/browse/SPARK-9217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9217. -- Resolution: Fixed Fix Version/s: 1.5.0 Update Kinesis Receiver to record sequence

[jira] [Updated] (SPARK-6599) Improve usability and reliability of Kinesis stream

[ https://issues.apache.org/jira/browse/SPARK-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-6599: - Issue Type: Epic (was: Improvement) Improve usability and reliability of Kinesis stream

[jira] [Updated] (SPARK-6599) Improve usability and reliability of Kinesis stream

[ https://issues.apache.org/jira/browse/SPARK-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-6599: - Issue Type: Umbrella (was: Epic) Improve usability and reliability of Kinesis stream

[jira] [Created] (SPARK-9632) update InternalRow.toSeq to make it accept data type info

Wenchen Fan created SPARK-9632: -- Summary: update InternalRow.toSeq to make it accept data type info Key: SPARK-9632 URL: https://issues.apache.org/jira/browse/SPARK-9632 Project: Spark Issue

[jira] [Assigned] (SPARK-9632) update InternalRow.toSeq to make it accept data type info

[ https://issues.apache.org/jira/browse/SPARK-9632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9632: --- Assignee: (was: Apache Spark) update InternalRow.toSeq to make it accept data type info

[jira] [Commented] (SPARK-9632) update InternalRow.toSeq to make it accept data type info

[ https://issues.apache.org/jira/browse/SPARK-9632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654942#comment-14654942 ] Apache Spark commented on SPARK-9632: - User 'cloud-fan' has created a pull request for

[jira] [Assigned] (SPARK-9632) update InternalRow.toSeq to make it accept data type info

[ https://issues.apache.org/jira/browse/SPARK-9632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9632: --- Assignee: Apache Spark update InternalRow.toSeq to make it accept data type info

[jira] [Commented] (SPARK-9631) Giant pile of parquet log when trying to read local data

[ https://issues.apache.org/jira/browse/SPARK-9631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654953#comment-14654953 ] Sean Owen commented on SPARK-9631: -- Is this fixed by

[jira] [Resolved] (SPARK-9581) Add test for JSON UDTs

[ https://issues.apache.org/jira/browse/SPARK-9581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9581. Resolution: Fixed Fix Version/s: 1.5.0 Add test for JSON UDTs --

[jira] [Commented] (SPARK-9629) Client session timed out, have not heard from server in

[ https://issues.apache.org/jira/browse/SPARK-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654959#comment-14654959 ] Sean Owen commented on SPARK-9629: -- This points to a problem with your ZK broker. Have

[jira] [Updated] (SPARK-9625) SparkILoop creates sql context continuously, thousands of times

[ https://issues.apache.org/jira/browse/SPARK-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9625: - Component/s: SQL Did you say this is reproducible -- how do you do it? SparkILoop creates sql context

[jira] [Closed] (SPARK-9631) Giant pile of parquet log when trying to read local data

[ https://issues.apache.org/jira/browse/SPARK-9631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-9631. -- Resolution: Duplicate Giant pile of parquet log when trying to read local data

[jira] [Updated] (SPARK-9627) SQL job failed if the dataframe is cached

[ https://issues.apache.org/jira/browse/SPARK-9627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9627: --- Target Version/s: 1.5.0 SQL job failed if the dataframe is cached

[jira] [Resolved] (SPARK-9621) Closure inside RDD doesn't properly close over environment

[ https://issues.apache.org/jira/browse/SPARK-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9621. -- Resolution: Duplicate Pretty sure this is a subset of the general problem of using case classes in the

[jira] [Resolved] (SPARK-9601) Join example fix in streaming-programming-guide.md

[ https://issues.apache.org/jira/browse/SPARK-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9601. -- Resolution: Fixed Fix Version/s: 1.5.0 Join example fix in

[jira] [Updated] (SPARK-9601) Join example fix in streaming-programming-guide.md

[ https://issues.apache.org/jira/browse/SPARK-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9601: - Assignee: Namit Katariya Join example fix in streaming-programming-guide.md

[jira] [Commented] (SPARK-6107) event log file ends with .inprogress should be able to display on webUI for standalone mode

[ https://issues.apache.org/jira/browse/SPARK-6107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14655002#comment-14655002 ] kumar deepak commented on SPARK-6107: - Is there a plan to fix it in 1.3.1 event log

[jira] [Created] (SPARK-9633) SBT download locations outdated; need an update

Sean Owen created SPARK-9633: Summary: SBT download locations outdated; need an update Key: SPARK-9633 URL: https://issues.apache.org/jira/browse/SPARK-9633 Project: Spark Issue Type:

[jira] [Updated] (SPARK-9633) SBT download locations outdated; need an update

[ https://issues.apache.org/jira/browse/SPARK-9633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9633: - Description: The SBT download script tries to download from two locations,

[jira] [Resolved] (SPARK-8862) Add a web UI page that visualizes physical plans (SparkPlan)

[ https://issues.apache.org/jira/browse/SPARK-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8862. Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.5.0 Add a web UI page

[jira] [Resolved] (SPARK-8861) Add basic instrumentation to each SparkPlan operator

[ https://issues.apache.org/jira/browse/SPARK-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8861. Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.5.0 Add basic

[jira] [Assigned] (SPARK-9633) SBT download locations outdated; need an update

[ https://issues.apache.org/jira/browse/SPARK-9633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9633: --- Assignee: (was: Apache Spark) SBT download locations outdated; need an update

[jira] [Commented] (SPARK-9633) SBT download locations outdated; need an update

[ https://issues.apache.org/jira/browse/SPARK-9633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14655027#comment-14655027 ] Apache Spark commented on SPARK-9633: - User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-9633) SBT download locations outdated; need an update

[ https://issues.apache.org/jira/browse/SPARK-9633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9633: --- Assignee: Apache Spark SBT download locations outdated; need an update

[jira] [Updated] (SPARK-9633) SBT download locations outdated; need an update

[ https://issues.apache.org/jira/browse/SPARK-9633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9633: - Assignee: Sean Owen (Assigning to me as I don't yet see that nraychaudhuri has a JIRA username) SBT

[jira] [Created] (SPARK-9634) resolve UnresolvedAlias in DataFrame.resolve

Wenchen Fan created SPARK-9634: -- Summary: resolve UnresolvedAlias in DataFrame.resolve Key: SPARK-9634 URL: https://issues.apache.org/jira/browse/SPARK-9634 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-9634) resolve UnresolvedAlias in DataFrame.resolve

[ https://issues.apache.org/jira/browse/SPARK-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14655044#comment-14655044 ] Apache Spark commented on SPARK-9634: - User 'cloud-fan' has created a pull request for

[jira] [Assigned] (SPARK-9634) resolve UnresolvedAlias in DataFrame.resolve

[ https://issues.apache.org/jira/browse/SPARK-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9634: --- Assignee: Apache Spark resolve UnresolvedAlias in DataFrame.resolve

[jira] [Assigned] (SPARK-9634) resolve UnresolvedAlias in DataFrame.resolve

[ https://issues.apache.org/jira/browse/SPARK-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9634: --- Assignee: (was: Apache Spark) resolve UnresolvedAlias in DataFrame.resolve

[jira] [Assigned] (SPARK-9323) DataFrame.orderBy gives confusing analysis errors when ordering based on nested columns

[ https://issues.apache.org/jira/browse/SPARK-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9323: --- Assignee: Apache Spark DataFrame.orderBy gives confusing analysis errors when ordering

[jira] [Assigned] (SPARK-9323) DataFrame.orderBy gives confusing analysis errors when ordering based on nested columns

[ https://issues.apache.org/jira/browse/SPARK-9323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9323: --- Assignee: (was: Apache Spark) DataFrame.orderBy gives confusing analysis errors when

[jira] [Updated] (SPARK-9607) Incorrect zinc check in build/mvn

[ https://issues.apache.org/jira/browse/SPARK-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9607: - Assignee: Ryan Williams Incorrect zinc check in build/mvn -

[jira] [Resolved] (SPARK-9607) Incorrect zinc check in build/mvn

[ https://issues.apache.org/jira/browse/SPARK-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9607. -- Resolution: Fixed Fix Version/s: 1.5.0 1.3.2 1.4.2 Issue

[jira] [Resolved] (SPARK-9608) Incorrect zinc -status check in build/mvn

[ https://issues.apache.org/jira/browse/SPARK-9608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9608. -- Resolution: Fixed Fix Version/s: 1.5.0 1.3.2 1.4.2 Issue

[jira] [Created] (SPARK-9636) Treat $SPARK_HOME as write-only

Philipp Angerer created SPARK-9636: -- Summary: Treat $SPARK_HOME as write-only Key: SPARK-9636 URL: https://issues.apache.org/jira/browse/SPARK-9636 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-9636) Treat $SPARK_HOME as write-only

[ https://issues.apache.org/jira/browse/SPARK-9636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9636: - Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) Treat $SPARK_HOME as write-only

[jira] [Commented] (SPARK-9636) Treat $SPARK_HOME as write-only

[ https://issues.apache.org/jira/browse/SPARK-9636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14655146#comment-14655146 ] Sean Owen commented on SPARK-9636: -- I'm not sure those are as obvious as defaults, or

[jira] [Created] (SPARK-9637) Add interface for implementing scheduling algorithm for standalone deployment

Liang-Chi Hsieh created SPARK-9637: -- Summary: Add interface for implementing scheduling algorithm for standalone deployment Key: SPARK-9637 URL: https://issues.apache.org/jira/browse/SPARK-9637

[jira] [Commented] (SPARK-9637) Add interface for implementing scheduling algorithm for standalone deployment

[ https://issues.apache.org/jira/browse/SPARK-9637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14655166#comment-14655166 ] Apache Spark commented on SPARK-9637: - User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-9637) Add interface for implementing scheduling algorithm for standalone deployment

[ https://issues.apache.org/jira/browse/SPARK-9637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9637: --- Assignee: (was: Apache Spark) Add interface for implementing scheduling algorithm for

[jira] [Assigned] (SPARK-9637) Add interface for implementing scheduling algorithm for standalone deployment

[ https://issues.apache.org/jira/browse/SPARK-9637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9637: --- Assignee: Apache Spark Add interface for implementing scheduling algorithm for standalone

[jira] [Commented] (SPARK-9563) Remove repartition operators when they are the child of Exchange and shuffle=True

[ https://issues.apache.org/jira/browse/SPARK-9563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14655180#comment-14655180 ] Apache Spark commented on SPARK-9563: - User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-9563) Remove repartition operators when they are the child of Exchange and shuffle=True

[ https://issues.apache.org/jira/browse/SPARK-9563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9563: --- Assignee: Apache Spark Remove repartition operators when they are the child of Exchange and

[jira] [Assigned] (SPARK-9563) Remove repartition operators when they are the child of Exchange and shuffle=True

[ https://issues.apache.org/jira/browse/SPARK-9563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9563: --- Assignee: (was: Apache Spark) Remove repartition operators when they are the child of

[jira] [Created] (SPARK-9638) .save() Procedure fails

Stijn Geuens created SPARK-9638: --- Summary: .save() Procedure fails Key: SPARK-9638 URL: https://issues.apache.org/jira/browse/SPARK-9638 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-9638) .save() Procedure fails

[ https://issues.apache.org/jira/browse/SPARK-9638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14655214#comment-14655214 ] Sean Owen commented on SPARK-9638: -- I think this is because you are on Windows and you

[jira] [Resolved] (SPARK-9593) Hive ShimLoader loads wrong Hadoop shims when Spark is compiled against Hadoop 2.0.0-mr1-cdh4.1.1

[ https://issues.apache.org/jira/browse/SPARK-9593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-9593. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7929

[jira] [Commented] (SPARK-9636) Treat $SPARK_HOME as write-only

[ https://issues.apache.org/jira/browse/SPARK-9636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14655310#comment-14655310 ] Philipp Angerer commented on SPARK-9636: everything is more obvious than picing a

[jira] [Comment Edited] (SPARK-9636) Treat $SPARK_HOME as write-only

[ https://issues.apache.org/jira/browse/SPARK-9636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14655310#comment-14655310 ] Philipp Angerer edited comment on SPARK-9636 at 8/5/15 1:04 PM:

[jira] [Created] (SPARK-9639) JobHandler may throw NPE if JobScheduler has been stopped

Shixiong Zhu created SPARK-9639: --- Summary: JobHandler may throw NPE if JobScheduler has been stopped Key: SPARK-9639 URL: https://issues.apache.org/jira/browse/SPARK-9639 Project: Spark Issue

[jira] [Assigned] (SPARK-9639) JobHandler may throw NPE if JobScheduler has been stopped

[ https://issues.apache.org/jira/browse/SPARK-9639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9639: --- Assignee: Apache Spark JobHandler may throw NPE if JobScheduler has been stopped

[jira] [Commented] (SPARK-9639) JobHandler may throw NPE if JobScheduler has been stopped

[ https://issues.apache.org/jira/browse/SPARK-9639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14658195#comment-14658195 ] Apache Spark commented on SPARK-9639: - User 'zsxwing' has created a pull request for

[jira] [Assigned] (SPARK-9639) JobHandler may throw NPE if JobScheduler has been stopped

[ https://issues.apache.org/jira/browse/SPARK-9639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9639: --- Assignee: (was: Apache Spark) JobHandler may throw NPE if JobScheduler has been stopped

[jira] [Created] (SPARK-9640) Do not run Python Kinesis tests when the Kinesis assembly JAR has not been generated

Tathagata Das created SPARK-9640: Summary: Do not run Python Kinesis tests when the Kinesis assembly JAR has not been generated Key: SPARK-9640 URL: https://issues.apache.org/jira/browse/SPARK-9640

[jira] [Assigned] (SPARK-9640) Do not run Python Kinesis tests when the Kinesis assembly JAR has not been generated

[ https://issues.apache.org/jira/browse/SPARK-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9640: --- Assignee: Apache Spark (was: Tathagata Das) Do not run Python Kinesis tests when the

[jira] [Assigned] (SPARK-9640) Do not run Python Kinesis tests when the Kinesis assembly JAR has not been generated

[ https://issues.apache.org/jira/browse/SPARK-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9640: --- Assignee: Tathagata Das (was: Apache Spark) Do not run Python Kinesis tests when the

[jira] [Commented] (SPARK-9640) Do not run Python Kinesis tests when the Kinesis assembly JAR has not been generated

[ https://issues.apache.org/jira/browse/SPARK-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14658243#comment-14658243 ] Apache Spark commented on SPARK-9640: - User 'tdas' has created a pull request for this

[jira] [Created] (SPARK-9641) spark.shuffle.service.port is not documented

Thomas Graves created SPARK-9641: Summary: spark.shuffle.service.port is not documented Key: SPARK-9641 URL: https://issues.apache.org/jira/browse/SPARK-9641 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-9618) SQLContext.read.schema().parquet() ignores the supplied schema

[ https://issues.apache.org/jira/browse/SPARK-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-9618. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7947

[jira] [Commented] (SPARK-8862) Add a web UI page that visualizes physical plans (SparkPlan)

[ https://issues.apache.org/jira/browse/SPARK-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14658302#comment-14658302 ] Apache Spark commented on SPARK-8862: - User 'zsxwing' has created a pull request for

[jira] [Updated] (SPARK-6486) Add BlockMatrix in PySpark

[ https://issues.apache.org/jira/browse/SPARK-6486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6486: - Fix Version/s: (was: 1.6.0) 1.5.0 Add BlockMatrix in PySpark

[jira] [Resolved] (SPARK-9381) Migrate JSON data source to the new partitioning data source

[ https://issues.apache.org/jira/browse/SPARK-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-9381. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7696

[jira] [Updated] (SPARK-9381) Migrate JSON data source to the new partitioning data source

[ https://issues.apache.org/jira/browse/SPARK-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9381: -- Assignee: Cheng Hao Migrate JSON data source to the new partitioning data source

[jira] [Commented] (SPARK-9641) spark.shuffle.service.port is not documented

[ https://issues.apache.org/jira/browse/SPARK-9641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14658328#comment-14658328 ] Sean Owen commented on SPARK-9641: -- Agree. the .enabled flag is mentioned but not

[jira] [Updated] (SPARK-9641) spark.shuffle.service.port is not documented

[ https://issues.apache.org/jira/browse/SPARK-9641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9641: - Priority: Minor (was: Major) Component/s: Documentation Issue Type: Improvement (was: Bug)

[jira] [Commented] (SPARK-5544) wholeTextFiles should recognize multiple input paths delimited by ,

[ https://issues.apache.org/jira/browse/SPARK-5544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14658368#comment-14658368 ] Perinkulam I Ganesh commented on SPARK-5544: It seems like this JIRA got

[jira] [Commented] (SPARK-8486) SIFT Feature Transformer

[ https://issues.apache.org/jira/browse/SPARK-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14658377#comment-14658377 ] K S Sreenivasa Raghavan commented on SPARK-8486: How to accept this issue?

[jira] [Commented] (SPARK-8971) Support balanced class labels when splitting train/cross validation sets

[ https://issues.apache.org/jira/browse/SPARK-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14658376#comment-14658376 ] Seth Hendrickson commented on SPARK-8971: - [~mengxr] You mentioned that the

[jira] [Commented] (SPARK-4412) Parquet logger cannot be configured

[ https://issues.apache.org/jira/browse/SPARK-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14658378#comment-14658378 ] Stephen Carman commented on SPARK-4412: --- This also happens to me a lot in Spark

[jira] [Resolved] (SPARK-5544) wholeTextFiles should recognize multiple input paths delimited by ,

[ https://issues.apache.org/jira/browse/SPARK-5544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5544. -- Resolution: Duplicate Target Version/s: (was: 1.5.0) wholeTextFiles should recognize

[jira] [Assigned] (SPARK-6227) PCA and SVD for PySpark

[ https://issues.apache.org/jira/browse/SPARK-6227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6227: --- Assignee: Apache Spark PCA and SVD for PySpark ---

[jira] [Commented] (SPARK-6227) PCA and SVD for PySpark

[ https://issues.apache.org/jira/browse/SPARK-6227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14658403#comment-14658403 ] Apache Spark commented on SPARK-6227: - User 'MechCoder' has created a pull request for

  1   2   3   4   >