[jira] [Created] (SPARK-7367) CLI --help -h overrides the application arguments

Gianmario Spacagna created SPARK-7367: - Summary: CLI --help -h overrides the application arguments Key: SPARK-7367 URL: https://issues.apache.org/jira/browse/SPARK-7367 Project: Spark

[jira] [Updated] (SPARK-7367) CLI --help -h overrides the application arguments

[ https://issues.apache.org/jira/browse/SPARK-7367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gianmario Spacagna updated SPARK-7367: -- Description: The spark-submit script will parse the --help argument even if is provided

[jira] [Resolved] (SPARK-3454) Expose JSON representation of data shown in WebUI

[ https://issues.apache.org/jira/browse/SPARK-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-3454. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4435

[jira] [Created] (SPARK-7368) add QR decomposition for RowMatrix

yuhao yang created SPARK-7368: - Summary: add QR decomposition for RowMatrix Key: SPARK-7368 URL: https://issues.apache.org/jira/browse/SPARK-7368 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-7368) add QR decomposition for RowMatrix

[ https://issues.apache.org/jira/browse/SPARK-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7368: --- Assignee: Apache Spark add QR decomposition for RowMatrix

[jira] [Updated] (SPARK-7357) Improving HBaseTest example

[ https://issues.apache.org/jira/browse/SPARK-7357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7357: - Assignee: Jihong MA Improving HBaseTest example --- Key:

[jira] [Updated] (SPARK-7367) spark-submit CLI --help -h overrides the application arguments

[ https://issues.apache.org/jira/browse/SPARK-7367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gianmario Spacagna updated SPARK-7367: -- Affects Version/s: (was: 1.0.0) spark-submit CLI --help -h overrides the

[jira] [Resolved] (SPARK-5112) Expose SizeEstimator as a developer API

[ https://issues.apache.org/jira/browse/SPARK-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5112. -- Resolution: Fixed Fix Version/s: 1.4.0 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-5112) Expose SizeEstimator as a developer API

[ https://issues.apache.org/jira/browse/SPARK-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5112: - Priority: Minor (was: Major) Expose SizeEstimator as a developer API

[jira] [Commented] (SPARK-6910) Support for pushing predicates down to metastore for partition pruning

[ https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529639#comment-14529639 ] Yana Kadiyska commented on SPARK-6910: -- Can you please provide an update on this --

[jira] [Updated] (SPARK-7217) Add configuration to control the default behavior of StreamingContext.stop() implicitly calling SparkContext.stop()

[ https://issues.apache.org/jira/browse/SPARK-7217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7217: - Summary: Add configuration to control the default behavior of StreamingContext.stop() implicitly

[jira] [Assigned] (SPARK-7383) Python API for ml.feature

[ https://issues.apache.org/jira/browse/SPARK-7383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7383: --- Assignee: (was: Apache Spark) Python API for ml.feature -

[jira] [Assigned] (SPARK-7388) Python Api for Param[Array[T]]

[ https://issues.apache.org/jira/browse/SPARK-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7388: --- Assignee: Apache Spark Python Api for Param[Array[T]] --

[jira] [Commented] (SPARK-7383) Python API for ml.feature

[ https://issues.apache.org/jira/browse/SPARK-7383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529800#comment-14529800 ] Apache Spark commented on SPARK-7383: - User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-7388) Python Api for Param[Array[T]]

[ https://issues.apache.org/jira/browse/SPARK-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7388: --- Assignee: (was: Apache Spark) Python Api for Param[Array[T]]

[jira] [Commented] (SPARK-7388) Python Api for Param[Array[T]]

[ https://issues.apache.org/jira/browse/SPARK-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529799#comment-14529799 ] Apache Spark commented on SPARK-7388: - User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-7383) Python API for ml.feature

[ https://issues.apache.org/jira/browse/SPARK-7383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7383: --- Assignee: Apache Spark Python API for ml.feature -

[jira] [Created] (SPARK-7391) Dag visualization: open viz on stage page if from job page

Andrew Or created SPARK-7391: Summary: Dag visualization: open viz on stage page if from job page Key: SPARK-7391 URL: https://issues.apache.org/jira/browse/SPARK-7391 Project: Spark Issue Type:

[jira] [Updated] (SPARK-7391) Dag visualization: open viz on stage page if from job page

[ https://issues.apache.org/jira/browse/SPARK-7391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7391: - Issue Type: Improvement (was: Bug) Dag visualization: open viz on stage page if from job page

[jira] [Resolved] (SPARK-6841) Similar to `stats.py` in Python, add support for mean, median, stdev etc.

[ https://issues.apache.org/jira/browse/SPARK-6841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-6841. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Qian Huang Similar to `stats.py`

[jira] [Commented] (SPARK-6810) Performance benchmarks for SparkR

[ https://issues.apache.org/jira/browse/SPARK-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529873#comment-14529873 ] Shivaram Venkataraman commented on SPARK-6810: -- Moving this to 1.5 as the

[jira] [Updated] (SPARK-6810) Performance benchmarks for SparkR

[ https://issues.apache.org/jira/browse/SPARK-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6810: - Target Version/s: 1.5.0 (was: 1.4.0) Performance benchmarks for SparkR

[jira] [Commented] (SPARK-7341) Fix the flaky test: org.apache.spark.streaming.InputStreamsSuite.socket input stream

[ https://issues.apache.org/jira/browse/SPARK-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529573#comment-14529573 ] Andrew Or commented on SPARK-7341: -- I see, looks like a false alarm then. Thanks for the

[jira] [Commented] (SPARK-7372) Multiclass SVM - One vs All wrapper

[ https://issues.apache.org/jira/browse/SPARK-7372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529592#comment-14529592 ] Renat Bekbolatov commented on SPARK-7372: - The main difference is probably an

[jira] [Commented] (SPARK-6910) Support for pushing predicates down to metastore for partition pruning

[ https://issues.apache.org/jira/browse/SPARK-6910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529666#comment-14529666 ] Michael Armbrust commented on SPARK-6910: - Target is Spark 1.5. In Spark 1.3 a

[jira] [Resolved] (SPARK-6231) Join on two tables (generated from same one) is broken

[ https://issues.apache.org/jira/browse/SPARK-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6231. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5919

[jira] [Comment Edited] (SPARK-5041) hive-exec jar should be generated with JDK 6

[ https://issues.apache.org/jira/browse/SPARK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529786#comment-14529786 ] Haifang Chen edited comment on SPARK-5041 at 5/6/15 2:42 AM: -

[jira] [Comment Edited] (SPARK-5041) hive-exec jar should be generated with JDK 6

[ https://issues.apache.org/jira/browse/SPARK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529786#comment-14529786 ] Haifang Chen edited comment on SPARK-5041 at 5/6/15 2:41 AM: -

[jira] [Created] (SPARK-7390) CovarianceCounter in StatFunctions might calculate incorrect result

Liang-Chi Hsieh created SPARK-7390: -- Summary: CovarianceCounter in StatFunctions might calculate incorrect result Key: SPARK-7390 URL: https://issues.apache.org/jira/browse/SPARK-7390 Project: Spark

[jira] [Assigned] (SPARK-7321) Add Column expression for conditional statements (if, case)

[ https://issues.apache.org/jira/browse/SPARK-7321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7321: --- Assignee: Apache Spark Add Column expression for conditional statements (if, case)

[jira] [Assigned] (SPARK-7321) Add Column expression for conditional statements (if, case)

[ https://issues.apache.org/jira/browse/SPARK-7321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7321: --- Assignee: (was: Apache Spark) Add Column expression for conditional statements (if,

[jira] [Commented] (SPARK-7321) Add Column expression for conditional statements (if, case)

[ https://issues.apache.org/jira/browse/SPARK-7321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529828#comment-14529828 ] Apache Spark commented on SPARK-7321: - User 'kaka1992' has created a pull request for

[jira] [Updated] (SPARK-6798) Fix Date serialization in SparkR

[ https://issues.apache.org/jira/browse/SPARK-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6798: - Priority: Minor (was: Major) Fix Date serialization in SparkR

[jira] [Updated] (SPARK-6822) lapplyPartition passes empty list to function

[ https://issues.apache.org/jira/browse/SPARK-6822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6822: - Target Version/s: 1.5.0 (was: 1.4.0) lapplyPartition passes empty list to

[jira] [Commented] (SPARK-6837) SparkR failure in processClosure

[ https://issues.apache.org/jira/browse/SPARK-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529869#comment-14529869 ] Shivaram Venkataraman commented on SPARK-6837: -- Moving this to 1.5 for we

[jira] [Assigned] (SPARK-7217) Add configuration to control the default behavior of StreamingContext.stop() implicitly calling SparkContext.stop()

[ https://issues.apache.org/jira/browse/SPARK-7217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7217: --- Assignee: Apache Spark (was: Tathagata Das) Add configuration to control the default

[jira] [Commented] (SPARK-7249) Updated Hadoop dependencies due to inconsistency in the versions

[ https://issues.apache.org/jira/browse/SPARK-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529771#comment-14529771 ] Konstantin Shaposhnikov commented on SPARK-7249: SPARK-7042 is somewhat

[jira] [Updated] (SPARK-5938) Generate row from json efficiently

[ https://issues.apache.org/jira/browse/SPARK-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5938: --- Assignee: Nathan Howell (was: Liang-Chi Hsieh) Generate row from json efficiently

[jira] [Updated] (SPARK-5443) jsonRDD with schema should ignore sub-objects that are omitted in schema

[ https://issues.apache.org/jira/browse/SPARK-5443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5443: --- Assignee: Nathan Howell jsonRDD with schema should ignore sub-objects that are omitted in schema

[jira] [Created] (SPARK-7386) Spark application level metrics application.$AppName.$number.cores doesn't reset on Standalone Master deployment

Bharat Venkat created SPARK-7386: Summary: Spark application level metrics application.$AppName.$number.cores doesn't reset on Standalone Master deployment Key: SPARK-7386 URL:

[jira] [Created] (SPARK-7388) Python Api for Param[Array[T]]

Burak Yavuz created SPARK-7388: -- Summary: Python Api for Param[Array[T]] Key: SPARK-7388 URL: https://issues.apache.org/jira/browse/SPARK-7388 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-7368) add QR decomposition for RowMatrix

[ https://issues.apache.org/jira/browse/SPARK-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529742#comment-14529742 ] yuhao yang commented on SPARK-7368: --- Oops, I was not aware of the previous effort.

[jira] [Commented] (SPARK-6932) A Prototype of Parameter Server

[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529803#comment-14529803 ] Zhenhong Chen commented on SPARK-6932: -- Hi,can you show more detail about why it is

[jira] [Commented] (SPARK-7390) CovarianceCounter in StatFunctions might calculate incorrect result

[ https://issues.apache.org/jira/browse/SPARK-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529813#comment-14529813 ] Apache Spark commented on SPARK-7390: - User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-7390) CovarianceCounter in StatFunctions might calculate incorrect result

[ https://issues.apache.org/jira/browse/SPARK-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7390: --- Assignee: (was: Apache Spark) CovarianceCounter in StatFunctions might calculate

[jira] [Assigned] (SPARK-7390) CovarianceCounter in StatFunctions might calculate incorrect result

[ https://issues.apache.org/jira/browse/SPARK-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7390: --- Assignee: Apache Spark CovarianceCounter in StatFunctions might calculate incorrect result

[jira] [Comment Edited] (SPARK-7310) SparkSubmit does not escape for java options and ^ won't work

[ https://issues.apache.org/jira/browse/SPARK-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529494#comment-14529494 ] Yitong Zhou edited comment on SPARK-7310 at 5/5/15 11:01 PM: -

[jira] [Commented] (SPARK-7310) SparkSubmit does not escape for java options and ^ won't work

[ https://issues.apache.org/jira/browse/SPARK-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529494#comment-14529494 ] Yitong Zhou commented on SPARK-7310: Hi Sean, I compared again I'm getting with Spark

[jira] [Commented] (SPARK-6943) Graphically show the RDD DAG on the UI

[ https://issues.apache.org/jira/browse/SPARK-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529585#comment-14529585 ] Kay Ousterhout commented on SPARK-6943: --- Sorry to be slow to respond, and I know

[jira] [Assigned] (SPARK-7389) Tachyon integration improvement

[ https://issues.apache.org/jira/browse/SPARK-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7389: --- Assignee: Apache Spark Tachyon integration improvement ---

[jira] [Created] (SPARK-7389) Tachyon integration improvement

shimingfei created SPARK-7389: - Summary: Tachyon integration improvement Key: SPARK-7389 URL: https://issues.apache.org/jira/browse/SPARK-7389 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-6837) SparkR failure in processClosure

[ https://issues.apache.org/jira/browse/SPARK-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6837: - Target Version/s: 1.5.0 (was: 1.4.0) SparkR failure in processClosure

[jira] [Assigned] (SPARK-7231) Make SparkR DataFrame API more dplyr friendly

[ https://issues.apache.org/jira/browse/SPARK-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-7231: Assignee: Shivaram Venkataraman Make SparkR DataFrame API more dplyr

[jira] [Commented] (SPARK-6812) filter() on DataFrame does not work as expected

[ https://issues.apache.org/jira/browse/SPARK-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529863#comment-14529863 ] Shivaram Venkataraman commented on SPARK-6812: -- Thanks [~sunrui] for

[jira] [Updated] (SPARK-5682) Add encrypted shuffle in spark

[ https://issues.apache.org/jira/browse/SPARK-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated SPARK-5682: Attachment: Design Document of Encrypted Spark Shuffle_20150506.docx Design Document of

[jira] [Updated] (SPARK-6834) Failed with error: ‘invalid package name’ Error in as.name(name) : attempt to use zero-length variable name

[ https://issues.apache.org/jira/browse/SPARK-6834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6834: - Target Version/s: 1.5.0 (was: 1.4.0) Failed with error: ‘invalid package name’

[jira] [Updated] (SPARK-6840) SparkR: private package functions unavailable when using lapplyPartition in package

[ https://issues.apache.org/jira/browse/SPARK-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6840: - Target Version/s: 1.5.0 (was: 1.4.0) SparkR: private package functions

[jira] [Commented] (SPARK-7265) Improving documentation for Spark SQL Hive support

[ https://issues.apache.org/jira/browse/SPARK-7265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529878#comment-14529878 ] Apache Spark commented on SPARK-7265: - User 'JihongMA' has created a pull request for

[jira] [Commented] (SPARK-5283) ML sharedParams should be private

[ https://issues.apache.org/jira/browse/SPARK-5283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529599#comment-14529599 ] Xiangrui Meng commented on SPARK-5283: -- Fixed as part of

[jira] [Updated] (SPARK-7387) CrossValidator example code in Python

[ https://issues.apache.org/jira/browse/SPARK-7387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7387: - Priority: Minor (was: Major) CrossValidator example code in Python

[jira] [Created] (SPARK-7387) CrossValidator example code in Python

Xiangrui Meng created SPARK-7387: Summary: CrossValidator example code in Python Key: SPARK-7387 URL: https://issues.apache.org/jira/browse/SPARK-7387 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-7341) Fix the flaky test: org.apache.spark.streaming.InputStreamsSuite.socket input stream

[ https://issues.apache.org/jira/browse/SPARK-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529495#comment-14529495 ] Andrew Or commented on SPARK-7341: -- this is still failing:

[jira] [Created] (SPARK-7385) Add RDD.foreachPartitionWithIndex to allow the index to be used in transactions in streaming apps

Tathagata Das created SPARK-7385: Summary: Add RDD.foreachPartitionWithIndex to allow the index to be used in transactions in streaming apps Key: SPARK-7385 URL: https://issues.apache.org/jira/browse/SPARK-7385

[jira] [Commented] (SPARK-6940) PySpark CrossValidator

[ https://issues.apache.org/jira/browse/SPARK-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529522#comment-14529522 ] Apache Spark commented on SPARK-6940: - User 'mengxr' has created a pull request for

[jira] [Commented] (SPARK-7385) Add RDD.foreachPartitionWithIndex to allow the index to be used in transactions in streaming apps

[ https://issues.apache.org/jira/browse/SPARK-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529545#comment-14529545 ] Apache Spark commented on SPARK-7385: - User 'tdas' has created a pull request for this

[jira] [Assigned] (SPARK-7385) Add RDD.foreachPartitionWithIndex to allow the index to be used in transactions in streaming apps

[ https://issues.apache.org/jira/browse/SPARK-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7385: --- Assignee: Apache Spark (was: Tathagata Das) Add RDD.foreachPartitionWithIndex to allow the

[jira] [Commented] (SPARK-7308) Should there be multiple concurrent attempts for one stage?

[ https://issues.apache.org/jira/browse/SPARK-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529618#comment-14529618 ] Imran Rashid commented on SPARK-7308: - I forgot to take {{TaskSetManager.isZombie}}

[jira] [Commented] (SPARK-7389) Tachyon integration improvement

[ https://issues.apache.org/jira/browse/SPARK-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529730#comment-14529730 ] Apache Spark commented on SPARK-7389: - User 'shimingfei' has created a pull request

[jira] [Commented] (SPARK-4208) stack over flow error while using sqlContext.sql

[ https://issues.apache.org/jira/browse/SPARK-4208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529770#comment-14529770 ] Shaza commented on SPARK-4208: -- I have the same issue with Spark 1.1.0, is it solved in other

[jira] [Commented] (SPARK-5041) hive-exec jar should be generated with JDK 6

[ https://issues.apache.org/jira/browse/SPARK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529786#comment-14529786 ] Haifang Chen commented on SPARK-5041: - Now, I have some problems, the yarn used

[jira] [Commented] (SPARK-7341) Fix the flaky test: org.apache.spark.streaming.InputStreamsSuite.socket input stream

[ https://issues.apache.org/jira/browse/SPARK-7341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529514#comment-14529514 ] Shixiong Zhu commented on SPARK-7341: - The revision is {code} commit

[jira] [Assigned] (SPARK-7385) Add RDD.foreachPartitionWithIndex to allow the index to be used in transactions in streaming apps

[ https://issues.apache.org/jira/browse/SPARK-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7385: --- Assignee: Tathagata Das (was: Apache Spark) Add RDD.foreachPartitionWithIndex to allow the

[jira] [Updated] (SPARK-7361) Throw unambiguous exception when attempting to start multiple StreamingContexts in the same JVM

[ https://issues.apache.org/jira/browse/SPARK-7361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7361: - Priority: Blocker (was: Major) Throw unambiguous exception when attempting to start multiple

[jira] [Closed] (SPARK-6755) Throw exception if the user tries to concurrently start multiple StreamingContexts in same JVM.

[ https://issues.apache.org/jira/browse/SPARK-6755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-6755. Resolution: Duplicate Throw exception if the user tries to concurrently start multiple

[jira] [Assigned] (SPARK-6799) Add dataframe examples for SparkR

[ https://issues.apache.org/jira/browse/SPARK-6799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-6799: Assignee: Shivaram Venkataraman Add dataframe examples for SparkR

[jira] [Updated] (SPARK-7248) Random number generators for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7248: --- Labels: starter (was: ) Random number generators for DataFrames

[jira] [Updated] (SPARK-7150) Facilitate random column generation for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-7150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7150: --- Target Version/s: 1.4.0 (was: 1.4.1, 1.5.0) Facilitate random column generation for DataFrames

[jira] [Commented] (SPARK-1437) Jenkins should build with Java 6

[ https://issues.apache.org/jira/browse/SPARK-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529982#comment-14529982 ] Sean Owen commented on SPARK-1437: -- Heh, so now that we're all going to Java 7, I don't

[jira] [Comment Edited] (SPARK-6984) Operations on tables with many partitions _very_slow

[ https://issues.apache.org/jira/browse/SPARK-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14519409#comment-14519409 ] Yana Kadiyska edited comment on SPARK-6984 at 5/6/15 12:26 AM:

[jira] [Comment Edited] (SPARK-5041) hive-exec jar should be generated with JDK 6

[ https://issues.apache.org/jira/browse/SPARK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529786#comment-14529786 ] Haifang Chen edited comment on SPARK-5041 at 5/6/15 2:39 AM: -

[jira] [Updated] (SPARK-6817) DataFrame UDFs in R

[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6817: - Target Version/s: 1.5.0 (was: 1.4.0) DataFrame UDFs in R ---

[jira] [Assigned] (SPARK-7392) Kryo buffer size can not be larger than 2M

[ https://issues.apache.org/jira/browse/SPARK-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7392: --- Assignee: Apache Spark Kryo buffer size can not be larger than 2M

[jira] [Assigned] (SPARK-7392) Kryo buffer size can not be larger than 2M

[ https://issues.apache.org/jira/browse/SPARK-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7392: --- Assignee: (was: Apache Spark) Kryo buffer size can not be larger than 2M

[jira] [Commented] (SPARK-7392) Kryo buffer size can not be larger than 2M

[ https://issues.apache.org/jira/browse/SPARK-7392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529946#comment-14529946 ] Apache Spark commented on SPARK-7392: - User 'liyezhang556520' has created a pull

[jira] [Resolved] (SPARK-5041) hive-exec jar should be generated with JDK 6

[ https://issues.apache.org/jira/browse/SPARK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5041. -- Resolution: Won't Fix Yeah, and this was a Hive artifact anyway. hive-exec jar should be generated

[jira] [Resolved] (SPARK-6267) Python API for IsotonicRegression

[ https://issues.apache.org/jira/browse/SPARK-6267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6267. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5890

[jira] [Updated] (SPARK-7150) Facilitate random column generation for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-7150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7150: --- Description: It would be handy to have easy ways to construct random columns for DataFrames.

[jira] [Commented] (SPARK-7035) Drop __getattr__ on pyspark.sql.DataFrame

[ https://issues.apache.org/jira/browse/SPARK-7035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529890#comment-14529890 ] Reynold Xin commented on SPARK-7035: I talked to more people offline about this also,

[jira] [Updated] (SPARK-7133) Implement struct, array, and map field accessor using apply in Scala and __getitem__ in Python

[ https://issues.apache.org/jira/browse/SPARK-7133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7133: --- Labels: (was: starter) Implement struct, array, and map field accessor using apply in Scala and

[jira] [Updated] (SPARK-7133) Implement struct, array, and map field accessor using apply in Scala and __getitem__ in Python

[ https://issues.apache.org/jira/browse/SPARK-7133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7133: --- Priority: Blocker (was: Major) Implement struct, array, and map field accessor using apply in Scala

[jira] [Updated] (SPARK-7150) Facilitate random column generation for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-7150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7150: --- Description: It would be handy to have easy ways to construct random columns for DataFrames.

[jira] [Updated] (SPARK-7150) Facilitate random column generation for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-7150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7150: --- Description: It would be handy to have easy ways to construct random columns for DataFrames.

[jira] [Updated] (SPARK-6812) filter() on DataFrame does not work as expected

[ https://issues.apache.org/jira/browse/SPARK-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6812: - Assignee: Sun Rui filter() on DataFrame does not work as expected

[jira] [Created] (SPARK-7392) Kryo buffer size can not be larger than 2M

Zhang, Liye created SPARK-7392: -- Summary: Kryo buffer size can not be larger than 2M Key: SPARK-7392 URL: https://issues.apache.org/jira/browse/SPARK-7392 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-7358) Move mathfunctions into functions

[ https://issues.apache.org/jira/browse/SPARK-7358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7358. Resolution: Fixed Fix Version/s: 1.4.0 Move mathfunctions into functions

[jira] [Commented] (SPARK-6812) filter() on DataFrame does not work as expected

[ https://issues.apache.org/jira/browse/SPARK-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529935#comment-14529935 ] Shivaram Venkataraman commented on SPARK-6812: -- Ah I see - We ran into a

[jira] [Updated] (SPARK-7248) Random number generators for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7248: --- Labels: (was: starter) Random number generators for DataFrames

[jira] [Resolved] (SPARK-7350) Attach the Streaming page when calling ssc.start()

[ https://issues.apache.org/jira/browse/SPARK-7350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7350. -- Resolution: Fixed Fix Version/s: 1.4.0 1.5.0 Issue resolved by pull request

[jira] [Updated] (SPARK-7350) Attach the Streaming page when calling ssc.start()

[ https://issues.apache.org/jira/browse/SPARK-7350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7350: - Assignee: Shixiong Zhu Attach the Streaming page when calling ssc.start()

[jira] [Updated] (SPARK-7202) Add SparseMatrixPickler to SerDe

[ https://issues.apache.org/jira/browse/SPARK-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7202: - Assignee: Manoj Kumar Add SparseMatrixPickler to SerDe

  1   2   3   >