[jira] [Updated] (SPARK-12319) ExchangeCoordinatorSuite fails on big-endian platforms

[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12319: -- Target Version/s: (was: 2.0.0) Summary: ExchangeCoordinatorSuite fails on big-endian

[jira] [Commented] (SPARK-12555) DatasetAggregatorSuite fails on big-endian platforms

[ https://issues.apache.org/jira/browse/SPARK-12555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073868#comment-15073868 ] Tim Preece commented on SPARK-12555: Yes it is a test failure. Thanks for updating the title. >

[jira] [Created] (SPARK-12557) Spark 1.5.1 is unable to read S3 file system (Java exception - s3a.S3AFileSystem not found)

Chiragkumar created SPARK-12557: --- Summary: Spark 1.5.1 is unable to read S3 file system (Java exception - s3a.S3AFileSystem not found) Key: SPARK-12557 URL: https://issues.apache.org/jira/browse/SPARK-12557

[jira] [Commented] (SPARK-12557) Spark 1.5.1 is unable to read S3 file system (Java exception - s3a.S3AFileSystem not found)

[ https://issues.apache.org/jira/browse/SPARK-12557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073938#comment-15073938 ] Chiragkumar commented on SPARK-12557: - Thanks Sean. Should I know the name of libraries so can able

[jira] [Updated] (SPARK-12555) Build Failure on 1.6

[ https://issues.apache.org/jira/browse/SPARK-12555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Preece updated SPARK-12555: --- Summary: Build Failure on 1.6 (was: Build Failure on 1.6 RC4) > Build Failure on 1.6 >

[jira] [Commented] (SPARK-12319) Address endian specific problems surfaced in 1.6

[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073801#comment-15073801 ] Tim Preece commented on SPARK-12319: Michael, Since this JIRA's description is not quite right and

[jira] [Commented] (SPARK-12511) streaming driver with checkpointing unable to finalize leading to OOM

[ https://issues.apache.org/jira/browse/SPARK-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073816#comment-15073816 ] Antony Mayi commented on SPARK-12511: - just found SPARK-11711 which looks to be the same issue >

[jira] [Resolved] (SPARK-11711) Finalizer memory leak is pyspark

[ https://issues.apache.org/jira/browse/SPARK-11711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11711. --- Resolution: Duplicate Merging this into the other as it has slightly more discussion of the same

[jira] [Updated] (SPARK-4819) Remove Guava's "Optional" from public API

[ https://issues.apache.org/jira/browse/SPARK-4819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4819: - Assignee: Sean Owen (was: Reynold Xin) I'm going to give this a try. The game plan is roughly to replace

[jira] [Assigned] (SPARK-12362) Create a full-fledged built-in SQL parser

[ https://issues.apache.org/jira/browse/SPARK-12362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12362: Assignee: Apache Spark > Create a full-fledged built-in SQL parser >

[jira] [Resolved] (SPARK-12557) Spark 1.5.1 is unable to read S3 file system (Java exception - s3a.S3AFileSystem not found)

[ https://issues.apache.org/jira/browse/SPARK-12557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12557. --- Resolution: Not A Problem > Spark 1.5.1 is unable to read S3 file system (Java exception - >

[jira] [Assigned] (SPARK-12362) Create a full-fledged built-in SQL parser

[ https://issues.apache.org/jira/browse/SPARK-12362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12362: Assignee: (was: Apache Spark) > Create a full-fledged built-in SQL parser >

[jira] [Resolved] (SPARK-12553) join is absloutly slow

[ https://issues.apache.org/jira/browse/SPARK-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12553. --- Resolution: Invalid Please put questions to user@. Without knowing what the data is like or how you

[jira] [Comment Edited] (SPARK-5948) Support writing to partitioned table for the Parquet data source

[ https://issues.apache.org/jira/browse/SPARK-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073755#comment-15073755 ] Yash Datta edited comment on SPARK-5948 at 12/29/15 10:18 AM: -- oh i see, So

[jira] [Commented] (SPARK-5948) Support writing to partitioned table for the Parquet data source

[ https://issues.apache.org/jira/browse/SPARK-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073755#comment-15073755 ] Yash Datta commented on SPARK-5948: --- oh i see, So does it mean that when using hive commands that use

[jira] [Commented] (SPARK-12553) join is absloutly slow

[ https://issues.apache.org/jira/browse/SPARK-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073780#comment-15073780 ] malouke commented on SPARK-12553: - h sean, sorry i am new user forgot to put I beg your pardon. but I use

[jira] [Updated] (SPARK-12554) Standalone app scheduler will hang when app.coreToAssign < minCoresPerExecutor

[ https://issues.apache.org/jira/browse/SPARK-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Xu updated SPARK-12554: - Description: In scheduleExecutorsOnWorker() in Master.scala, *val keepScheduling = coresToAssign >=

[jira] [Updated] (SPARK-12554) Standalone app scheduler will hang when app.coreToAssign < minCoresPerExecutor

[ https://issues.apache.org/jira/browse/SPARK-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Xu updated SPARK-12554: - Description: In scheduleExecutorsOnWorker() in Master.scala, *val keepScheduling = coresToAssign >=

[jira] [Assigned] (SPARK-12554) Standalone app scheduler will hang when app.coreToAssign < minCoresPerExecutor

[ https://issues.apache.org/jira/browse/SPARK-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12554: Assignee: Apache Spark > Standalone app scheduler will hang when app.coreToAssign <

[jira] [Comment Edited] (SPARK-10789) Cluster mode SparkSubmit classpath only includes Spark assembly

[ https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073832#comment-15073832 ] Roi Reshef edited comment on SPARK-10789 at 12/29/15 11:56 AM: --- Thanks

[jira] [Assigned] (SPARK-12554) Standalone app scheduler will hang when app.coreToAssign < minCoresPerExecutor

[ https://issues.apache.org/jira/browse/SPARK-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12554: Assignee: (was: Apache Spark) > Standalone app scheduler will hang when

[jira] [Commented] (SPARK-10789) Cluster mode SparkSubmit classpath only includes Spark assembly

[ https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073832#comment-15073832 ] Roi Reshef commented on SPARK-10789: Thanks [~jonathak]. That requires rebuilding spark and

[jira] [Created] (SPARK-12556) Pyspark dataframe unionAll call accepts incorrect input

Aravind B created SPARK-12556: -- Summary: Pyspark dataframe unionAll call accepts incorrect input Key: SPARK-12556 URL: https://issues.apache.org/jira/browse/SPARK-12556 Project: Spark Issue

[jira] [Updated] (SPARK-12555) Build Failure on 1.6 ( DatasetAggregatorSuite )

[ https://issues.apache.org/jira/browse/SPARK-12555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Preece updated SPARK-12555: --- Target Version/s: (was: 1.6.0) > Build Failure on 1.6 ( DatasetAggregatorSuite ) >

[jira] [Commented] (SPARK-12319) Address endian specific problems surfaced in 1.6

[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073821#comment-15073821 ] Tim Preece commented on SPARK-12319: The remaining problem is ExchangeCoordinatorSuite. I don't have

[jira] [Comment Edited] (SPARK-10789) Cluster mode SparkSubmit classpath only includes Spark assembly

[ https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073832#comment-15073832 ] Roi Reshef edited comment on SPARK-10789 at 12/29/15 11:55 AM: --- Thanks

[jira] [Resolved] (SPARK-12556) Pyspark dataframe unionAll call accepts incorrect input

[ https://issues.apache.org/jira/browse/SPARK-12556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravind B resolved SPARK-12556. Resolution: Duplicate > Pyspark dataframe unionAll call accepts incorrect input >

[jira] [Commented] (SPARK-12556) Pyspark dataframe unionAll call accepts incorrect input

[ https://issues.apache.org/jira/browse/SPARK-12556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073890#comment-15073890 ] Aravind B commented on SPARK-12556: Never, mind apparently this is a better and more comprehensive

[jira] [Commented] (SPARK-12554) Standalone app scheduler will hang when app.coreToAssign < minCoresPerExecutor

[ https://issues.apache.org/jira/browse/SPARK-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073750#comment-15073750 ] Apache Spark commented on SPARK-12554: -- User 'JerryLead' has created a pull request for this issue:

[jira] [Created] (SPARK-12555) Build Failure on 1.6 RC4

Tim Preece created SPARK-12555: -- Summary: Build Failure on 1.6 RC4 Key: SPARK-12555 URL: https://issues.apache.org/jira/browse/SPARK-12555 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-12555) Build Failure on 1.6 ( DatasetAggregatorSuite )

[ https://issues.apache.org/jira/browse/SPARK-12555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073805#comment-15073805 ] Tim Preece commented on SPARK-12555: Set priority to Major following guidance here -

[jira] [Updated] (SPARK-12555) DatasetAggregatorSuite fails on big-endian platforms

[ https://issues.apache.org/jira/browse/SPARK-12555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12555: -- Summary: DatasetAggregatorSuite fails on big-endian platforms (was: Build Failure on 1.6 (

[jira] [Commented] (SPARK-12319) Address endian specific problems surfaced in 1.6

[ https://issues.apache.org/jira/browse/SPARK-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073813#comment-15073813 ] Sean Owen commented on SPARK-12319: --- [~preece] what's the remaining problem here then? you can edit the

[jira] [Updated] (SPARK-12554) Standalone app scheduler will hang when app.coreToAssign < minCoresPerExecutor

[ https://issues.apache.org/jira/browse/SPARK-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Xu updated SPARK-12554: - Description: In scheduleExecutorsOnWorker() in Master.scala, *val keepScheduling = coresToAssign >=

[jira] [Updated] (SPARK-12554) Standalone app scheduler will hang when app.coreToAssign < minCoresPerExecutor

[ https://issues.apache.org/jira/browse/SPARK-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Xu updated SPARK-12554: - Description: In scheduleExecutorsOnWorker() in Master.scala, *val keepScheduling = coresToAssign >=

[jira] [Commented] (SPARK-10789) Cluster mode SparkSubmit classpath only includes Spark assembly

[ https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073840#comment-15073840 ] Sean Owen commented on SPARK-10789: --- I don't think we want to build another config flag in here. It

[jira] [Commented] (SPARK-12408) Spark 1.6 with tachyon 0.8.2 uses deprecated client

[ https://issues.apache.org/jira/browse/SPARK-12408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073905#comment-15073905 ] Rares Mirica commented on SPARK-12408: -- Thank you for the reply, this makes sense. > Spark 1.6

[jira] [Commented] (SPARK-12554) Standalone app scheduler will hang when app.coreToAssign < minCoresPerExecutor

[ https://issues.apache.org/jira/browse/SPARK-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073954#comment-15073954 ] Saisai Shao commented on SPARK-12554: - First from my understanding tasks can be scheduled after

[jira] [Updated] (SPARK-12554) Standalone app scheduler will hang when app.coreToAssign < minCoresPerExecutor

[ https://issues.apache.org/jira/browse/SPARK-12554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Xu updated SPARK-12554: - Description: In scheduleExecutorsOnWorker() in Master.scala, *val keepScheduling = coresToAssign >=

[jira] [Assigned] (SPARK-12362) Create a full-fledged built-in SQL parser

[ https://issues.apache.org/jira/browse/SPARK-12362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12362: Assignee: Apache Spark > Create a full-fledged built-in SQL parser >

[jira] [Updated] (SPARK-12557) Spark 1.5.1 is unable to read S3 file system (Java exception - s3a.S3AFileSystem not found)

[ https://issues.apache.org/jira/browse/SPARK-12557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12557: -- Target Version/s: (was: 1.5.1) Component/s: EC2 [~chiragkumarp] first, please read

[jira] [Commented] (SPARK-12557) Spark 1.5.1 is unable to read S3 file system (Java exception - s3a.S3AFileSystem not found)

[ https://issues.apache.org/jira/browse/SPARK-12557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073939#comment-15073939 ] Sean Owen commented on SPARK-12557: --- Yes, include the AWS Hadoop jars in your Hadoop installation or

[jira] [Commented] (SPARK-12557) Spark 1.5.1 is unable to read S3 file system (Java exception - s3a.S3AFileSystem not found)

[ https://issues.apache.org/jira/browse/SPARK-12557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15073960#comment-15073960 ] Sean Owen commented on SPARK-12557: --- You need to try adding it to your application, or else, make sure

<    1   2   3