[jira] [Resolved] (SPARK-16505) YARN shuffle service should throw errors when it fails to start

2016-07-14 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-16505. --- Resolution: Fixed Fix Version/s: 2.1.0 > YARN shuffle service should throw errors

[jira] [Created] (SPARK-16546) Dataframe.drop supported multi-columns in spark api and should make python api also support it.

2016-07-14 Thread Weichen Xu (JIRA)
Weichen Xu created SPARK-16546: -- Summary: Dataframe.drop supported multi-columns in spark api and should make python api also support it. Key: SPARK-16546 URL: https://issues.apache.org/jira/browse/SPARK-16546

[jira] [Commented] (SPARK-14963) YarnShuffleService should use YARN getRecoveryPath() for leveldb location

2016-07-14 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376913#comment-15376913 ] Thomas Graves commented on SPARK-14963: --- committed fix in

[jira] [Commented] (SPARK-16230) Executors self-killing after being assigned tasks while still in init

2016-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377065#comment-15377065 ] Apache Spark commented on SPARK-16230: -- User 'tejasapatil' has created a pull request for this

[jira] [Resolved] (SPARK-16543) Rename the columns of `SHOW PARTITION/COLUMNS` commands

2016-07-14 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-16543. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.1.0 >

[jira] [Assigned] (SPARK-16546) Dataframe.drop supported multi-columns in spark api and should make python api also support it.

2016-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16546: Assignee: (was: Apache Spark) > Dataframe.drop supported multi-columns in spark api

[jira] [Commented] (SPARK-15687) Columnar execution engine

2016-07-14 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376999#comment-15376999 ] Kazuaki Ishizaki commented on SPARK-15687: -- It would be good to introduce trait for

[jira] [Updated] (SPARK-16505) YARN shuffle service should throw errors when it fails to start

2016-07-14 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-16505: -- Assignee: Marcelo Vanzin > YARN shuffle service should throw errors when it fails to start >

[jira] [Commented] (SPARK-13645) DAG Diagram not shown properly in Chrome

2016-07-14 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-13645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377022#comment-15377022 ] Maciej BryƄski commented on SPARK-13645: I think that problem is resolved in 2.0.0 > DAG Diagram

[jira] [Updated] (SPARK-16547) EventLoggingListener to auto create log base dir if it does not exist

2016-07-14 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-16547: Description: When the HDFS namenode gets changed or replaced, one has to manually create the

[jira] [Commented] (SPARK-16230) Executors self-killing after being assigned tasks while still in init

2016-07-14 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377055#comment-15377055 ] Tejas Patil commented on SPARK-16230: - With the fix from SPARK-13112, I see that `LaunchTask` is

[jira] [Resolved] (SPARK-16530) Wrong Keyword in ALTER TABLE CHANGE COLUMN

2016-07-14 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-16530. --- Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.1.0 > Wrong

[jira] [Comment Edited] (SPARK-15687) Columnar execution engine

2016-07-14 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376999#comment-15376999 ] Kazuaki Ishizaki edited comment on SPARK-15687 at 7/14/16 2:25 PM: --- It

[jira] [Updated] (SPARK-16546) Dataframe.drop supported multi-columns in spark api and should make python api also support it.

2016-07-14 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-16546: --- Component/s: SQL PySpark > Dataframe.drop supported multi-columns in spark api and

[jira] [Created] (SPARK-16547) EventLoggingListener to auto create log base dir if it does not exist

2016-07-14 Thread Tejas Patil (JIRA)
Tejas Patil created SPARK-16547: --- Summary: EventLoggingListener to auto create log base dir if it does not exist Key: SPARK-16547 URL: https://issues.apache.org/jira/browse/SPARK-16547 Project: Spark

[jira] [Assigned] (SPARK-16546) Dataframe.drop supported multi-columns in spark api and should make python api also support it.

2016-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16546: Assignee: Apache Spark > Dataframe.drop supported multi-columns in spark api and should

[jira] [Commented] (SPARK-16546) Dataframe.drop supported multi-columns in spark api and should make python api also support it.

2016-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377144#comment-15377144 ] Apache Spark commented on SPARK-16546: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-16520) Link executors to corresponding worker pages

2016-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16520: Assignee: Apache Spark > Link executors to corresponding worker pages >

[jira] [Assigned] (SPARK-16547) EventLoggingListener to auto create log base dir if it does not exist

2016-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16547: Assignee: Apache Spark > EventLoggingListener to auto create log base dir if it does not

[jira] [Commented] (SPARK-16547) EventLoggingListener to auto create log base dir if it does not exist

2016-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377219#comment-15377219 ] Apache Spark commented on SPARK-16547: -- User 'tejasapatil' has created a pull request for this

[jira] [Assigned] (SPARK-16547) EventLoggingListener to auto create log base dir if it does not exist

2016-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16547: Assignee: (was: Apache Spark) > EventLoggingListener to auto create log base dir if

[jira] [Resolved] (SPARK-16540) Jars specified with --jars will added twice when running on YARN

2016-07-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-16540. Resolution: Fixed Assignee: Saisai Shao Fix Version/s: 2.0.0 > Jars

[jira] [Updated] (SPARK-16529) SQLTestUtils.withTempDatabase should set `default` database before dropping

2016-07-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-16529: --- Assignee: Dongjoon Hyun > SQLTestUtils.withTempDatabase should set `default` database before

[jira] [Resolved] (SPARK-16529) SQLTestUtils.withTempDatabase should set `default` database before dropping

2016-07-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-16529. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 14184

[jira] [Updated] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16538: -- Assignee: Felix Cheung > Cannot use "SparkR::sql" > >

[jira] [Resolved] (SPARK-16528) HiveClientImpl throws NPE when reading database from a custom metastore

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16528. - Resolution: Fixed Assignee: Jacek Lewandowski Fix Version/s: 2.1.0

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-07-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377343#comment-15377343 ] Shivaram Venkataraman commented on SPARK-15799: --- I have written a design doc capturing the

[jira] [Resolved] (SPARK-16509) Rename window.partitionBy and window.orderBy

2016-07-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16509. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Commented] (SPARK-16547) EventLoggingListener to auto create log base dir if it does not exist

2016-07-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377281#comment-15377281 ] Marcelo Vanzin commented on SPARK-16547: This has come up a bunch of times and the answer here is

[jira] [Created] (SPARK-16548) java.io.CharConversionException: Invalid UTF-32 character prevents me from querying my data

2016-07-14 Thread Egor Pahomov (JIRA)
Egor Pahomov created SPARK-16548: Summary: java.io.CharConversionException: Invalid UTF-32 character prevents me from querying my data Key: SPARK-16548 URL: https://issues.apache.org/jira/browse/SPARK-16548

[jira] [Resolved] (SPARK-16547) EventLoggingListener to auto create log base dir if it does not exist

2016-07-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-16547. Resolution: Duplicate > EventLoggingListener to auto create log base dir if it does not

[jira] [Comment Edited] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-07-14 Thread Matt Martin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377301#comment-15377301 ] Matt Martin edited comment on SPARK-10063 at 7/14/16 5:16 PM: -- For what it's

[jira] [Commented] (SPARK-10063) Remove DirectParquetOutputCommitter

2016-07-14 Thread Matt Martin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377301#comment-15377301 ] Matt Martin commented on SPARK-10063: - For what it's worth, I gather that the Netflix folks have

[jira] [Updated] (SPARK-16532) Provide a REST API for submitting and tracking status of jobs

2016-07-14 Thread Joao Vasques (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joao Vasques updated SPARK-16532: - Description: When I was looking at the Spark Master dashboard I noticed the existence of a REST

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-07-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377347#comment-15377347 ] Shivaram Venkataraman commented on SPARK-15799: --- cc [~javierluraschi] [~j...@rstudio.com]

[jira] [Assigned] (SPARK-16520) Link executors to corresponding worker pages

2016-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16520: Assignee: (was: Apache Spark) > Link executors to corresponding worker pages >

[jira] [Commented] (SPARK-16520) Link executors to corresponding worker pages

2016-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377167#comment-15377167 ] Apache Spark commented on SPARK-16520: -- User 'nblintao' has created a pull request for this issue:

[jira] [Resolved] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-16538. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue

[jira] [Comment Edited] (SPARK-12945) ERROR LiveListenerBus: Listener JobProgressListener threw an exception

2016-07-14 Thread Ella Peltonen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377322#comment-15377322 ] Ella Peltonen edited comment on SPARK-12945 at 7/14/16 5:23 PM: I got

[jira] [Commented] (SPARK-12945) ERROR LiveListenerBus: Listener JobProgressListener threw an exception

2016-07-14 Thread Ella Peltonen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377322#comment-15377322 ] Ella Peltonen commented on SPARK-12945: --- I got that error too multiple times from different jobs. I

[jira] [Created] (SPARK-16549) GC Overhead Limit Reached and Core Dump

2016-07-14 Thread Niels Becker (JIRA)
Niels Becker created SPARK-16549: Summary: GC Overhead Limit Reached and Core Dump Key: SPARK-16549 URL: https://issues.apache.org/jira/browse/SPARK-16549 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-16520) Link executors to corresponding worker pages

2016-07-14 Thread Tao Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377197#comment-15377197 ] Tao Lin commented on SPARK-16520: - ## What changes were proposed in this pull request? Added a new

[jira] [Commented] (SPARK-16520) Link executors to corresponding worker pages

2016-07-14 Thread Tao Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377198#comment-15377198 ] Tao Lin commented on SPARK-16520: - It looks like this if we use the worker URL as the placeholder

[jira] [Updated] (SPARK-16440) Undeleted broadcast variables in Word2Vec causing OoM for long runs

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16440: Fix Version/s: (was: 2.0.1) 2.0.0 > Undeleted broadcast variables in

[jira] [Updated] (SPARK-16509) Rename window.partitionBy and window.orderBy

2016-07-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-16509: -- Assignee: Sun Rui > Rename window.partitionBy and window.orderBy >

[jira] [Updated] (SPARK-16369) tallSkinnyQR of RowMatrix should aware of empty partition

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16369: Fix Version/s: (was: 2.0.1) 2.0.0 > tallSkinnyQR of RowMatrix should aware

[jira] [Updated] (SPARK-16249) Change visibility of Object ml.clustering.LDA to public for loading

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16249: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-16278) Implement map_keys SQL function

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16278: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16538: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-15740) Word2VecSuite "big model load / save" caused OOM in maven jenkins builds

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15740: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-16401) Data Source APIs: Extending RelationProvider and CreatableRelationProvider Without SchemaRelationProvider

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16401: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-16509) Rename window.partitionBy and window.orderBy

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16509: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-16500) Add LBFG training not convergence warning for all ML algorithm

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16500: Fix Version/s: (was: 2.0.1) 2.0.0 > Add LBFG training not convergence

[jira] [Updated] (SPARK-16435) Behavior changes if initialExecutor is less than minExecutor for dynamic allocation

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16435: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-16276) Implement elt SQL function

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16276: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-16279) Implement map_values SQL function

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16279: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-16271) Implement Hive's UDFXPathUtil

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16271: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-16350) Complete output mode does not output updated aggregated value in Structured Streaming

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16350: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-13638) Support for saving with a quote mode

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13638: Fix Version/s: (was: 2.0.1) 2.0.0 > Support for saving with a quote mode >

[jira] [Updated] (SPARK-16425) SparkR summary() fails on column of type logical

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16425: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-16281) Implement parse_url SQL function

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16281: Fix Version/s: (was: 2.0.1) 2.0.0 > Implement parse_url SQL function >

[jira] [Updated] (SPARK-16375) [Spark web UI]:The wrong value(numCompletedTasks) has been assigned to the variable numSkippedTasks

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16375: Fix Version/s: (was: 2.0.1) 2.0.0 > [Spark web UI]:The wrong

[jira] [Commented] (SPARK-15815) Hang while enable blacklistExecutor and DynamicExecutorAllocator

2016-07-14 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377283#comment-15377283 ] Imran Rashid commented on SPARK-15815: -- [~SuYan] I've been thinking about this more, and I agree

[jira] [Commented] (SPARK-5311) EventLoggingListener throws exception if log directory does not exist

2016-07-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377285#comment-15377285 ] Marcelo Vanzin commented on SPARK-5311: --- Pasting the PR comments here for posterity: {quote}

[jira] [Updated] (SPARK-16284) Implement reflect and java_method SQL function

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16284: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-16288) Implement inline table generating function

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16288: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-16470) ml.regression.LinearRegression training data do not check whether the result actually reach convergence

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16470: Fix Version/s: (was: 2.0.1) 2.0.0 > ml.regression.LinearRegression training

[jira] [Updated] (SPARK-16372) Retag RDD to tallSkinnyQR of RowMatrix

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16372: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-16274) Implement xpath_boolean

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16274: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-16438) Add Asynchronous Actions documentation

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16438: Fix Version/s: (was: 2.0.1) 2.0.0 > Add Asynchronous Actions documentation

[jira] [Updated] (SPARK-16439) Incorrect information in SQL Query details

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16439: Fix Version/s: (was: 2.0.1) 2.0.0 > Incorrect information in SQL Query

[jira] [Updated] (SPARK-16285) Implement sentences SQL function

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16285: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-16310) SparkR csv source should have the same default na.string as R

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16310: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-16339) ScriptTransform does not print stderr when outstream is lost

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16339: Fix Version/s: (was: 2.0.1) 2.0.0 > ScriptTransform does not print stderr

[jira] [Updated] (SPARK-16485) Additional fixes to Mllib 2.0 documentation

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16485: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-16469) Long running Driver task while multiplying big matrices

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16469: Fix Version/s: (was: 2.0.1) 2.0.0 > Long running Driver task while

[jira] [Updated] (SPARK-14812) ML, Graph 2.0 QA: API: Experimental, DeveloperApi, final, sealed audit

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14812: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 > ML,

[jira] [Updated] (SPARK-16286) Implement stack table generating function

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16286: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Updated] (SPARK-16453) release script does not publish spark-hive-thriftserver_2.10

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16453: Fix Version/s: (was: 2.0.1) (was: 2.1.0) 2.0.0 >

[jira] [Commented] (SPARK-12945) ERROR LiveListenerBus: Listener JobProgressListener threw an exception

2016-07-14 Thread Ben Huntley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377331#comment-15377331 ] Ben Huntley commented on SPARK-12945: - Hi Ella, This approach worked for us as well. We had ~40k

[jira] [Commented] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377361#comment-15377361 ] Sean Owen commented on SPARK-16522: --- I'm not the release guy, but I also saw that RC3 looks like it has

[jira] [Resolved] (SPARK-16549) GC Overhead Limit Reached and Core Dump

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16549. --- Resolution: Fixed "Out of memory" isn't a Spark bug. From your description, it's not clear that you

[jira] [Commented] (SPARK-16549) GC Overhead Limit Reached and Core Dump

2016-07-14 Thread Niels Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377884#comment-15377884 ] Niels Becker commented on SPARK-16549: -- I added my Code, there is realy not mush I do > GC Overhead

[jira] [Commented] (SPARK-16528) HiveClientImpl throws NPE when reading database from a custom metastore

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378078#comment-15378078 ] Sean Owen commented on SPARK-16528: --- No, but the latest RC could theoretically be the released version,

[jira] [Updated] (SPARK-16549) GC Overhead Limit Reached and Core Dump

2016-07-14 Thread Niels Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niels Becker updated SPARK-16549: - Description: I'm submitting my application via spark-submit. It is running a long living

[jira] [Commented] (SPARK-16528) HiveClientImpl throws NPE when reading database from a custom metastore

2016-07-14 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377892#comment-15377892 ] Jacek Lewandowski commented on SPARK-16528: --- so it won't be available in 2.0.0 ? it hasn't been

[jira] [Reopened] (SPARK-16549) GC Overhead Limit Reached and Core Dump

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-16549: --- (Oops, didn't mean to resolve yet) > GC Overhead Limit Reached and Core Dump >

[jira] [Commented] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378171#comment-15378171 ] Apache Spark commented on SPARK-16538: -- User 'felixcheung' has created a pull request for this

[jira] [Updated] (SPARK-16549) GC Overhead Limit Reached and Core Dump

2016-07-14 Thread Niels Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niels Becker updated SPARK-16549: - Description: I'm submitting my application via spark-submit. It is running a long living

[jira] [Commented] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378054#comment-15378054 ] Felix Cheung commented on SPARK-16538: -- Remove Fix 1.6.3 since SPARK-10903 was not in Branch-1.6

[jira] [Comment Edited] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378054#comment-15378054 ] Felix Cheung edited comment on SPARK-16538 at 7/14/16 6:23 PM: --- Remove Fix

[jira] [Commented] (SPARK-16548) java.io.CharConversionException: Invalid UTF-32 character prevents me from querying my data

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378123#comment-15378123 ] Sean Owen commented on SPARK-16548: --- Yeah sure, but is that much better? the job continues and is

[jira] [Commented] (SPARK-16550) Caching data with replication doesn't replicate data

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378167#comment-15378167 ] Sean Owen commented on SPARK-16550: --- You have a shell-related problem here that caused the failure. It

[jira] [Commented] (SPARK-5311) EventLoggingListener throws exception if log directory does not exist

2016-07-14 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378177#comment-15378177 ] Tejas Patil commented on SPARK-5311: [~vanzin] : Thanks for pointing that out. I went through the PR

[jira] [Updated] (SPARK-16549) GC Overhead Limit Reached and Core Dump

2016-07-14 Thread Niels Becker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niels Becker updated SPARK-16549: - Description: I'm submitting my application via spark-submit. It is running a long living

[jira] [Updated] (SPARK-16538) Cannot use "SparkR::sql"

2016-07-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-16538: - Fix Version/s: (was: 1.6.3) > Cannot use "SparkR::sql" > > >

[jira] [Updated] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16522: Description: Spark applications running on Mesos throw exception upon exit as follows: {noformat}

[jira] [Commented] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-07-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378150#comment-15378150 ] Reynold Xin commented on SPARK-16522: - Does this fail the job? If it doesn't fail the job and simply

[jira] [Commented] (SPARK-16548) java.io.CharConversionException: Invalid UTF-32 character prevents me from querying my data

2016-07-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377352#comment-15377352 ] Sean Owen commented on SPARK-16548: --- Tough call, just because returning 'null' is also arguably wrong,

[jira] [Commented] (SPARK-16522) [MESOS] Spark application throws exception on exit

2016-07-14 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15377353#comment-15377353 ] Michael Gummelt commented on SPARK-16522: - [~srowen] I'm going to look into this now and resolve

  1   2   3   4   >