[jira] [Updated] (SPARK-13082) sqlCtx.real.json() doesn't work with PythonRDD

2016-01-29 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-13082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gaëtan Lehmann updated SPARK-13082: --- Description: This code works without problem: sqlCtx.read.json(sqlCtx.range(10).toJSON())

[jira] [Commented] (SPARK-3374) Spark on Yarn remove deprecated configs for 2.0

2016-01-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123498#comment-15123498 ] Thomas Graves commented on SPARK-3374: -- The Drive and AM configs should not be combined. In client

[jira] [Assigned] (SPARK-13076) Rename ClientInterface to HiveClient

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13076: Assignee: Reynold Xin (was: Apache Spark) > Rename ClientInterface to HiveClient >

[jira] [Created] (SPARK-13077) Expose BlockGenerator functionality in the public API

2016-01-29 Thread Matthew Taylor (JIRA)
Matthew Taylor created SPARK-13077: -- Summary: Expose BlockGenerator functionality in the public API Key: SPARK-13077 URL: https://issues.apache.org/jira/browse/SPARK-13077 Project: Spark

[jira] [Assigned] (SPARK-13076) Rename ClientInterface to HiveClient

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13076: Assignee: Apache Spark (was: Reynold Xin) > Rename ClientInterface to HiveClient >

[jira] [Commented] (SPARK-13076) Rename ClientInterface to HiveClient

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123198#comment-15123198 ] Apache Spark commented on SPARK-13076: -- User 'rxin' has created a pull request for this issue:

[jira] [Issue Comment Deleted] (SPARK-12982) SQLContext: temporary table registration does not accept valid identifier

2016-01-29 Thread Jayadevan M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jayadevan M updated SPARK-12982: Comment: was deleted (was: yes, was able to replicate.) > SQLContext: temporary table

[jira] [Commented] (SPARK-12982) SQLContext: temporary table registration does not accept valid identifier

2016-01-29 Thread Thomas Sebastian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123403#comment-15123403 ] Thomas Sebastian commented on SPARK-12982: -- Need to make change in the SQLConext.scala, to

[jira] [Commented] (SPARK-12982) SQLContext: temporary table registration does not accept valid identifier

2016-01-29 Thread Jayadevan M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123389#comment-15123389 ] Jayadevan M commented on SPARK-12982: - yes, was able to replicate. > SQLContext: temporary table

[jira] [Assigned] (SPARK-12982) SQLContext: temporary table registration does not accept valid identifier

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12982: Assignee: (was: Apache Spark) > SQLContext: temporary table registration does not

[jira] [Assigned] (SPARK-12982) SQLContext: temporary table registration does not accept valid identifier

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12982: Assignee: Apache Spark > SQLContext: temporary table registration does not accept valid

[jira] [Updated] (SPARK-13083) Small spark sql queries get blocked if there is a long running query over a lot a partitions

2016-01-29 Thread Vishal Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vishal Gupta updated SPARK-13083: - Summary: Small spark sql queries get blocked if there is a long running query over a lot a

[jira] [Commented] (SPARK-12982) SQLContext: temporary table registration does not accept valid identifier

2016-01-29 Thread Jayadevan M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123388#comment-15123388 ] Jayadevan M commented on SPARK-12982: - yes, was able to replicate. > SQLContext: temporary table

[jira] [Commented] (SPARK-12982) SQLContext: temporary table registration does not accept valid identifier

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123406#comment-15123406 ] Apache Spark commented on SPARK-12982: -- User 'jayadevanmurali' has created a pull request for this

[jira] [Comment Edited] (SPARK-12982) SQLContext: temporary table registration does not accept valid identifier

2016-01-29 Thread Thomas Sebastian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123403#comment-15123403 ] Thomas Sebastian edited comment on SPARK-12982 at 1/29/16 12:08 PM:

[jira] [Assigned] (SPARK-12997) Use cast expression to perform type cast in csv

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12997: Assignee: Apache Spark > Use cast expression to perform type cast in csv >

[jira] [Comment Edited] (SPARK-12982) SQLContext: temporary table registration does not accept valid identifier

2016-01-29 Thread Thomas Sebastian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123248#comment-15123248 ] Thomas Sebastian edited comment on SPARK-12982 at 1/29/16 9:30 AM: ---

[jira] [Commented] (SPARK-12982) SQLContext: temporary table registration does not accept valid identifier

2016-01-29 Thread Grzegorz Chilkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123266#comment-15123266 ] Grzegorz Chilkiewicz commented on SPARK-12982: -- I haven't started work on this, You are

[jira] [Updated] (SPARK-13075) Native full SQL system catalog

2016-01-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13075: Summary: Native full SQL system catalog (was: Native full feature catalog) > Native full SQL

[jira] [Updated] (SPARK-13075) Native full database/table system catalog

2016-01-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13075: Summary: Native full database/table system catalog (was: Native full SQL system catalog) >

[jira] [Updated] (SPARK-13075) Native database/table system catalog

2016-01-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13075: Summary: Native database/table system catalog (was: Native full database/table system catalog) >

[jira] [Created] (SPARK-13075) Native full feature catalog

2016-01-29 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-13075: --- Summary: Native full feature catalog Key: SPARK-13075 URL: https://issues.apache.org/jira/browse/SPARK-13075 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-13081) Allow set pythonExec of driver and executor through configuration

2016-01-29 Thread Jeff Zhang (JIRA)
Jeff Zhang created SPARK-13081: -- Summary: Allow set pythonExec of driver and executor through configuration Key: SPARK-13081 URL: https://issues.apache.org/jira/browse/SPARK-13081 Project: Spark

[jira] [Commented] (SPARK-13081) Allow set pythonExec of driver and executor through configuration

2016-01-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123207#comment-15123207 ] Jeff Zhang commented on SPARK-13081: working on it. > Allow set pythonExec of driver and executor

[jira] [Commented] (SPARK-12982) SQLContext: temporary table registration does not accept valid identifier

2016-01-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123287#comment-15123287 ] Reynold Xin commented on SPARK-12982: - Is this still a problem on master? > SQLContext: temporary

[jira] [Created] (SPARK-13082) sqlCtx.real.json() doesn't work with PythonRDD

2016-01-29 Thread JIRA
Gaëtan Lehmann created SPARK-13082: -- Summary: sqlCtx.real.json() doesn't work with PythonRDD Key: SPARK-13082 URL: https://issues.apache.org/jira/browse/SPARK-13082 Project: Spark Issue

[jira] [Commented] (SPARK-12997) Use cast expression to perform type cast in csv

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123190#comment-15123190 ] Apache Spark commented on SPARK-12997: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-12997) Use cast expression to perform type cast in csv

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12997: Assignee: (was: Apache Spark) > Use cast expression to perform type cast in csv >

[jira] [Created] (SPARK-13078) Create internal catalog API

2016-01-29 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-13078: --- Summary: Create internal catalog API Key: SPARK-13078 URL: https://issues.apache.org/jira/browse/SPARK-13078 Project: Spark Issue Type: Sub-task

[jira] [Comment Edited] (SPARK-12982) SQLContext: temporary table registration does not accept valid identifier

2016-01-29 Thread Jayadevan M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123023#comment-15123023 ] Jayadevan M edited comment on SPARK-12982 at 1/29/16 9:03 AM: -- I tried

[jira] [Commented] (SPARK-13070) Points out which physical file is the trouble maker when Parquet schema merging fails

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123188#comment-15123188 ] Apache Spark commented on SPARK-13070: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-12982) SQLContext: temporary table registration does not accept valid identifier

2016-01-29 Thread Thomas Sebastian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123248#comment-15123248 ] Thomas Sebastian commented on SPARK-12982: -- @Reynold Xin @Michael Armbrust Shall we add the

[jira] [Created] (SPARK-13079) Provide an in-memory implementation of the catalog API

2016-01-29 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-13079: --- Summary: Provide an in-memory implementation of the catalog API Key: SPARK-13079 URL: https://issues.apache.org/jira/browse/SPARK-13079 Project: Spark Issue

[jira] [Created] (SPARK-13080) Implementation of the internal catalog API using Hive

2016-01-29 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-13080: --- Summary: Implementation of the internal catalog API using Hive Key: SPARK-13080 URL: https://issues.apache.org/jira/browse/SPARK-13080 Project: Spark Issue

[jira] [Commented] (SPARK-13077) Expose BlockGenerator functionality in the public API

2016-01-29 Thread Matthew Taylor (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123201#comment-15123201 ] Matthew Taylor commented on SPARK-13077: If no new external modules are being added this

[jira] [Created] (SPARK-13083) Small spark sql queries get bloced if there is a long running query over a lot a partitions

2016-01-29 Thread Vishal Gupta (JIRA)
Vishal Gupta created SPARK-13083: Summary: Small spark sql queries get bloced if there is a long running query over a lot a partitions Key: SPARK-13083 URL: https://issues.apache.org/jira/browse/SPARK-13083

[jira] [Updated] (SPARK-13083) Small spark sql queries get bloced if there is a long running query over a lot a partitions

2016-01-29 Thread Vishal Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vishal Gupta updated SPARK-13083: - Description: Steps to reproduce : a) Run first query doing count(*) over a lot of paritions (

[jira] [Created] (SPARK-13076) Rename ClientInterface to HiveClient

2016-01-29 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-13076: --- Summary: Rename ClientInterface to HiveClient Key: SPARK-13076 URL: https://issues.apache.org/jira/browse/SPARK-13076 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-13078) Create internal catalog API

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13078: Assignee: Apache Spark (was: Reynold Xin) > Create internal catalog API >

[jira] [Assigned] (SPARK-13078) Create internal catalog API

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13078: Assignee: Reynold Xin (was: Apache Spark) > Create internal catalog API >

[jira] [Commented] (SPARK-13078) Create internal catalog API

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123296#comment-15123296 ] Apache Spark commented on SPARK-13078: -- User 'rxin' has created a pull request for this issue:

[jira] [Updated] (SPARK-13083) Small spark sql queries get bloced if there is a long running query over a lot a partitions

2016-01-29 Thread Vishal Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vishal Gupta updated SPARK-13083: - Description: Steps to reproduce : a) Run first query doing count(*) over a lot of paritions (

[jira] [Created] (SPARK-13085) Add scalastyle command used in build testing

2016-01-29 Thread Charles Allen (JIRA)
Charles Allen created SPARK-13085: - Summary: Add scalastyle command used in build testing Key: SPARK-13085 URL: https://issues.apache.org/jira/browse/SPARK-13085 Project: Spark Issue Type:

[jira] [Updated] (SPARK-13085) Add scalastyle command used in build testing

2016-01-29 Thread Charles Allen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Allen updated SPARK-13085: -- Description: As an occasional or new contributor, it is easy to screw up scala style. But

[jira] [Created] (SPARK-13084) Utilize @SerialVersionUID to avoid local class incompatibility

2016-01-29 Thread Ted Yu (JIRA)
Ted Yu created SPARK-13084: -- Summary: Utilize @SerialVersionUID to avoid local class incompatibility Key: SPARK-13084 URL: https://issues.apache.org/jira/browse/SPARK-13084 Project: Spark Issue

[jira] [Updated] (SPARK-13084) Utilize @SerialVersionUID to avoid local class incompatibility

2016-01-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-13084: --- Description: Here is related thread:

[jira] [Assigned] (SPARK-13086) Spark Shell for 2.11 does not allow loading files via '-i'

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13086: Assignee: Apache Spark > Spark Shell for 2.11 does not allow loading files via '-i' >

[jira] [Resolved] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

2016-01-29 Thread Luciano Resende (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende resolved SPARK-5159. Resolution: Fixed Fix Version/s: 1.5.2 After some of the proposed fixes went in with

[jira] [Commented] (SPARK-13086) Spark Shell for 2.11 does not allow loading files via '-i'

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123721#comment-15123721 ] Apache Spark commented on SPARK-13086: -- User 'dragos' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13086) Spark Shell for 2.11 does not allow loading files via '-i'

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13086: Assignee: (was: Apache Spark) > Spark Shell for 2.11 does not allow loading files via

[jira] [Commented] (SPARK-12749) Spark SQL JSON schema infernce should allow floating-point numbers as BigDecimal

2016-01-29 Thread Brandon Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123658#comment-15123658 ] Brandon Bradley commented on SPARK-12749: - Is it possible to get this in 1.6.1? > Spark SQL JSON

[jira] [Created] (SPARK-13086) Spark Shell for 2.11 does not allow loading files via '-i'

2016-01-29 Thread Iulian Dragos (JIRA)
Iulian Dragos created SPARK-13086: - Summary: Spark Shell for 2.11 does not allow loading files via '-i' Key: SPARK-13086 URL: https://issues.apache.org/jira/browse/SPARK-13086 Project: Spark

[jira] [Updated] (SPARK-13032) Basic ML Pipeline export/import functions for PySpark

2016-01-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-13032: -- Assignee: Yanbo Liang > Basic ML Pipeline export/import functions for PySpark >

[jira] [Resolved] (SPARK-13032) Basic ML Pipeline export/import functions for PySpark

2016-01-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-13032. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10469

[jira] [Updated] (SPARK-12626) MLlib 2.0 Roadmap

2016-01-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12626: -- Description: This is a master list for MLlib improvements we plan to have in Spark

[jira] [Commented] (SPARK-13037) PySpark ml.recommendation support export/import

2016-01-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123824#comment-15123824 ] Joseph K. Bradley commented on SPARK-13037: --- The blocking PR is now merged! > PySpark

[jira] [Commented] (SPARK-13034) PySpark ml.classification support export/import

2016-01-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123820#comment-15123820 ] Joseph K. Bradley commented on SPARK-13034: --- It's merged! > PySpark ml.classification support

[jira] [Updated] (SPARK-10873) Change history table to use datatables to support sorting columns and searching

2016-01-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-10873: -- Summary: Change history table to use datatables to support sorting columns and searching

[jira] [Assigned] (SPARK-12913) Reimplement stat functions as declarative function

2016-01-29 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-12913: -- Assignee: Davies Liu > Reimplement stat functions as declarative function >

[jira] [Resolved] (SPARK-10873) can't sort columns on history page

2016-01-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-10873. --- Resolution: Fixed Fix Version/s: 2.0.0 > can't sort columns on history page >

[jira] [Updated] (SPARK-10873) Change history to use datatables to support sorting columns and searching

2016-01-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-10873: -- Summary: Change history to use datatables to support sorting columns and searching (was:

[jira] [Commented] (SPARK-13033) PySpark ml.regression support export/import

2016-01-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123823#comment-15123823 ] Joseph K. Bradley commented on SPARK-13033: --- It's now merged! > PySpark ml.regression support

[jira] [Commented] (SPARK-9975) Add Normalized Closeness Centrality to Spark GraphX

2016-01-29 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124375#comment-15124375 ] Stavros Kontopoulos commented on SPARK-9975: Betweenness centrality seems straightforward to

[jira] [Updated] (SPARK-13084) Utilize @SerialVersionUID to avoid local class incompatibility

2016-01-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-13084: --- Component/s: Spark Core > Utilize @SerialVersionUID to avoid local class incompatibility >

[jira] [Resolved] (SPARK-5331) Spark workers can't find tachyon master as spark-ec2 doesn't set spark.tachyonStore.url

2016-01-29 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-5331. -- Resolution: Fixed Fix Version/s: 1.4.0 Fixed by

[jira] [Resolved] (SPARK-13088) DAG viz does not work with latest version of chrome

2016-01-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13088. --- Resolution: Fixed Fix Version/s: 2.0.0 1.6.1 1.5.3

[jira] [Resolved] (SPARK-13096) Make AccumulatorSuite#verifyPeakExecutionMemorySet less flaky

2016-01-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13096. --- Resolution: Fixed Fix Version/s: 2.0.0 > Make AccumulatorSuite#verifyPeakExecutionMemorySet

[jira] [Closed] (SPARK-12984) Not able to read CSV file using Spark 1.4.0

2016-01-29 Thread Jai Murugesh Rajasekaran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jai Murugesh Rajasekaran closed SPARK-12984. > Not able to read CSV file using Spark 1.4.0 >

[jira] [Commented] (SPARK-12984) Not able to read CSV file using Spark 1.4.0

2016-01-29 Thread Jai Murugesh Rajasekaran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124284#comment-15124284 ] Jai Murugesh Rajasekaran commented on SPARK-12984: -- Thanks > Not able to read CSV file

[jira] [Resolved] (SPARK-12984) Not able to read CSV file using Spark 1.4.0

2016-01-29 Thread Jai Murugesh Rajasekaran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jai Murugesh Rajasekaran resolved SPARK-12984. -- Resolution: Fixed > Not able to read CSV file using Spark 1.4.0 >

[jira] [Commented] (SPARK-12984) Not able to read CSV file using Spark 1.4.0

2016-01-29 Thread Jai Murugesh Rajasekaran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124282#comment-15124282 ] Jai Murugesh Rajasekaran commented on SPARK-12984: -- Issue resolved Tried with --jars

[jira] [Commented] (SPARK-13098) remove GenericInternalRowWithSchema

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124452#comment-15124452 ] Apache Spark commented on SPARK-13098: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13098) remove GenericInternalRowWithSchema

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13098: Assignee: (was: Apache Spark) > remove GenericInternalRowWithSchema >

[jira] [Commented] (SPARK-13085) Add scalastyle command used in build testing

2016-01-29 Thread Charles Allen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124518#comment-15124518 ] Charles Allen commented on SPARK-13085: --- I wanted to know what command was failing the build and it

[jira] [Updated] (SPARK-13097) Extend Binarizer to allow Double AND Vector inputs

2016-01-29 Thread Mike Seddon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Seddon updated SPARK-13097: Description: To enhance the existing SparkML Binarizer [SPARK-5891] to allow Vector in addition

[jira] [Assigned] (SPARK-12299) Remove history serving functionality from standalone Master

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12299: Assignee: Apache Spark > Remove history serving functionality from standalone Master >

[jira] [Commented] (SPARK-13085) Add scalastyle command used in build testing

2016-01-29 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124392#comment-15124392 ] Alex Bozarth commented on SPARK-13085: -- The script is located at $SPARK_HOME/dev/scalastyle Are you

[jira] [Assigned] (SPARK-12299) Remove history serving functionality from standalone Master

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12299: Assignee: (was: Apache Spark) > Remove history serving functionality from standalone

[jira] [Commented] (SPARK-12299) Remove history serving functionality from standalone Master

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124393#comment-15124393 ] Apache Spark commented on SPARK-12299: -- User 'BryanCutler' has created a pull request for this

[jira] [Assigned] (SPARK-13098) remove GenericInternalRowWithSchema

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13098: Assignee: Apache Spark > remove GenericInternalRowWithSchema >

[jira] [Commented] (SPARK-5095) Support launching multiple mesos executors in coarse grained mesos mode

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124473#comment-15124473 ] Apache Spark commented on SPARK-5095: - User 'mgummelt' has created a pull request for this issue:

[jira] [Resolved] (SPARK-10462) spark-ec2 not creating ephemeral volumes

2016-01-29 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10462. --- Resolution: Won't Fix According to

[jira] [Commented] (SPARK-13085) Add scalastyle command used in build testing

2016-01-29 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124543#comment-15124543 ] Alex Bozarth commented on SPARK-13085: -- Ah, I get it. I've been confused by this particular build

[jira] [Resolved] (SPARK-13076) Rename ClientInterface to HiveClient

2016-01-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13076. - Resolution: Fixed Fix Version/s: 2.0.0 > Rename ClientInterface to HiveClient >

[jira] [Commented] (SPARK-13094) Dataset Aggregators do not work with complex types

2016-01-29 Thread Deenar Toraskar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124278#comment-15124278 ] Deenar Toraskar commented on SPARK-13094: - [~marmbrus] Still the same error on nightly snapshot

[jira] [Commented] (SPARK-13096) Make AccumulatorSuite#verifyPeakExecutionMemorySet less flaky

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124306#comment-15124306 ] Apache Spark commented on SPARK-13096: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13096) Make AccumulatorSuite#verifyPeakExecutionMemorySet less flaky

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13096: Assignee: Apache Spark (was: Andrew Or) > Make

[jira] [Assigned] (SPARK-13096) Make AccumulatorSuite#verifyPeakExecutionMemorySet less flaky

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13096: Assignee: Andrew Or (was: Apache Spark) > Make

[jira] [Assigned] (SPARK-13097) Extend Binarizer to allow Double AND Vector inputs

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13097: Assignee: (was: Apache Spark) > Extend Binarizer to allow Double AND Vector inputs >

[jira] [Updated] (SPARK-13096) Make AccumulatorSuite#verifyPeakExecutionMemorySet less flaky

2016-01-29 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13096: -- Affects Version/s: 1.6.0 Target Version/s: 2.0.0 > Make

[jira] [Commented] (SPARK-13097) Extend Binarizer to allow Double AND Vector inputs

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124323#comment-15124323 ] Apache Spark commented on SPARK-13097: -- User 'seddonm1' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13097) Extend Binarizer to allow Double AND Vector inputs

2016-01-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13097: Assignee: Apache Spark > Extend Binarizer to allow Double AND Vector inputs >

[jira] [Updated] (SPARK-13097) Extend Binarizer to allow Double AND Vector inputs

2016-01-29 Thread Mike Seddon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Seddon updated SPARK-13097: Description: To enhance the existing SparkML Binarizer [SPARK-5891] to allow Vector in addition

[jira] [Updated] (SPARK-13091) Rewrite/Propagate constraints for Aliases

2016-01-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13091: - Assignee: Sameer Agarwal > Rewrite/Propagate constraints for Aliases >

[jira] [Updated] (SPARK-13090) Add initial support for constraint propagation in SparkSQL

2016-01-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13090: - Assignee: Sameer Agarwal > Add initial support for constraint propagation in SparkSQL >

[jira] [Updated] (SPARK-13092) Track constraints in ExpressionSet

2016-01-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13092: - Assignee: Sameer Agarwal > Track constraints in ExpressionSet >

[jira] [Issue Comment Deleted] (SPARK-10658) Could pyspark provide addJars() as scala spark API?

2016-01-29 Thread Tony Cebzanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tony Cebzanov updated SPARK-10658: -- Comment: was deleted (was: I'm also noticing that the %addjar magic doesn't seem to work with

[jira] [Commented] (SPARK-12964) SparkContext.localProperties leaked

2016-01-29 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124296#comment-15124296 ] Shixiong Zhu commented on SPARK-12964: -- +1 for removing the inheritance. >

[jira] [Commented] (SPARK-10658) Could pyspark provide addJars() as scala spark API?

2016-01-29 Thread Tony Cebzanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124298#comment-15124298 ] Tony Cebzanov commented on SPARK-10658: --- I'm also noticing that the %addjar magic doesn't seem to

[jira] [Created] (SPARK-13096) Make AccumulatorSuite#verifyPeakExecutionMemorySet less flaky

2016-01-29 Thread Andrew Or (JIRA)
Andrew Or created SPARK-13096: - Summary: Make AccumulatorSuite#verifyPeakExecutionMemorySet less flaky Key: SPARK-13096 URL: https://issues.apache.org/jira/browse/SPARK-13096 Project: Spark

  1   2   >