[jira] [Updated] (SPARK-9629) Client session timed out, have not heard from server in

2015-08-04 Thread zengqiuyang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zengqiuyang updated SPARK-9629: --- Environment: spark1.4.1./make-distribution.sh --tgz -Dhadoop.version=2.5.2 -Dyarn.version=2.5.2 -

[jira] [Updated] (SPARK-8930) Throw a AnalysisException with meaningful messages if DataFrame#explode takes a star in expressions

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8930: --- Target Version/s: 1.5.0 > Throw a AnalysisException with meaningful messages if DataFrame#explode take

[jira] [Updated] (SPARK-8930) Throw a AnalysisException with meaningful messages if DataFrame#explode takes a star in expressions

2015-08-04 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-8930: Description: The current implementation throws an exception with meaningless messages if Da

[jira] [Updated] (SPARK-8930) Throw a AnalysisException with meaningful messages if DataFrame#explode takes a star in expressions

2015-08-04 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-8930: Summary: Throw a AnalysisException with meaningful messages if DataFrame#explode takes a sta

[jira] [Updated] (SPARK-8930) Throw a AnalysisException with meaningful messages when DataFrame#explode takes a star in expressions

2015-08-04 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-8930: Description: The current implementation throws an exception with meaningless messages if Da

[jira] [Updated] (SPARK-8930) Throw a AnalysisException with meaningful messages when DataFrame#explode takes a star in expressions

2015-08-04 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-8930: Summary: Throw a AnalysisException with meaningful messages when DataFrame#explode takes a s

[jira] [Commented] (SPARK-6488) Support addition/multiplication in PySpark's BlockMatrix

2015-08-04 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14654906#comment-14654906 ] Mike Dusenberry commented on SPARK-6488: I'd like to work on this one as well. >

[jira] [Updated] (SPARK-9618) SQLContext.read.schema().parquet() ignores the supplied schema

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9618: --- Assignee: Nathan Howell Target Version/s: 1.5.0 > SQLContext.read.schema().parquet() ignor

[jira] [Updated] (SPARK-9617) Implement json_tuple

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9617: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-9571 > Implement json_tuple > -

[jira] [Created] (SPARK-9629) Client session timed out, have not heard from server in

2015-08-04 Thread zengqiuyang (JIRA)
zengqiuyang created SPARK-9629: -- Summary: Client session timed out, have not heard from server in Key: SPARK-9629 URL: https://issues.apache.org/jira/browse/SPARK-9629 Project: Spark Issue Type

[jira] [Updated] (SPARK-6212) The EXPLAIN output of CTAS only shows the analyzed plan

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6212: --- Assignee: Yijie Shen > The EXPLAIN output of CTAS only shows the analyzed plan > -

[jira] [Assigned] (SPARK-9628) Rename Int and Long to SQLDate SQLTimestamp In DateTimeUtils

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9628: --- Assignee: (was: Apache Spark) > Rename Int and Long to SQLDate SQLTimestamp In DateTimeUt

[jira] [Commented] (SPARK-9628) Rename Int and Long to SQLDate SQLTimestamp In DateTimeUtils

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14654900#comment-14654900 ] Apache Spark commented on SPARK-9628: - User 'yjshen' has created a pull request for th

[jira] [Assigned] (SPARK-9628) Rename Int and Long to SQLDate SQLTimestamp In DateTimeUtils

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9628: --- Assignee: Apache Spark > Rename Int and Long to SQLDate SQLTimestamp In DateTimeUtils > -

[jira] [Created] (SPARK-9628) Rename Int and Long to SQLDate SQLTimestamp In DateTimeUtils

2015-08-04 Thread Yijie Shen (JIRA)
Yijie Shen created SPARK-9628: - Summary: Rename Int and Long to SQLDate SQLTimestamp In DateTimeUtils Key: SPARK-9628 URL: https://issues.apache.org/jira/browse/SPARK-9628 Project: Spark Issue T

[jira] [Resolved] (SPARK-9046) Decimal type support improvement and bug fix

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9046. Resolution: Fixed Fix Version/s: 1.5.0 > Decimal type support improvement and bug fix > -

[jira] [Created] (SPARK-9627) SQL job failed if the dataframe is cached

2015-08-04 Thread Davies Liu (JIRA)
Davies Liu created SPARK-9627: - Summary: SQL job failed if the dataframe is cached Key: SPARK-9627 URL: https://issues.apache.org/jira/browse/SPARK-9627 Project: Spark Issue Type: Bug Affects

[jira] [Resolved] (SPARK-8359) Spark SQL Decimal type precision loss on multiplication

2015-08-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8359. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7925 [https://github.com/

[jira] [Resolved] (SPARK-9119) In some cases, we may save wrong decimal values to parquet

2015-08-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9119. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7925 [https://github.com/

[jira] [Updated] (SPARK-9611) UnsafeFixedWidthAggregationMap.destructAndCreateExternalSorter will add an empty entry to if the map is empty.

2015-08-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9611: -- Shepherd: Josh Rosen > UnsafeFixedWidthAggregationMap.destructAndCreateExternalSorter will add an > emp

[jira] [Updated] (SPARK-6906) Improve Hive integration support

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6906: --- Issue Type: Story (was: Umbrella) > Improve Hive integration support > --

[jira] [Updated] (SPARK-6906) Improve Hive integration support

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6906: --- Epic Name: test Issue Type: Umbrella (was: Epic) > Improve Hive integration support > --

[jira] [Updated] (SPARK-9486) Add aliasing to data sources to allow external packages to register themselves with Spark

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9486: --- Sprint: Spark 1.5 release > Add aliasing to data sources to allow external packages to register > the

[jira] [Updated] (SPARK-8108) Build Hive module by default (i.e. remove -Phive profile)

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8108: --- Priority: Major (was: Blocker) > Build Hive module by default (i.e. remove -Phive profile) >

[jira] [Updated] (SPARK-8108) Build Hive module by default (i.e. remove -Phive profile)

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8108: --- Issue Type: Bug (was: Sub-task) Parent: (was: SPARK-6906) > Build Hive module by default

[jira] [Updated] (SPARK-8108) Build Hive module by default (i.e. remove -Phive profile)

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8108: --- Issue Type: Improvement (was: Bug) > Build Hive module by default (i.e. remove -Phive profile) >

[jira] [Updated] (SPARK-9616) Erroneous result in Frequent Items (SQL) when merging FrequentItemCounters

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9616: --- Assignee: Burak Yavuz > Erroneous result in Frequent Items (SQL) when merging FrequentItemCounters > -

[jira] [Updated] (SPARK-9616) Erroneous result in Frequent Items (SQL) when merging FrequentItemCounters

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9616: --- Sprint: Spark 1.5 release > Erroneous result in Frequent Items (SQL) when merging FrequentItemCounters

[jira] [Updated] (SPARK-9581) Add test for JSON UDTs

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9581: --- Sprint: Spark 1.5 release > Add test for JSON UDTs > -- > > Key: S

[jira] [Updated] (SPARK-9424) Document recent Parquet changes in Spark 1.5

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9424: --- Sprint: Spark 1.5 doc/QA sprint > Document recent Parquet changes in Spark 1.5 > -

[jira] [Closed] (SPARK-9131) Python UDFs change data values

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-9131. -- Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 (was: 1.4.2, 1.5.0) Goi

[jira] [Updated] (SPARK-9131) Python UDFs change data values

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9131: --- Sprint: Spark 1.5 release (was: Spark 1.5 doc/QA sprint) > Python UDFs change data values > -

[jira] [Updated] (SPARK-9131) Python UDFs change data values

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9131: --- Sprint: Spark 1.5 doc/QA sprint > Python UDFs change data values > -- > >

[jira] [Updated] (SPARK-6906) Improve Hive integration support

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6906: --- Issue Type: Epic (was: Story) > Improve Hive integration support > >

[jira] [Updated] (SPARK-6116) DataFrame API improvement umbrella ticket (Spark 1.5)

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6116: --- Sprint: Spark 1.5 doc/QA sprint (was: Spark 1.5 release) > DataFrame API improvement umbrella ticket

[jira] [Updated] (SPARK-6906) Improve Hive integration support

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6906: --- Issue Type: Story (was: Bug) > Improve Hive integration support > >

[jira] [Updated] (SPARK-6116) DataFrame API improvement umbrella ticket (Spark 1.5)

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6116: --- Sprint: Spark 1.5 release > DataFrame API improvement umbrella ticket (Spark 1.5) > --

[jira] [Updated] (SPARK-6591) Python data source load options should auto convert common types into strings

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6591: --- Sprint: Spark 1.5 release > Python data source load options should auto convert common types into stri

[jira] [Resolved] (SPARK-8159) Improve expression function coverage (Spark 1.5)

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8159. Resolution: Fixed Fix Version/s: 1.5.0 > Improve expression function coverage (Spark 1.5) > -

[jira] [Updated] (SPARK-9565) Spark SQL 1.5.0 QA/testing umbrella

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9565: --- Summary: Spark SQL 1.5.0 QA/testing umbrella (was: Spark SQL 1.5.0 testing umbrella) > Spark SQL 1.5

[jira] [Updated] (SPARK-9526) Utilize randomized tests to reveal potential bugs in sql expressions

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9526: --- Parent Issue: SPARK-9565 (was: SPARK-8159) > Utilize randomized tests to reveal potential bugs in sql

[jira] [Updated] (SPARK-9208) Audit DataFrame expression API for 1.5 release

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9208: --- Parent Issue: SPARK-9565 (was: SPARK-8159) > Audit DataFrame expression API for 1.5 release > ---

[jira] [Updated] (SPARK-9427) Add expression functions in SparkR

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9427: --- Issue Type: New Feature (was: Bug) > Add expression functions in SparkR > ---

[jira] [Updated] (SPARK-9541) DateTimeUtils cleanup

2015-08-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-9541: -- Assignee: Yijie Shen > DateTimeUtils cleanup > - > > Key: SPARK-9541

[jira] [Updated] (SPARK-9427) Add expression functions in SparkR

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9427: --- Issue Type: Bug (was: Sub-task) Parent: (was: SPARK-8159) > Add expression functions in S

[jira] [Resolved] (SPARK-8231) complex function: array_contains

2015-08-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8231. --- Resolution: Fixed Assignee: Pedro Rodriguez Fix Version/s: 1.5.0 > complex function: a

[jira] [Updated] (SPARK-8231) complex function: array_contains

2015-08-04 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-8231: -- Assignee: (was: Cheng Hao) > complex function: array_contains > > >

[jira] [Resolved] (SPARK-9540) Optimize PrefixSpan implementation

2015-08-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9540. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7937 [https://githu

[jira] [Updated] (SPARK-9493) Chain logistic regression with isotonic regression under the pipeline API

2015-08-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9493: - Shepherd: Joseph K. Bradley > Chain logistic regression with isotonic regression under the pipelin

[jira] [Assigned] (SPARK-9493) Chain logistic regression with isotonic regression under the pipeline API

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9493: --- Assignee: Apache Spark (was: Xiangrui Meng) > Chain logistic regression with isotonic regres

[jira] [Commented] (SPARK-9493) Chain logistic regression with isotonic regression under the pipeline API

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14654833#comment-14654833 ] Apache Spark commented on SPARK-9493: - User 'mengxr' has created a pull request for th

[jira] [Assigned] (SPARK-9493) Chain logistic regression with isotonic regression under the pipeline API

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9493: --- Assignee: Xiangrui Meng (was: Apache Spark) > Chain logistic regression with isotonic regres

[jira] [Commented] (SPARK-8542) PMML export for Decision Trees

2015-08-04 Thread Jasmine George (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14654819#comment-14654819 ] Jasmine George commented on SPARK-8542: --- Hi Joseph, I have the pull request ready. I

[jira] [Closed] (SPARK-9626) Add python api for base64, crc32, pmod, factorial and conv functions

2015-08-04 Thread zhichao-li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhichao-li closed SPARK-9626. - Resolution: Duplicate duplicated with SPARK-9513 > Add python api for base64, crc32, pmod, factorial and

[jira] [Commented] (SPARK-9625) SparkILoop creates sql context continuously, thousands of times

2015-08-04 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14654806#comment-14654806 ] Simeon Simeonov commented on SPARK-9625: This is a spark shell-specific issue seem

[jira] [Closed] (SPARK-9625) SparkILoop creates sql context continuously, thousands of times

2015-08-04 Thread Simeon Simeonov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simeon Simeonov closed SPARK-9625. -- Resolution: Won't Fix > SparkILoop creates sql context continuously, thousands of times > --

[jira] [Created] (SPARK-9626) Add python api for base64, crc32, pmod, factorial and conv functions

2015-08-04 Thread zhichao-li (JIRA)
zhichao-li created SPARK-9626: - Summary: Add python api for base64, crc32, pmod, factorial and conv functions Key: SPARK-9626 URL: https://issues.apache.org/jira/browse/SPARK-9626 Project: Spark

[jira] [Created] (SPARK-9625) SparkILoop creates sql context continuously, thousands of times

2015-08-04 Thread Simeon Simeonov (JIRA)
Simeon Simeonov created SPARK-9625: -- Summary: SparkILoop creates sql context continuously, thousands of times Key: SPARK-9625 URL: https://issues.apache.org/jira/browse/SPARK-9625 Project: Spark

[jira] [Assigned] (SPARK-9624) Make RateControllerSuite faster and more robust

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9624: --- Assignee: Tathagata Das (was: Apache Spark) > Make RateControllerSuite faster and more robus

[jira] [Commented] (SPARK-9624) Make RateControllerSuite faster and more robust

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14654728#comment-14654728 ] Apache Spark commented on SPARK-9624: - User 'tdas' has created a pull request for this

[jira] [Assigned] (SPARK-9624) Make RateControllerSuite faster and more robust

2015-08-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9624: --- Assignee: Apache Spark (was: Tathagata Das) > Make RateControllerSuite faster and more robus

[jira] [Created] (SPARK-9624) Make RateControllerSuite faster and more robust

2015-08-04 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-9624: Summary: Make RateControllerSuite faster and more robust Key: SPARK-9624 URL: https://issues.apache.org/jira/browse/SPARK-9624 Project: Spark Issue Type: Tes

[jira] [Updated] (SPARK-9565) Spark SQL 1.5.0 testing umbrella

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9565: Sprint: Spark 1.5 doc/QA sprint > Spark SQL 1.5.0 testing umbrella > ---

[jira] [Updated] (SPARK-7821) Hide private SQL JDBC classes from Javadoc

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7821: Sprint: Spark 1.5 doc/QA sprint > Hide private SQL JDBC classes from Javadoc > -

[jira] [Resolved] (SPARK-6923) Spark SQL CLI does not read Data Source schema correctly

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6923. - Resolution: Duplicate > Spark SQL CLI does not read Data Source schema correctly > ---

[jira] [Updated] (SPARK-6923) Spark SQL CLI does not read Data Source schema correctly

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6923: Sprint: Spark 1.5 release > Spark SQL CLI does not read Data Source schema correctly > -

[jira] [Updated] (SPARK-9046) Decimal type support improvement and bug fix

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9046: --- Assignee: Davies Liu > Decimal type support improvement and bug fix >

[jira] [Updated] (SPARK-9619) Rename Receiver.executor to Receiver.supervisor

2015-08-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9619: - Summary: Rename Receiver.executor to Receiver.supervisor (was: BlockGenerator should not receive

[jira] [Updated] (SPARK-7550) Support setting the right schema & serde when writing to Hive metastore

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7550: Sprint: Spark 1.5 release > Support setting the right schema & serde when writing to Hive me

[jira] [Updated] (SPARK-9046) Decimal type support improvement and bug fix

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9046: --- Sprint: Spark 1.5 release > Decimal type support improvement and bug fix > ---

[jira] [Updated] (SPARK-9141) DataFrame recomputed instead of using cached parent.

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9141: Sprint: Spark 1.5 release > DataFrame recomputed instead of using cached parent. > -

[jira] [Updated] (SPARK-6831) Document how to use external data sources

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6831: --- Sprint: Spark 1.5 doc/QA sprint > Document how to use external data sources >

[jira] [Updated] (SPARK-6116) DataFrame API improvement umbrella ticket (Spark 1.5)

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6116: Sprint: Spark 1.5 doc/QA sprint > DataFrame API improvement umbrella ticket (Spark 1.5) > --

[jira] [Updated] (SPARK-7178) Improve DataFrame documentation and code samples

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7178: --- Sprint: Spark 1.5 doc/QA sprint > Improve DataFrame documentation and code samples > -

[jira] [Updated] (SPARK-6116) DataFrame API improvement umbrella ticket (Spark 1.5)

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6116: Sprint: (was: Spark 1.5 doc/QA sprint) > DataFrame API improvement umbrella ticket (Spark

[jira] [Updated] (SPARK-9619) BlockGenerator should not receive data even after it has been stopped

2015-08-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9619: - Summary: BlockGenerator should not receive data even after it has been stopped (was: Restarting t

[jira] [Updated] (SPARK-9619) BlockGenerator should not receive data even after it has been stopped

2015-08-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9619: - Description: (was: The internal default block generator that is used by receivers gets reused

[jira] [Resolved] (SPARK-9513) Create Python API for all SQL functions

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9513. Resolution: Fixed Fix Version/s: 1.5.0 > Create Python API for all SQL functions > --

[jira] [Commented] (SPARK-9604) Unsafe ArrayData and MapData is very very slow

2015-08-04 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14654696#comment-14654696 ] Wenchen Fan commented on SPARK-9604: there is a known issue: https://github.com/apach

[jira] [Resolved] (SPARK-8522) Disable feature scaling in Linear and Logistic Regression

2015-08-04 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-8522. Resolution: Fixed > Disable feature scaling in Linear and Logistic Regression >

[jira] [Resolved] (SPARK-7119) ScriptTransform doesn't consider the output data type

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7119. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6638 [https:/

[jira] [Resolved] (SPARK-9432) Audit expression unit tests to make sure we pass the proper numeric ranges

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9432. Resolution: Fixed Fix Version/s: 1.5.0 > Audit expression unit tests to make sure we pass the

[jira] [Resolved] (SPARK-8313) Support Spark Packages containing R code with --packages

2015-08-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8313. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 713

[jira] [Updated] (SPARK-8313) Support Spark Packages containing R code with --packages

2015-08-04 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8313: - Assignee: Burak Yavuz > Support Spark Packages containing R code with --packages >

[jira] [Resolved] (SPARK-8601) Add an option to disable feature scaling in Linear Regression

2015-08-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-8601. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7875 [https

[jira] [Resolved] (SPARK-9609) Spelling error in Strategy.defaultStrategy

2015-08-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9609. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7941 [https

[jira] [Updated] (SPARK-9208) Audit DataFrame expression API for 1.5 release

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9208: Issue Type: Technical task (was: Sub-task) > Audit DataFrame expression API for 1.5 release

[jira] [Updated] (SPARK-6831) Document how to use external data sources

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6831: Issue Type: Documentation (was: Improvement) > Document how to use external data sources >

[jira] [Updated] (SPARK-9148) User-facing documentation for NaN handling semantics

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9148: Issue Type: Technical task (was: Sub-task) > User-facing documentation for NaN handling sem

[jira] [Updated] (SPARK-9242) Audit both built-in aggregate function and UDAF interface before 1.5.0 release

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9242: Issue Type: Technical task (was: Sub-task) > Audit both built-in aggregate function and UDA

[jira] [Updated] (SPARK-9228) Combine unsafe and codegen into a single option

2015-08-04 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9228: Assignee: Davies Liu (was: Michael Armbrust) > Combine unsafe and codegen into a single opt

[jira] [Updated] (SPARK-9453) Support records larger than default page size in UnsafeExternalShuffleSorter

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9453: --- Target Version/s: 1.6.0 > Support records larger than default page size in UnsafeExternalShuffleSorter

[jira] [Updated] (SPARK-9412) Support records larger than a page size

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9412: --- Target Version/s: 1.6.0 (was: 1.5.0) > Support records larger than a page size >

[jira] [Resolved] (SPARK-9598) do not expose generic getter in internal row

2015-08-04 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9598. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 > do not expose generic

[jira] [Updated] (SPARK-8514) LU factorization on BlockMatrix

2015-08-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8514: - Target Version/s: 1.6.0 (was: 1.5.0) > LU factorization on BlockMatrix >

[jira] [Resolved] (SPARK-9586) Update BinaryClassificationEvaluator to use setRawPredictionCol

2015-08-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9586. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7921 [https://githu

[jira] [Updated] (SPARK-5989) Model import/export for LDAModel

2015-08-04 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5989: - Description: Add save/load for LDAModel and its local and distributed variants. LDA was

[jira] [Created] (SPARK-9623) RandomForestRegressor: provide variance of predictions

2015-08-04 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-9623: Summary: RandomForestRegressor: provide variance of predictions Key: SPARK-9623 URL: https://issues.apache.org/jira/browse/SPARK-9623 Project: Spark

[jira] [Created] (SPARK-9622) DecisionTreeRegressor: provide variance of prediction

2015-08-04 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-9622: Summary: DecisionTreeRegressor: provide variance of prediction Key: SPARK-9622 URL: https://issues.apache.org/jira/browse/SPARK-9622 Project: Spark I

[jira] [Updated] (SPARK-6485) Add CoordinateMatrix/RowMatrix/IndexedRowMatrix in PySpark

2015-08-04 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6485: - Assignee: Mike Dusenberry > Add CoordinateMatrix/RowMatrix/IndexedRowMatrix in PySpark > -

  1   2   3   4   >