[jira] [Updated] (SPARK-9663) ML Python API coverage issues found during 1.5 QA

2015-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9663: --- Description: This umbrella is for a list of Python API coverage issues which we should fix for the

[jira] [Updated] (SPARK-9663) ML Python API coverage issues found during 1.5 QA

2015-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9663: --- Description: This umbrella is for a list of Python API coverage issues which we should fix for the

[jira] [Comment Edited] (SPARK-9662) ML 1.5 QA: API: Python API coverage

2015-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14663255#comment-14663255 ] Yanbo Liang edited comment on SPARK-9662 at 8/9/15 6:09 AM: I

[jira] [Commented] (SPARK-9673) Use unbiased standard deviation in DataFrame.describe

2015-08-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14663277#comment-14663277 ] Apache Spark commented on SPARK-9673: - User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-9673) Use unbiased standard deviation in DataFrame.describe

2015-08-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9673: --- Assignee: Burak Yavuz (was: Apache Spark) Use unbiased standard deviation in

[jira] [Assigned] (SPARK-9673) Use unbiased standard deviation in DataFrame.describe

2015-08-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9673: --- Assignee: Apache Spark (was: Burak Yavuz) Use unbiased standard deviation in

[jira] [Created] (SPARK-9766) check and add miss docs for PySpark ML

2015-08-09 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-9766: -- Summary: check and add miss docs for PySpark ML Key: SPARK-9766 URL: https://issues.apache.org/jira/browse/SPARK-9766 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-9766) check and add miss docs for PySpark ML

2015-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9766: --- Affects Version/s: 1.5.0 check and add miss docs for PySpark ML

[jira] [Assigned] (SPARK-9766) check and add miss docs for PySpark ML

2015-08-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9766: --- Assignee: Apache Spark check and add miss docs for PySpark ML

[jira] [Commented] (SPARK-9766) check and add miss docs for PySpark ML

2015-08-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14663303#comment-14663303 ] Apache Spark commented on SPARK-9766: - User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-9766) check and add miss docs for PySpark ML

2015-08-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9766: --- Assignee: (was: Apache Spark) check and add miss docs for PySpark ML

[jira] [Updated] (SPARK-9604) Unsafe ArrayData and MapData is very very slow

2015-08-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9604: --- Priority: Critical (was: Blocker) Unsafe ArrayData and MapData is very very slow

[jira] [Closed] (SPARK-7821) Hide private SQL JDBC classes from Javadoc

2015-08-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-7821. -- Resolution: Duplicate Fix Version/s: 1.5.0 Hide private SQL JDBC classes from Javadoc

[jira] [Updated] (SPARK-9714) Cannot insert into a table using pySpark

2015-08-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9714: --- Description: This is a bug on the master branch. After creating the table (yun is the table name)

[jira] [Updated] (SPARK-9431) TimeIntervalType for for time intervals

2015-08-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9431: --- Issue Type: Story (was: New Feature) TimeIntervalType for for time intervals

[jira] [Commented] (SPARK-9622) DecisionTreeRegressor: provide variance of prediction

2015-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14663315#comment-14663315 ] Yanbo Liang commented on SPARK-9622: I will work on it. DecisionTreeRegressor:

[jira] [Commented] (SPARK-9623) RandomForestRegressor: provide variance of predictions

2015-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14663316#comment-14663316 ] Yanbo Liang commented on SPARK-9623: I will work on it. RandomForestRegressor:

[jira] [Closed] (SPARK-2957) Leverage Hadoop native io's fadvise and read-ahead in Netty transferTo

2015-08-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-2957. -- Resolution: Won't Fix Marking this as won't fix for now since it's unclear how much benefit this

[jira] [Created] (SPARK-9767) Remove ConnectionManager

2015-08-09 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9767: -- Summary: Remove ConnectionManager Key: SPARK-9767 URL: https://issues.apache.org/jira/browse/SPARK-9767 Project: Spark Issue Type: Task Components:

[jira] [Updated] (SPARK-5293) Enable Spark user applications to use different versions of Akka

2015-08-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5293: --- Affects Version/s: (was: 1.3.0) Enable Spark user applications to use different versions of Akka

[jira] [Updated] (SPARK-9738) remove FromUnsafe and add its codegen version to GenerateSafe

2015-08-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9738: --- Assignee: Wenchen Fan remove FromUnsafe and add its codegen version to GenerateSafe

[jira] [Commented] (SPARK-9604) Unsafe ArrayData and MapData is very very slow

2015-08-09 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14663335#comment-14663335 ] Wenchen Fan commented on SPARK-9604: cc [~rxin] [~davies] looks like the tests is fast

[jira] [Created] (SPARK-9768) Add ml.feature.ElementwiseProduct Python API

2015-08-09 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-9768: -- Summary: Add ml.feature.ElementwiseProduct Python API Key: SPARK-9768 URL: https://issues.apache.org/jira/browse/SPARK-9768 Project: Spark Issue Type:

[jira] [Updated] (SPARK-9663) ML Python API coverage issues found during 1.5 QA

2015-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9663: --- Description: This umbrella is for a list of Python API coverage issues which we should fix for the

[jira] [Updated] (SPARK-9663) ML Python API coverage issues found during 1.5 QA

2015-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9663: --- Description: This umbrella is for a list of Python API coverage issues which we should fix for the

[jira] [Updated] (SPARK-9768) Add Python API for ml.feature.ElementwiseProduct

2015-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9768: --- Description: Add Python API for ml.feature.ElementwiseProduct. (was: Add

[jira] [Updated] (SPARK-9768) Add Python API for ml.feature.ElementwiseProduct

2015-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9768: --- Summary: Add Python API for ml.feature.ElementwiseProduct (was: Add ml.feature.ElementwiseProduct

[jira] [Created] (SPARK-9769) Add Python API for ml.feature.CountVectorizerModel

2015-08-09 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-9769: -- Summary: Add Python API for ml.feature.CountVectorizerModel Key: SPARK-9769 URL: https://issues.apache.org/jira/browse/SPARK-9769 Project: Spark Issue Type:

[jira] [Updated] (SPARK-9663) ML Python API coverage issues found during 1.5 QA

2015-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9663: --- Description: This umbrella is for a list of Python API coverage issues which we should fix for the

[jira] [Updated] (SPARK-9768) Add Python API for ml.feature.ElementwiseProduct

2015-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9768: --- Description: Add Python API, user guide and example for ml.feature.ElementwiseProduct. (was: Add

[jira] [Created] (SPARK-9770) Add Python API for ml.feature.DCT

2015-08-09 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-9770: -- Summary: Add Python API for ml.feature.DCT Key: SPARK-9770 URL: https://issues.apache.org/jira/browse/SPARK-9770 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-9663) ML Python API coverage issues found during 1.5 QA

2015-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9663: --- Description: This umbrella is for a list of Python API coverage issues which we should fix for the

[jira] [Created] (SPARK-9771) Add Python API for ml.feature.MinMaxScaler

2015-08-09 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-9771: -- Summary: Add Python API for ml.feature.MinMaxScaler Key: SPARK-9771 URL: https://issues.apache.org/jira/browse/SPARK-9771 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-9663) ML Python API coverage issues found during 1.5 QA

2015-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9663: --- Description: This umbrella is for a list of Python API coverage issues which we should fix for the

[jira] [Updated] (SPARK-9663) ML Python API coverage issues found during 1.5 QA

2015-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9663: --- Description: This umbrella is for a list of Python API coverage issues which we should fix for the

[jira] [Created] (SPARK-9772) Add Python API, user guide and example for ml.feature.VectorSlicer

2015-08-09 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-9772: -- Summary: Add Python API, user guide and example for ml.feature.VectorSlicer Key: SPARK-9772 URL: https://issues.apache.org/jira/browse/SPARK-9772 Project: Spark

[jira] [Updated] (SPARK-9663) ML Python API coverage issues found during 1.5 QA

2015-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9663: --- Description: This umbrella is for a list of Python API coverage issues which we should fix for the

[jira] [Created] (SPARK-9773) Add Python API for MultilayerPerceptronClassifier

2015-08-09 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-9773: -- Summary: Add Python API for MultilayerPerceptronClassifier Key: SPARK-9773 URL: https://issues.apache.org/jira/browse/SPARK-9773 Project: Spark Issue Type:

[jira] [Updated] (SPARK-9663) ML Python API coverage issues found during 1.5 QA

2015-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9663: --- Description: This umbrella is for a list of Python API coverage issues which we should fix for the

[jira] [Created] (SPARK-9774) Add Python API for ml.regression.IsotonicRegression

2015-08-09 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-9774: -- Summary: Add Python API for ml.regression.IsotonicRegression Key: SPARK-9774 URL: https://issues.apache.org/jira/browse/SPARK-9774 Project: Spark Issue Type:

[jira] [Updated] (SPARK-9663) ML Python API coverage issues found during 1.5 QA

2015-08-09 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-9663: --- Description: This umbrella is for a list of Python API coverage issues which we should fix for the

[jira] [Assigned] (SPARK-9646) Metrics SQL/DataFrame query plans for Spark 1.5

2015-08-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9646: --- Assignee: Apache Spark Metrics SQL/DataFrame query plans for Spark 1.5

[jira] [Assigned] (SPARK-9646) Metrics SQL/DataFrame query plans for Spark 1.5

2015-08-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9646: --- Assignee: (was: Apache Spark) Metrics SQL/DataFrame query plans for Spark 1.5

[jira] [Commented] (SPARK-9646) Metrics SQL/DataFrame query plans for Spark 1.5

2015-08-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14669886#comment-14669886 ] Apache Spark commented on SPARK-9646: - User 'zsxwing' has created a pull request for

[jira] [Assigned] (SPARK-9768) Add Python API for ml.feature.ElementwiseProduct

2015-08-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9768: --- Assignee: Apache Spark Add Python API for ml.feature.ElementwiseProduct

[jira] [Commented] (SPARK-9768) Add Python API for ml.feature.ElementwiseProduct

2015-08-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679075#comment-14679075 ] Apache Spark commented on SPARK-9768: - User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-9768) Add Python API for ml.feature.ElementwiseProduct

2015-08-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9768: --- Assignee: (was: Apache Spark) Add Python API for ml.feature.ElementwiseProduct

[jira] [Commented] (SPARK-9770) Add Python API for ml.feature.DCT

2015-08-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679076#comment-14679076 ] Sean Owen commented on SPARK-9770: -- Does this really need to be 20 JIRAs? I can sort of

[jira] [Resolved] (SPARK-8930) Throw a AnalysisException with meaningful messages if DataFrame#explode takes a star in expressions

2015-08-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-8930. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8057

[jira] [Updated] (SPARK-9737) Add the suggested configuration when required executor memory is above the max threshold of this cluster on YARN mode

2015-08-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9737: - Assignee: Yadong Qi Add the suggested configuration when required executor memory is above the max

[jira] [Assigned] (SPARK-9720) spark.ml Identifiable types should have UID in toString methods

2015-08-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9720: --- Assignee: Apache Spark spark.ml Identifiable types should have UID in toString methods

[jira] [Commented] (SPARK-9720) spark.ml Identifiable types should have UID in toString methods

2015-08-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679228#comment-14679228 ] Apache Spark commented on SPARK-9720: - User 'BertrandDechoux' has created a pull

[jira] [Assigned] (SPARK-9720) spark.ml Identifiable types should have UID in toString methods

2015-08-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9720: --- Assignee: (was: Apache Spark) spark.ml Identifiable types should have UID in toString

[jira] [Commented] (SPARK-9600) DataFrameWriter.saveAsTable always writes data to /user/hive/warehouse

2015-08-09 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679251#comment-14679251 ] Sudhakar Thota commented on SPARK-9600: --- Cheng Lian, Your statements above have

[jira] [Created] (SPARK-9776) Another instance of Derby may have already booted the database

2015-08-09 Thread Sudhakar Thota (JIRA)
Sudhakar Thota created SPARK-9776: - Summary: Another instance of Derby may have already booted the database Key: SPARK-9776 URL: https://issues.apache.org/jira/browse/SPARK-9776 Project: Spark

[jira] [Created] (SPARK-9775) Query Mesos for number of CPUs to set default parallelism

2015-08-09 Thread Herman Schistad (JIRA)
Herman Schistad created SPARK-9775: -- Summary: Query Mesos for number of CPUs to set default parallelism Key: SPARK-9775 URL: https://issues.apache.org/jira/browse/SPARK-9775 Project: Spark

[jira] [Resolved] (SPARK-9752) Sample operator should avoid row copying and support UnsafeRow

2015-08-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9752. Resolution: Fixed Fix Version/s: 1.5.0 Sample operator should avoid row copying and support

[jira] [Resolved] (SPARK-9751) Audit operators to make sure they can support UnsafeRows

2015-08-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9751. Resolution: Fixed Fix Version/s: 1.5.0 Audit operators to make sure they can support

[jira] [Resolved] (SPARK-9737) Add the suggested configuration when required executor memory is above the max threshold of this cluster on YARN mode

2015-08-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9737. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8028

[jira] [Commented] (SPARK-9746) PairRDDFunctions.countByKey: values/counts always 1

2015-08-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679279#comment-14679279 ] Sean Owen commented on SPARK-9746: -- No, it doesn't: {code} scala val rdd =

[jira] [Commented] (SPARK-9714) Cannot insert into a table using pySpark

2015-08-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679269#comment-14679269 ] Yin Huai commented on SPARK-9714: - I could not reproduce it. Will try again. Cannot

[jira] [Updated] (SPARK-9776) Another instance of Derby may have already booted the database

2015-08-09 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-9776: -- Attachment: SPARK-9776-FL1.rtf Screen content Another instance of Derby may have already

[jira] [Updated] (SPARK-9750) SparseMatrix should override equals

2015-08-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9750: - Component/s: MLlib SparseMatrix should override equals ---

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

2015-08-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679293#comment-14679293 ] Sean Owen commented on SPARK-9776: -- Do you mean you're trying to make several

[jira] [Updated] (SPARK-6101) Create a SparkSQL DataSource API implementation for DynamoDB

2015-08-09 Thread Chris Fregly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Fregly updated SPARK-6101: Fix Version/s: (was: 1.5.0) 1.6.0 Description: similar to

[jira] [Commented] (SPARK-9744) Add RDD method to map with lag and lead

2015-08-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679316#comment-14679316 ] Sean Owen commented on SPARK-9744: -- OK, I don't know if it would be accepted, and you'd

[jira] [Resolved] (SPARK-9703) EnsureRequirements should not add unnecessary shuffles when only ordering requirements are unsatisfied

2015-08-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9703. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7988

[jira] [Updated] (SPARK-7420) Flaky test: o.a.s.streaming.JobGeneratorSuite Do not clear received block data too soon

2015-08-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-7420: - Labels: flaky-test (was: ) Flaky test: o.a.s.streaming.JobGeneratorSuite Do not

[jira] [Commented] (SPARK-9776) Another instance of Derby may have already booted the database

2015-08-09 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679390#comment-14679390 ] Sudhakar Thota commented on SPARK-9776: --- Hi, No, I am not trying to open multiple

[jira] [Commented] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

2015-08-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679351#comment-14679351 ] Apache Spark commented on SPARK-9340: - User 'dguy' has created a pull request for this

[jira] [Updated] (SPARK-9340) ParquetTypeConverter incorrectly handling of repeated types results in schema mismatch

2015-08-09 Thread Damian Guy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Damian Guy updated SPARK-9340: -- Affects Version/s: 1.5.0 ParquetTypeConverter incorrectly handling of repeated types results in schema

[jira] [Commented] (SPARK-9476) Kafka stream loses leader after 2h of operation

2015-08-09 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679380#comment-14679380 ] Cody Koeninger commented on SPARK-9476: --- The stacktraces you posted don't contain

[jira] [Commented] (SPARK-8890) Reduce memory consumption for dynamic partition insert

2015-08-09 Thread Fei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679447#comment-14679447 ] Fei Wang commented on SPARK-8890: - should this be part of tungsten? Reduce memory

[jira] [Issue Comment Deleted] (SPARK-7778) Add standard deviation aggregate expression

2015-08-09 Thread SsuTing Weng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SsuTing Weng updated SPARK-7778: Comment: was deleted (was: Hi, rakeshchalasani, I have a question about sub-task Add standard

[jira] [Issue Comment Deleted] (SPARK-7778) Add standard deviation aggregate expression

2015-08-09 Thread SsuTing Weng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SsuTing Weng updated SPARK-7778: Comment: was deleted (was: Hi, rakeshchalasani, I have a question about sub-task Add standard

[jira] [Commented] (SPARK-7778) Add standard deviation aggregate expression

2015-08-09 Thread SsuTing Weng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679500#comment-14679500 ] SsuTing Weng commented on SPARK-7778: - Hi, rakeshchalasani, I have a question about

[jira] [Commented] (SPARK-7778) Add standard deviation aggregate expression

2015-08-09 Thread SsuTing Weng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679502#comment-14679502 ] SsuTing Weng commented on SPARK-7778: - Hi, rakeshchalasani, I have a question about

[jira] [Resolved] (SPARK-9777) Window operator can accept UnsafeRows

2015-08-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9777. Resolution: Fixed Fix Version/s: 1.5.0 Window operator can accept UnsafeRows

[jira] [Commented] (SPARK-7778) Add standard deviation aggregate expression

2015-08-09 Thread SsuTing Weng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679501#comment-14679501 ] SsuTing Weng commented on SPARK-7778: - Hi, rakeshchalasani, I have a question about

[jira] [Assigned] (SPARK-9777) Window operator can accept UnsafeRows

2015-08-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9777: --- Assignee: Yin Huai (was: Apache Spark) Window operator can accept UnsafeRows

[jira] [Commented] (SPARK-9777) Window operator can accept UnsafeRows

2015-08-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679511#comment-14679511 ] Apache Spark commented on SPARK-9777: - User 'yhuai' has created a pull request for

[jira] [Assigned] (SPARK-9777) Window operator can accept UnsafeRows

2015-08-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9777: --- Assignee: Apache Spark (was: Yin Huai) Window operator can accept UnsafeRows

[jira] [Commented] (SPARK-9742) NullPointerException when using --packages

2015-08-09 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679495#comment-14679495 ] Herman van Hovell commented on SPARK-9742: -- Seems SPARK-9760 and this ticket are

[jira] [Commented] (SPARK-9720) spark.ml Identifiable types should have UID in toString methods

2015-08-09 Thread Sean Cho (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679481#comment-14679481 ] Sean Cho commented on SPARK-9720: - I was fooled by the word print. I thought it was said

[jira] [Created] (SPARK-9777) Window operator can accept UnsafeRows

2015-08-09 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9777: --- Summary: Window operator can accept UnsafeRows Key: SPARK-9777 URL: https://issues.apache.org/jira/browse/SPARK-9777 Project: Spark Issue Type: Sub-task