[jira] [Issue Comment Deleted] (SPARK-7148) Configure Parquet block size (row group size) for ML model import/export

2015-08-03 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-7148: --- Comment: was deleted (was: [~josephkb] If you are busy with other issues, please don't hesitate to

[jira] [Assigned] (SPARK-925) Allow ec2 scripts to load default options from a json file

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-925: -- Assignee: (was: Apache Spark) Allow ec2 scripts to load default options from a json file

[jira] [Commented] (SPARK-8064) Upgrade Hive to 1.2

2015-08-03 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652699#comment-14652699 ] Steve Loughran commented on SPARK-8064: --- While assigned to me, lots of people helped

[jira] [Assigned] (SPARK-9577) Surface concrete iterator types in various sort classes

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9577: --- Assignee: Apache Spark (was: Reynold Xin) Surface concrete iterator types in various sort

[jira] [Updated] (SPARK-5571) LDA should handle text as well

2015-08-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5571: - Target Version/s: 1.6.0 (was: 1.5.0) LDA should handle text as well

[jira] [Updated] (SPARK-7685) Handle high imbalanced data and apply weights to different samples in Logistic Regression

2015-08-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7685: - Shepherd: Joseph K. Bradley Handle high imbalanced data and apply weights to different

[jira] [Resolved] (SPARK-9577) Surface concrete iterator types in various sort classes

2015-08-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9577. Resolution: Fixed Surface concrete iterator types in various sort classes

[jira] [Commented] (SPARK-7148) Configure Parquet block size (row group size) for ML model import/export

2015-08-03 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652950#comment-14652950 ] Yanbo Liang commented on SPARK-7148: [~josephkb] If you are busy with other issues,

[jira] [Commented] (SPARK-7148) Configure Parquet block size (row group size) for ML model import/export

2015-08-03 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652951#comment-14652951 ] Yanbo Liang commented on SPARK-7148: [~josephkb] If you are busy with other issues,

[jira] [Updated] (SPARK-7398) Add back-pressure to Spark Streaming (umbrella JIRA)

2015-08-03 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7398: - Summary: Add back-pressure to Spark Streaming (umbrella JIRA) (was: Add back-pressure to Spark

[jira] [Commented] (SPARK-8802) Decimal.apply(BigDecimal).toBigDecimal may throw NumberFormatException

2015-08-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652733#comment-14652733 ] Reynold Xin commented on SPARK-8802: [~joshrosen] is this still a problem given the

[jira] [Updated] (SPARK-8983) ML Tuning Cross-Validation Improvements

2015-08-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8983: - Target Version/s: 1.6.0 (was: 1.5.0) ML Tuning Cross-Validation Improvements

[jira] [Updated] (SPARK-9483) UTF8String.getPrefix only works in little-endian order

2015-08-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9483: --- Shepherd: Davies Liu UTF8String.getPrefix only works in little-endian order

[jira] [Updated] (SPARK-8964) Use Exchange in limit operations (per partition limit - exchange to one partition - per partition limit)

2015-08-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8964: --- Target Version/s: 1.6.0 (was: 1.5.0) Use Exchange in limit operations (per partition limit -

[jira] [Updated] (SPARK-6591) Python data source load options should auto convert common types into strings

2015-08-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6591: --- Assignee: Yijie Shen (was: Davies Liu) Python data source load options should auto convert common

[jira] [Updated] (SPARK-8160) Tungsten style external aggregation

2015-08-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8160: --- Sprint: Week 32 Tungsten style external aggregation ---

[jira] [Commented] (SPARK-8069) Add support for cutoff to RandomForestClassifier

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652681#comment-14652681 ] Apache Spark commented on SPARK-8069: - User 'jkbradley' has created a pull request for

[jira] [Created] (SPARK-9576) DataFrame API improvement umbrella ticket (Spark 1.6)

2015-08-03 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9576: -- Summary: DataFrame API improvement umbrella ticket (Spark 1.6) Key: SPARK-9576 URL: https://issues.apache.org/jira/browse/SPARK-9576 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-8874) Add missing methods in Word2Vec ML

2015-08-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-8874. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7263

[jira] [Updated] (SPARK-7160) Support converting DataFrames to typed RDDs.

2015-08-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7160: Target Version/s: 1.6.0 (was: 1.5.0) Support converting DataFrames to typed RDDs.

[jira] [Assigned] (SPARK-9581) Add test for JSON UDTs

2015-08-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-9581: -- Assignee: Reynold Xin Add test for JSON UDTs -- Key:

[jira] [Created] (SPARK-9581) Add test for JSON UDTs

2015-08-03 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9581: -- Summary: Add test for JSON UDTs Key: SPARK-9581 URL: https://issues.apache.org/jira/browse/SPARK-9581 Project: Spark Issue Type: Test Components: SQL

[jira] [Resolved] (SPARK-6126) Support UDTs in JSON

2015-08-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-6126. Resolution: Fixed Assignee: Nathan Howell Fix Version/s: 1.5.0 This is already

[jira] [Commented] (SPARK-9514) Add EventHubsReceiver to support Spark Streaming using Azure EventHubs

2015-08-03 Thread shanyu zhao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652883#comment-14652883 ] shanyu zhao commented on SPARK-9514: Thanks [~CodingCat], I've created the pull

[jira] [Assigned] (SPARK-9582) Improve clarity of LocalLDAModel log likelihood methods

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9582: --- Assignee: Apache Spark (was: Joseph K. Bradley) Improve clarity of LocalLDAModel log

[jira] [Assigned] (SPARK-9582) Improve clarity of LocalLDAModel log likelihood methods

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9582: --- Assignee: Joseph K. Bradley (was: Apache Spark) Improve clarity of LocalLDAModel log

[jira] [Commented] (SPARK-9582) Improve clarity of LocalLDAModel log likelihood methods

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652885#comment-14652885 ] Apache Spark commented on SPARK-9582: - User 'jkbradley' has created a pull request for

[jira] [Updated] (SPARK-8416) Thread dump page should highlight Spark executor threads

2015-08-03 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8416: -- Assignee: Nan Zhu Thread dump page should highlight Spark executor threads

[jira] [Commented] (SPARK-7148) Configure Parquet block size (row group size) for ML model import/export

2015-08-03 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652953#comment-14652953 ] Yanbo Liang commented on SPARK-7148: [~josephkb] If you are busy with other issues,

[jira] [Commented] (SPARK-7148) Configure Parquet block size (row group size) for ML model import/export

2015-08-03 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652954#comment-14652954 ] Yanbo Liang commented on SPARK-7148: [~josephkb] If you are busy with other issues,

[jira] [Commented] (SPARK-7148) Configure Parquet block size (row group size) for ML model import/export

2015-08-03 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652955#comment-14652955 ] Yanbo Liang commented on SPARK-7148: [~josephkb] If you are busy with other issues,

[jira] [Commented] (SPARK-7148) Configure Parquet block size (row group size) for ML model import/export

2015-08-03 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652952#comment-14652952 ] Yanbo Liang commented on SPARK-7148: [~josephkb] If you are busy with other issues,

[jira] [Issue Comment Deleted] (SPARK-7148) Configure Parquet block size (row group size) for ML model import/export

2015-08-03 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-7148: --- Comment: was deleted (was: [~josephkb] If you are busy with other issues, please don't hesitate to

[jira] [Issue Comment Deleted] (SPARK-7148) Configure Parquet block size (row group size) for ML model import/export

2015-08-03 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-7148: --- Comment: was deleted (was: [~josephkb] If you are busy with other issues, please don't hesitate to

[jira] [Issue Comment Deleted] (SPARK-7148) Configure Parquet block size (row group size) for ML model import/export

2015-08-03 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-7148: --- Comment: was deleted (was: [~josephkb] If you are busy with other issues, please don't hesitate to

[jira] [Updated] (SPARK-8159) Improve expression function coverage (Spark 1.5)

2015-08-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8159: --- Sprint: Week 32 Improve expression function coverage (Spark 1.5)

[jira] [Updated] (SPARK-8978) Implement the DirectKafkaRateController

2015-08-03 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-8978: - Summary: Implement the DirectKafkaRateController (was: Implement the DirectKafkaController)

[jira] [Assigned] (SPARK-9131) Python UDFs change data values

2015-08-03 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-9131: - Assignee: Davies Liu Python UDFs change data values --

[jira] [Updated] (SPARK-8834) Throttle DStreams dynamically through back-pressure information

2015-08-03 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-8834: - Issue Type: New Feature (was: Sub-task) Parent: (was: SPARK-7398) Throttle DStreams

[jira] [Updated] (SPARK-5659) Flaky test: o.a.s.streaming.ReceiverSuite.block

2015-08-03 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-5659: - Priority: Minor (was: Critical) Flaky test: o.a.s.streaming.ReceiverSuite.block

[jira] [Assigned] (SPARK-9119) In some cases, we may save wrong decimal values to parquet

2015-08-03 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-9119: - Assignee: Davies Liu In some cases, we may save wrong decimal values to parquet

[jira] [Commented] (SPARK-8359) Spark SQL Decimal type precision loss on multiplication

2015-08-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652853#comment-14652853 ] Reynold Xin commented on SPARK-8359: [~davies] to add a unit test for precision = 38.

[jira] [Updated] (SPARK-8359) Spark SQL Decimal type precision loss on multiplication

2015-08-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8359: --- Assignee: Davies Liu Spark SQL Decimal type precision loss on multiplication

[jira] [Updated] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin

2015-08-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9482: --- Assignee: Davies Liu (was: Yin Huai) flaky test:

[jira] [Updated] (SPARK-7837) NPE when save as parquet in speculative tasks

2015-08-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7837: --- Assignee: Cheng Lian NPE when save as parquet in speculative tasks

[jira] [Created] (SPARK-9583) build/mvn script should not print debug messages to stdout

2015-08-03 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-9583: - Summary: build/mvn script should not print debug messages to stdout Key: SPARK-9583 URL: https://issues.apache.org/jira/browse/SPARK-9583 Project: Spark

[jira] [Assigned] (SPARK-9556) Make all BlockGenerators subscribe to rate limit updates

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9556: --- Assignee: Tathagata Das (was: Apache Spark) Make all BlockGenerators subscribe to rate

[jira] [Assigned] (SPARK-9556) Make all BlockGenerators subscribe to rate limit updates

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9556: --- Assignee: Apache Spark (was: Tathagata Das) Make all BlockGenerators subscribe to rate

[jira] [Commented] (SPARK-9556) Make all BlockGenerators subscribe to rate limit updates

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652875#comment-14652875 ] Apache Spark commented on SPARK-9556: - User 'tdas' has created a pull request for this

[jira] [Commented] (SPARK-7119) ScriptTransform doesn't consider the output data type

2015-08-03 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652892#comment-14652892 ] Cheng Hao commented on SPARK-7119: -- [~marmbrus] This is actually a bug fixing, and it

[jira] [Updated] (SPARK-7148) Configure Parquet block size (row group size) for ML model import/export

2015-08-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7148: - Assignee: Yanbo Liang Configure Parquet block size (row group size) for ML model

[jira] [Updated] (SPARK-3190) Creation of large graph( 2.15 B nodes) seems to be broken:possible overflow somewhere

2015-08-03 Thread Ankur Dave (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3190: -- Target Version/s: 1.3.2, 1.4.2, 1.5.0 Creation of large graph( 2.15 B nodes) seems to be

[jira] [Commented] (SPARK-8824) Support Parquet logical types TIMESTAMP_MILLIS and TIMESTAMP_MICROS

2015-08-03 Thread Konstantin Shaposhnikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653060#comment-14653060 ] Konstantin Shaposhnikov commented on SPARK-8824: Can TIMESTAMP_MILLIS

[jira] [Reopened] (SPARK-3190) Creation of large graph( 2.15 B nodes) seems to be broken:possible overflow somewhere

2015-08-03 Thread Ankur Dave (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave reopened SPARK-3190: --- Regression due to

[jira] [Assigned] (SPARK-9141) DataFrame recomputed instead of using cached parent.

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9141: --- Assignee: Apache Spark (was: Michael Armbrust) DataFrame recomputed instead of using

[jira] [Commented] (SPARK-9141) DataFrame recomputed instead of using cached parent.

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653013#comment-14653013 ] Apache Spark commented on SPARK-9141: - User 'marmbrus' has created a pull request for

[jira] [Assigned] (SPARK-9141) DataFrame recomputed instead of using cached parent.

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9141: --- Assignee: Michael Armbrust (was: Apache Spark) DataFrame recomputed instead of using

[jira] [Commented] (SPARK-9586) Update BinaryClassificationEvaluator to use setRawPredictionCol

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653035#comment-14653035 ] Apache Spark commented on SPARK-9586: - User 'jkbradley' has created a pull request for

[jira] [Assigned] (SPARK-9586) Update BinaryClassificationEvaluator to use setRawPredictionCol

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9586: --- Assignee: Joseph K. Bradley (was: Apache Spark) Update BinaryClassificationEvaluator to

[jira] [Created] (SPARK-9586) Update BinaryClassificationEvaluator to use setRawPredictionCol

2015-08-03 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-9586: Summary: Update BinaryClassificationEvaluator to use setRawPredictionCol Key: SPARK-9586 URL: https://issues.apache.org/jira/browse/SPARK-9586 Project: Spark

[jira] [Assigned] (SPARK-9586) Update BinaryClassificationEvaluator to use setRawPredictionCol

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9586: --- Assignee: Apache Spark (was: Joseph K. Bradley) Update BinaryClassificationEvaluator to

[jira] [Commented] (SPARK-9587) Spark Web UI not displaying while changing another network

2015-08-03 Thread Kaveen Raajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653068#comment-14653068 ] Kaveen Raajan commented on SPARK-9587: -- Even I tried to *set

[jira] [Commented] (SPARK-8497) Graph Clique(Complete Connected Sub-graph) Discovery Algorithm

2015-08-03 Thread kaywei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653101#comment-14653101 ] kaywei commented on SPARK-8497: --- In general, it follows algorithm from

[jira] [Created] (SPARK-9587) Spark Web UI not displaying while changing another network

2015-08-03 Thread Kaveen Raajan (JIRA)
Kaveen Raajan created SPARK-9587: Summary: Spark Web UI not displaying while changing another network Key: SPARK-9587 URL: https://issues.apache.org/jira/browse/SPARK-9587 Project: Spark

[jira] [Commented] (SPARK-3190) Creation of large graph( 2.15 B nodes) seems to be broken:possible overflow somewhere

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653098#comment-14653098 ] Apache Spark commented on SPARK-3190: - User 'ankurdave' has created a pull request for

[jira] [Commented] (SPARK-7148) Configure Parquet block size (row group size) for ML model import/export

2015-08-03 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653022#comment-14653022 ] Joseph K. Bradley commented on SPARK-7148: -- Sure, if you can look into this, that

[jira] [Commented] (SPARK-9513) Create Python API for all SQL functions

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653043#comment-14653043 ] Apache Spark commented on SPARK-9513: - User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-9513) Create Python API for all SQL functions

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9513: --- Assignee: Apache Spark (was: Davies Liu) Create Python API for all SQL functions

[jira] [Assigned] (SPARK-9513) Create Python API for all SQL functions

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9513: --- Assignee: Davies Liu (was: Apache Spark) Create Python API for all SQL functions

[jira] [Comment Edited] (SPARK-9587) Spark Web UI not displaying while changing another network

2015-08-03 Thread Kaveen Raajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653068#comment-14653068 ] Kaveen Raajan edited comment on SPARK-9587 at 8/4/15 5:31 AM: --

[jira] [Commented] (SPARK-9555) Cannot use spark-csv in spark-shell

2015-08-03 Thread Varadharajan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14653109#comment-14653109 ] Varadharajan commented on SPARK-9555: - [~srowen] Thanks for your response. I tried

[jira] [Resolved] (SPARK-7761) Flaky PySpark test: test_kafka_stream

2015-08-03 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7761. -- Resolution: Cannot Reproduce Flaky PySpark test: test_kafka_stream

[jira] [Commented] (SPARK-7761) Flaky PySpark test: test_kafka_stream

2015-08-03 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652539#comment-14652539 ] Tathagata Das commented on SPARK-7761: -- This has not been flaky for a while. So I am

[jira] [Resolved] (SPARK-8735) Expose metrics for runtime memory usage

2015-08-03 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8735. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7770

[jira] [Created] (SPARK-9572) Add StreamingContext.getActiveOrCreate() to python API

2015-08-03 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-9572: Summary: Add StreamingContext.getActiveOrCreate() to python API Key: SPARK-9572 URL: https://issues.apache.org/jira/browse/SPARK-9572 Project: Spark Issue

[jira] [Updated] (SPARK-9572) Add StreamingContext.getActiveOrCreate() to python API

2015-08-03 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9572: - Issue Type: Improvement (was: Bug) Add StreamingContext.getActiveOrCreate() to python API

[jira] [Commented] (SPARK-9521) Require Maven 3.3.3+ in the build

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14652550#comment-14652550 ] Apache Spark commented on SPARK-9521: - User 'srowen' has created a pull request for

[jira] [Updated] (SPARK-9573) Forward exceptions in batch jobs to the awaitTermination thread

2015-08-03 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9573: - Assignee: Tathagata Das Target Version/s: 1.5.0 Forward exceptions in batch jobs to

[jira] [Created] (SPARK-9573) Forward exceptions in batch jobs to the awaitTermination thread

2015-08-03 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-9573: Summary: Forward exceptions in batch jobs to the awaitTermination thread Key: SPARK-9573 URL: https://issues.apache.org/jira/browse/SPARK-9573 Project: Spark

[jira] [Updated] (SPARK-9574) Review the contents of uber JARs spark-streaming-XXX-assembly

2015-08-03 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9574: - Target Version/s: 1.5.0 Review the contents of uber JARs spark-streaming-XXX-assembly

[jira] [Updated] (SPARK-9574) Review the contents of uber JARs spark-streaming-XXX-assembly

2015-08-03 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-9574: - Description: It should not contain Spark core and its dependencies, especially the following. -

[jira] [Created] (SPARK-9574) Review the contents of uber JARs spark-streaming-XXX-assembly

2015-08-03 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-9574: Summary: Review the contents of uber JARs spark-streaming-XXX-assembly Key: SPARK-9574 URL: https://issues.apache.org/jira/browse/SPARK-9574 Project: Spark

[jira] [Created] (SPARK-9557) Refactor ParquetFilterSuite and remove old ParquetFilters code

2015-08-03 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-9557: - Summary: Refactor ParquetFilterSuite and remove old ParquetFilters code Key: SPARK-9557 URL: https://issues.apache.org/jira/browse/SPARK-9557 Project: Spark

[jira] [Assigned] (SPARK-9518) Clean up GenerateUnsafeRowJoiner

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9518: --- Assignee: Davies Liu (was: Apache Spark) Clean up GenerateUnsafeRowJoiner

[jira] [Assigned] (SPARK-9518) Clean up GenerateUnsafeRowJoiner

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9518: --- Assignee: Apache Spark (was: Davies Liu) Clean up GenerateUnsafeRowJoiner

[jira] [Created] (SPARK-9555) Cannot use spark-csv in spark-shell

2015-08-03 Thread Varadharajan (JIRA)
Varadharajan created SPARK-9555: --- Summary: Cannot use spark-csv in spark-shell Key: SPARK-9555 URL: https://issues.apache.org/jira/browse/SPARK-9555 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-9554) Turn on in-memory relation partition pruning by default

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9554: --- Assignee: Apache Spark (was: Cheng Lian) Turn on in-memory relation partition pruning by

[jira] [Commented] (SPARK-9554) Turn on in-memory relation partition pruning by default

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651647#comment-14651647 ] Apache Spark commented on SPARK-9554: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-9554) Turn on in-memory relation partition pruning by default

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9554: --- Assignee: Cheng Lian (was: Apache Spark) Turn on in-memory relation partition pruning by

[jira] [Created] (SPARK-9556) Make all BlockGenerators subscribe to rate limit updates

2015-08-03 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-9556: Summary: Make all BlockGenerators subscribe to rate limit updates Key: SPARK-9556 URL: https://issues.apache.org/jira/browse/SPARK-9556 Project: Spark Issue

[jira] [Resolved] (SPARK-9372) For a join operator, rows with null equal join key expression can be filtered out early

2015-08-03 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9372. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7768

[jira] [Resolved] (SPARK-9389) Support ArrayType in Tungsten

2015-08-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9389. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 Support ArrayType in

[jira] [Resolved] (SPARK-9404) UnsafeArrayData

2015-08-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9404. Resolution: Fixed Fix Version/s: 1.5.0 UnsafeArrayData ---

[jira] [Resolved] (SPARK-9413) Support MapType in Tungsten

2015-08-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9413. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 Support MapType in

[jira] [Resolved] (SPARK-9542) create unsafe version of map type

2015-08-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9542. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 create unsafe version

[jira] [Commented] (SPARK-9518) Clean up GenerateUnsafeRowJoiner

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651531#comment-14651531 ] Apache Spark commented on SPARK-9518: - User 'davies' has created a pull request for

[jira] [Commented] (SPARK-8064) Upgrade Hive to 1.2

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651614#comment-14651614 ] Apache Spark commented on SPARK-8064: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-9452) Support records larger than default page size in UnsafeExternalSorter

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9452: --- Assignee: Apache Spark (was: Josh Rosen) Support records larger than default page size in

[jira] [Commented] (SPARK-9452) Support records larger than default page size in UnsafeExternalSorter

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14651525#comment-14651525 ] Apache Spark commented on SPARK-9452: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-9452) Support records larger than default page size in UnsafeExternalSorter

2015-08-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9452: --- Assignee: Josh Rosen (was: Apache Spark) Support records larger than default page size in

<    1   2   3   4   5   >