[jira] [Created] (SPARK-9492) LogisticRegression should provide model statistics

2015-07-30 Thread Eric Liang (JIRA)
Eric Liang created SPARK-9492: - Summary: LogisticRegression should provide model statistics Key: SPARK-9492 URL: https://issues.apache.org/jira/browse/SPARK-9492 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-9425) Support DecimalType in UnsafeRow

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9425. Resolution: Fixed Fix Version/s: 1.5.0 Support DecimalType in UnsafeRow

[jira] [Resolved] (SPARK-9469) TungstenSort should not do safe - unsafe conversion itself

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9469. Resolution: Fixed Fix Version/s: 1.5.0 TungstenSort should not do safe - unsafe conversion

[jira] [Resolved] (SPARK-9458) Avoid object allocation in prefix generation

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9458. Resolution: Fixed Avoid object allocation in prefix generation

[jira] [Commented] (SPARK-5133) Feature Importance for Decision Tree (Ensembles)

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648565#comment-14648565 ] Joseph K. Bradley commented on SPARK-5133: -- Yes, that's the approach I was

[jira] [Commented] (SPARK-5895) Add VectorSlicer

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648575#comment-14648575 ] Joseph K. Bradley commented on SPARK-5895: -- This sounds very useful, but I think

[jira] [Commented] (SPARK-8416) Thread dump page should highlight Spark executor threads

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648410#comment-14648410 ] Apache Spark commented on SPARK-8416: - User 'CodingCat' has created a pull request for

[jira] [Assigned] (SPARK-8416) Thread dump page should highlight Spark executor threads

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8416: --- Assignee: (was: Apache Spark) Thread dump page should highlight Spark executor threads

[jira] [Resolved] (SPARK-9463) Expose model coefficients with names in SparkR RFormula

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9463. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7771

[jira] [Updated] (SPARK-9490) MLlib evaluation metrics guide example python code uses deprecated print statement

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9490: - Target Version/s: 1.5.0 MLlib evaluation metrics guide example python code uses

[jira] [Resolved] (SPARK-6684) Add checkpointing to GradientBoostedTrees

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-6684. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7804

[jira] [Updated] (SPARK-9494) {{spark-ec2 launch}} fails with anaconda python 3.4

2015-07-30 Thread Stuart Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stuart Owen updated SPARK-9494: --- Summary: {{spark-ec2 launch}} fails with anaconda python 3.4 (was: `spark-ec2 launch` fails with

[jira] [Comment Edited] (SPARK-9494) 'spark-ec2 launch' fails with anaconda python 3.4

2015-07-30 Thread Stuart Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648513#comment-14648513 ] Stuart Owen edited comment on SPARK-9494 at 7/30/15 11:48 PM: --

[jira] [Created] (SPARK-9495) Support prefix generation for date / timestamp data type

2015-07-30 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9495: -- Summary: Support prefix generation for date / timestamp data type Key: SPARK-9495 URL: https://issues.apache.org/jira/browse/SPARK-9495 Project: Spark Issue

[jira] [Updated] (SPARK-6319) Should throw analysis exception when using binary type in groupby/join

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6319: --- Summary: Should throw analysis exception when using binary type in groupby/join (was: DISTINCT

[jira] [Resolved] (SPARK-6319) DISTINCT doesn't work for binary type

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-6319. Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 1.5.0 DISTINCT doesn't

[jira] [Resolved] (SPARK-9472) Consistent hadoop config for streaming

2015-07-30 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-9472. -- Resolution: Fixed Assignee: Cody Koeninger Fix Version/s: 1.5.0 Consistent

[jira] [Commented] (SPARK-5895) Add VectorSlicer

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648582#comment-14648582 ] Joseph K. Bradley commented on SPARK-5895: -- Actually, this sounds like stuff to

[jira] [Updated] (SPARK-9490) MLlib evaluation metrics guide example python code uses deprecated print statement

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9490: - Description: The python examples in the evaluation metrics user guide (MLlib) use print x

[jira] [Updated] (SPARK-8742) Improve SparkR error messages for DataFrame API

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8742: - Assignee: Hossein Falaki Improve SparkR error messages for DataFrame API

[jira] [Resolved] (SPARK-8742) Improve SparkR error messages for DataFrame API

2015-07-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8742. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-9489) Remove compatibleWith, meetsRequirements, and needsAnySort checks from Exchange

2015-07-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9489. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7807

[jira] [Updated] (SPARK-5895) Add VectorSlicer

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5895: - Shepherd: Joseph K. Bradley Add VectorSlicer Key:

[jira] [Updated] (SPARK-8169) Add StopWordsRemover as a transformer

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8169: - Shepherd: Xiangrui Meng Add StopWordsRemover as a transformer

[jira] [Updated] (SPARK-6486) Add BlockMatrix in PySpark

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6486: - Shepherd: Xiangrui Meng Add BlockMatrix in PySpark --

[jira] [Resolved] (SPARK-8671) Add isotonic regression to the pipeline API

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8671. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7517

[jira] [Updated] (SPARK-8671) Add isotonic regression to the pipeline API

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8671: - Assignee: Martin Zapletal Add isotonic regression to the pipeline API

[jira] [Created] (SPARK-9491) App running on secure YARN with no HBase config will hang

2015-07-30 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-9491: - Summary: App running on secure YARN with no HBase config will hang Key: SPARK-9491 URL: https://issues.apache.org/jira/browse/SPARK-9491 Project: Spark

[jira] [Assigned] (SPARK-9491) App running on secure YARN with no HBase config will hang

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9491: --- Assignee: (was: Apache Spark) App running on secure YARN with no HBase config will hang

[jira] [Commented] (SPARK-9491) App running on secure YARN with no HBase config will hang

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648453#comment-14648453 ] Apache Spark commented on SPARK-9491: - User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-9491) App running on secure YARN with no HBase config will hang

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9491: --- Assignee: Apache Spark App running on secure YARN with no HBase config will hang

[jira] [Updated] (SPARK-9494) 'spark-ec2 launch' fails with anaconda python 3.4

2015-07-30 Thread Stuart Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stuart Owen updated SPARK-9494: --- Summary: 'spark-ec2 launch' fails with anaconda python 3.4 (was: {{spark-ec2 launch}} fails with

[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

2015-07-30 Thread Jeremy Freeman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648552#comment-14648552 ] Jeremy Freeman commented on SPARK-9461: --- Ah, great to hear! Possibly slightly

[jira] [Commented] (SPARK-5895) Add VectorSlicer

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648583#comment-14648583 ] Joseph K. Bradley commented on SPARK-5895: -- Comment copied from PR about design:

[jira] [Updated] (SPARK-9214) support ml.NaiveBayes for Python

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9214: - Shepherd: Joseph K. Bradley Assignee: Yanbo Liang Target

[jira] [Updated] (SPARK-9246) DistributedLDAModel predict top docs per topic

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9246: - Assignee: Meihua Wu DistributedLDAModel predict top docs per topic

[jira] [Updated] (SPARK-9494) `spark-ec2 launch` fails with anaconda python 3.4

2015-07-30 Thread Stuart Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stuart Owen updated SPARK-9494: --- Description: Command I used to launch: {code:bash} $SPARK_HOME/ec2/spark-ec2 \ -k spark \ -i

[jira] [Updated] (SPARK-9494) `spark-ec2 launch` fails with anaconda python 3.4

2015-07-30 Thread Stuart Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stuart Owen updated SPARK-9494: --- Description: Command I used to launch: {code:none} $SPARK_HOME/ec2/spark-ec2 \ -k spark \ -i

[jira] [Commented] (SPARK-9494) `spark-ec2 launch` fails with anaconda python 3.4

2015-07-30 Thread Stuart Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648513#comment-14648513 ] Stuart Owen commented on SPARK-9494: Have not observed any other `spark-ec2` commands

[jira] [Commented] (SPARK-9461) Possibly slightly flaky PySpark StreamingLinearRegressionWithTests

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648543#comment-14648543 ] Joseph K. Bradley commented on SPARK-9461: -- Increasing time-out sounds expensive.

[jira] [Resolved] (SPARK-7157) Add approximate stratified sampling to DataFrame

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7157. Resolution: Fixed Fix Version/s: 1.5.0 Add approximate stratified sampling to DataFrame

[jira] [Updated] (SPARK-9077) Improve error message for decision trees when numExamples maxCategoriesPerFeature

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9077: - Shepherd: Joseph K. Bradley Assignee: Sean Owen Target Version/s:

[jira] [Resolved] (SPARK-9077) Improve error message for decision trees when numExamples maxCategoriesPerFeature

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9077. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7800

[jira] [Commented] (SPARK-8271) string function: soundex

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648566#comment-14648566 ] Apache Spark commented on SPARK-8271: - User 'davies' has created a pull request for

[jira] [Commented] (SPARK-5981) pyspark ML models should support predict/transform on vector within map

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648594#comment-14648594 ] Joseph K. Bradley commented on SPARK-5981: -- This issue was partly solved by

[jira] [Updated] (SPARK-5981) pyspark ML models should support predict/transform on vector within map

2015-07-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5981: - Target Version/s: (was: 1.5.0) pyspark ML models should support predict/transform on

[jira] [Assigned] (SPARK-8416) Thread dump page should highlight Spark executor threads

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8416: --- Assignee: Apache Spark Thread dump page should highlight Spark executor threads

[jira] [Created] (SPARK-9490) MLlib evaluation metrics guide example python code uses deprecated print statement

2015-07-30 Thread Seth Hendrickson (JIRA)
Seth Hendrickson created SPARK-9490: --- Summary: MLlib evaluation metrics guide example python code uses deprecated print statement Key: SPARK-9490 URL: https://issues.apache.org/jira/browse/SPARK-9490

[jira] [Resolved] (SPARK-9199) Upgrade Tachyon dependency to 0.7.0

2015-07-30 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9199. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7577

[jira] [Created] (SPARK-9494) `spark-ec2 launch` fails with anaconda python 3.4

2015-07-30 Thread Stuart Owen (JIRA)
Stuart Owen created SPARK-9494: -- Summary: `spark-ec2 launch` fails with anaconda python 3.4 Key: SPARK-9494 URL: https://issues.apache.org/jira/browse/SPARK-9494 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-9405) approximateCountDiscting does not work with GroupBy

2015-07-30 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648694#comment-14648694 ] Michael Armbrust commented on SPARK-9405: - You can't use {{*}} in a count

[jira] [Commented] (SPARK-7129) Add generic boosting algorithm to spark.ml

2015-07-30 Thread K S Sreenivasa Raghavan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648711#comment-14648711 ] K S Sreenivasa Raghavan commented on SPARK-7129: Hello, I am new

[jira] [Commented] (SPARK-8850) Turn unsafe mode on by default

2015-07-30 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648714#comment-14648714 ] Herman van Hovell commented on SPARK-8850: -- Hi, I am getting a Too many open

[jira] [Commented] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin

2015-07-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648715#comment-14648715 ] Yin Huai commented on SPARK-9482: - Seems the failed query is {{select a.key from t3 a left

[jira] [Commented] (SPARK-8819) Spark doesn't compile with maven 3.3.x

2015-07-30 Thread Konstantin Shaposhnikov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648680#comment-14648680 ] Konstantin Shaposhnikov commented on SPARK-8819: [MSHADE-148] has been

[jira] [Commented] (SPARK-9496) Do not print password in Hive Config

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648705#comment-14648705 ] Apache Spark commented on SPARK-9496: - User 'WangTaoTheTonic' has created a pull

[jira] [Assigned] (SPARK-9496) Do not print password in Hive Config

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9496: --- Assignee: (was: Apache Spark) Do not print password in Hive Config

[jira] [Created] (SPARK-9497) DistributedSuite failed after the test of repeatedly failing task that crashes JVM

2015-07-30 Thread Yin Huai (JIRA)
Yin Huai created SPARK-9497: --- Summary: DistributedSuite failed after the test of repeatedly failing task that crashes JVM Key: SPARK-9497 URL: https://issues.apache.org/jira/browse/SPARK-9497 Project:

[jira] [Commented] (SPARK-9497) DistributedSuite failed after the test of repeatedly failing task that crashes JVM

2015-07-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648710#comment-14648710 ] Yin Huai commented on SPARK-9497: - [~kayousterhout] Seems you added repeatedly failing

[jira] [Updated] (SPARK-9497) Flaky test: DistributedSuite failed after the test of repeatedly failing task that crashes JVM

2015-07-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9497: Summary: Flaky test: DistributedSuite failed after the test of repeatedly failing task that crashes JVM

[jira] [Updated] (SPARK-9497) Flaky test: DistributedSuite failed after the test of repeatedly failing task that crashes JVM

2015-07-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9497: Labels: flaky-test (was: ) Flaky test: DistributedSuite failed after the test of repeatedly failing

[jira] [Commented] (SPARK-9497) Flaky test: DistributedSuite failed after the test of repeatedly failing task that crashes JVM

2015-07-30 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648721#comment-14648721 ] Kay Ousterhout commented on SPARK-9497: --- When did you start seeing these failures?

[jira] [Commented] (SPARK-9497) Flaky test: DistributedSuite failed after the test of repeatedly failing task that crashes JVM

2015-07-30 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648727#comment-14648727 ] Kay Ousterhout commented on SPARK-9497: --- It looks like this has failed much longer

[jira] [Resolved] (SPARK-8176) date/time function: to_date

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8176. Resolution: Fixed Fix Version/s: 1.5.0 date/time function: to_date

[jira] [Resolved] (SPARK-8197) date/time function: trunc

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8197. Resolution: Fixed Assignee: Adrian Wang Fix Version/s: 1.5.0 date/time function:

[jira] [Commented] (SPARK-5133) Feature Importance for Decision Tree (Ensembles)

2015-07-30 Thread Nam Ma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648656#comment-14648656 ] Nam Ma commented on SPARK-5133: --- Definitely, Joseph. Please go ahead sending the PR. There

[jira] [Updated] (SPARK-9359) Support IntervalType for Parquet

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9359: --- Issue Type: Sub-task (was: New Feature) Parent: SPARK-9431 Support IntervalType for Parquet

[jira] [Resolved] (SPARK-8943) CalendarIntervalType for time intervals

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8943. Resolution: Fixed Fix Version/s: 1.5.0 CalendarIntervalType for time intervals

[jira] [Commented] (SPARK-8064) Upgrade Hive to 1.2

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648651#comment-14648651 ] Apache Spark commented on SPARK-8064: - User 'marmbrus' has created a pull request for

[jira] [Commented] (SPARK-9497) Flaky test: DistributedSuite failed after the test of repeatedly failing task that crashes JVM

2015-07-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648725#comment-14648725 ] Yin Huai commented on SPARK-9497: - It started to fail about 2 to 3 days ago. Its history

[jira] [Commented] (SPARK-9497) Flaky test: DistributedSuite failed after the test of repeatedly failing task that crashes JVM

2015-07-30 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648737#comment-14648737 ] Kay Ousterhout commented on SPARK-9497: --- A bunch of thoughts here: The oldest

[jira] [Updated] (SPARK-9499) Possible file handle leak in spilling/sort code

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9499: --- Assignee: Josh Rosen Possible file handle leak in spilling/sort code

[jira] [Created] (SPARK-9499) Possible file handle leak in spilling/sort code

2015-07-30 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9499: -- Summary: Possible file handle leak in spilling/sort code Key: SPARK-9499 URL: https://issues.apache.org/jira/browse/SPARK-9499 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-8850) Turn unsafe mode on by default

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648744#comment-14648744 ] Reynold Xin commented on SPARK-8850: [~hvanhovell] I created

[jira] [Updated] (SPARK-9499) Possible file handle leak in spilling/sort code

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9499: --- Priority: Blocker (was: Critical) Possible file handle leak in spilling/sort code

[jira] [Assigned] (SPARK-9240) Hybrid aggregate operator using unsafe row

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9240: --- Assignee: Apache Spark Hybrid aggregate operator using unsafe row

[jira] [Assigned] (SPARK-9240) Hybrid aggregate operator using unsafe row

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9240: --- Assignee: (was: Apache Spark) Hybrid aggregate operator using unsafe row

[jira] [Commented] (SPARK-9240) Hybrid aggregate operator using unsafe row

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648621#comment-14648621 ] Apache Spark commented on SPARK-9240: - User 'yhuai' has created a pull request for

[jira] [Created] (SPARK-9496) Do not print password in Hive Config

2015-07-30 Thread Tao Wang (JIRA)
Tao Wang created SPARK-9496: --- Summary: Do not print password in Hive Config Key: SPARK-9496 URL: https://issues.apache.org/jira/browse/SPARK-9496 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-9496) Do not print password in Hive Config

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9496: --- Assignee: Apache Spark Do not print password in Hive Config

[jira] [Created] (SPARK-9498) Some statistical information missed when the driver is out of the cluster

2015-07-30 Thread Liang Lee (JIRA)
Liang Lee created SPARK-9498: Summary: Some statistical information missed when the driver is out of the cluster Key: SPARK-9498 URL: https://issues.apache.org/jira/browse/SPARK-9498 Project: Spark

[jira] [Commented] (SPARK-8486) SIFT Feature Transformer

2015-07-30 Thread K S Sreenivasa Raghavan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648712#comment-14648712 ] K S Sreenivasa Raghavan commented on SPARK-8486: Hello, I am

[jira] [Comment Edited] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin

2015-07-30 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648715#comment-14648715 ] Yin Huai edited comment on SPARK-9482 at 7/31/15 4:00 AM: -- Seems

[jira] [Commented] (SPARK-8850) Turn unsafe mode on by default

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14648729#comment-14648729 ] Reynold Xin commented on SPARK-8850: Can you do a lsof to see what's open? The

[jira] [Updated] (SPARK-8850) Turn unsafe mode on by default

2015-07-30 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-8850: - Attachment: open Dump of all open files after a {{Too Many Files Open}} error. The

[jira] [Updated] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9482: - Labels: flaky-test (was: ) flaky test:

[jira] [Created] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin

2015-07-30 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-9482: Summary: flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin Key: SPARK-9482 URL: https://issues.apache.org/jira/browse/SPARK-9482

[jira] [Updated] (SPARK-6805) MLlib + SparkR integration for 1.5

2015-07-30 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6805: - Description: ~~SparkR was merged. So let's have this umbrella JIRA for the ML pipeline API in

[jira] [Updated] (SPARK-9483) UTF8String.getPrefix only works in little-endian order

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9483: --- Description: There are 2 bit masking and a reverse bytes that should probably be handled differently

[jira] [Commented] (SPARK-8786) Create a wrapper for BinaryType

2015-07-30 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647248#comment-14647248 ] Takeshi Yamamuro commented on SPARK-8786: - Sorry to make you confused though, a

[jira] [Comment Edited] (SPARK-8786) Create a wrapper for BinaryType

2015-07-30 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647248#comment-14647248 ] Takeshi Yamamuro edited comment on SPARK-8786 at 7/30/15 6:26 AM:

[jira] [Commented] (SPARK-9468) Avoid scheduling tasks on preemption executors

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647286#comment-14647286 ] Apache Spark commented on SPARK-9468: - User 'jerryshao' has created a pull request for

[jira] [Assigned] (SPARK-9468) Avoid scheduling tasks on preemption executors

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9468: --- Assignee: (was: Apache Spark) Avoid scheduling tasks on preemption executors

[jira] [Assigned] (SPARK-9468) Avoid scheduling tasks on preemption executors

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9468: --- Assignee: Apache Spark Avoid scheduling tasks on preemption executors

[jira] [Reopened] (SPARK-9458) Avoid object allocation in prefix generation

2015-07-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reopened SPARK-9458: Avoid object allocation in prefix generation

[jira] [Commented] (SPARK-9470) Java API function interface cleanup

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647323#comment-14647323 ] Apache Spark commented on SPARK-9470: - User 'rahulkavale' has created a pull request

[jira] [Updated] (SPARK-9470) Java API function interface cleanup

2015-07-30 Thread Rahul Kavale (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rahul Kavale updated SPARK-9470: Description: Hi guys, I was exploring Spark codebase, and came across the Java API function

[jira] [Assigned] (SPARK-9470) Java API function interface cleanup

2015-07-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9470: --- Assignee: Apache Spark Java API function interface cleanup

[jira] [Commented] (SPARK-9362) Exception when using DataFrame groupby().sum on Decimal type in Python

2015-07-30 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647338#comment-14647338 ] Liang-Chi Hsieh commented on SPARK-9362: As I just test, yes. I think this ticket

[jira] [Commented] (SPARK-8786) Create a wrapper for BinaryType

2015-07-30 Thread James Aley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647299#comment-14647299 ] James Aley commented on SPARK-8786: --- Ah ok, cool, so it's already fixed in master?

<    1   2   3   4   >