[jira] [Commented] (SPARK-2017) web ui stage page becomes unresponsive when the number of tasks is large

2014-07-31 Thread Carlos Fuertes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080539#comment-14080539 ] Carlos Fuertes commented on SPARK-2017: --- Hi, I have implemented under

[jira] [Updated] (SPARK-2766) ScalaReflectionSuite throw an llegalArgumentException in JDK 6

2014-07-31 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-2766: --- Summary: ScalaReflectionSuite throw an llegalArgumentException in JDK 6 (was: ScalaReflectionSuite

[jira] [Comment Edited] (SPARK-2017) web ui stage page becomes unresponsive when the number of tasks is large

2014-07-31 Thread Carlos Fuertes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080539#comment-14080539 ] Carlos Fuertes edited comment on SPARK-2017 at 7/31/14 6:05 AM:

[jira] [Commented] (SPARK-2016) rdd in-memory storage UI becomes unresponsive when the number of RDD partitions is large

2014-07-31 Thread Carlos Fuertes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080542#comment-14080542 ] Carlos Fuertes commented on SPARK-2016: --- I have created a pull request

[jira] [Updated] (SPARK-2022) Spark 1.0.0 is failing if mesos.coarse set to true

2014-07-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2022: --- Target Version/s: 1.1.0 Spark 1.0.0 is failing if mesos.coarse set to true

[jira] [Updated] (SPARK-2633) support register spark listener to listener bus with Java API

2014-07-31 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated SPARK-2633: - Attachment: Spark listener enhancement for Hive on Spark job monitor and statistic.docx I add a

[jira] [Commented] (SPARK-2712) Add a small note that mvn package must happen before test

2014-07-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080579#comment-14080579 ] Patrick Wendell commented on SPARK-2712: I'm a bit confused about the doc request

[jira] [Updated] (SPARK-2712) Add a small note that mvn package must happen before test

2014-07-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2712: --- Assignee: Stephen Boesch Add a small note that mvn package must happen before test

[jira] [Commented] (SPARK-2728) Integer overflow in partition index calculation RangePartitioner

2014-07-31 Thread Larry Xiao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080594#comment-14080594 ] Larry Xiao commented on SPARK-2728: --- I checked-out newest commit

[jira] [Comment Edited] (SPARK-2728) Integer overflow in partition index calculation RangePartitioner

2014-07-31 Thread Larry Xiao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080594#comment-14080594 ] Larry Xiao edited comment on SPARK-2728 at 7/31/14 7:23 AM: I

[jira] [Comment Edited] (SPARK-2728) Integer overflow in partition index calculation RangePartitioner

2014-07-31 Thread Larry Xiao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080594#comment-14080594 ] Larry Xiao edited comment on SPARK-2728 at 7/31/14 7:24 AM: I

[jira] [Commented] (SPARK-2729) Forgot to match Timestamp type in ColumnBuilder

2014-07-31 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080624#comment-14080624 ] Cheng Lian commented on SPARK-2729: --- Steps to reproduce this bug within {{sbt -Phive

[jira] [Commented] (SPARK-1812) Support cross-building with Scala 2.11

2014-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080627#comment-14080627 ] Apache Spark commented on SPARK-1812: - User 'avati' has created a pull request for

[jira] [Commented] (SPARK-2728) Integer overflow in partition index calculation RangePartitioner

2014-07-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080647#comment-14080647 ] Sean Owen commented on SPARK-2728: -- Yes, this was likely fixed by recent changes to

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

2014-07-31 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080653#comment-14080653 ] Tathagata Das commented on SPARK-2447: -- I took a brief look at SPARK-1127 as well. I

[jira] [Comment Edited] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

2014-07-31 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080653#comment-14080653 ] Tathagata Das edited comment on SPARK-2447 at 7/31/14 8:39 AM:

[jira] [Comment Edited] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

2014-07-31 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080653#comment-14080653 ] Tathagata Das edited comment on SPARK-2447 at 7/31/14 8:40 AM:

[jira] [Comment Edited] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

2014-07-31 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080653#comment-14080653 ] Tathagata Das edited comment on SPARK-2447 at 7/31/14 8:41 AM:

[jira] [Commented] (SPARK-2468) zero-copy shuffle network communication

2014-07-31 Thread Raymond Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080657#comment-14080657 ] Raymond Liu commented on SPARK-2468: so, is there anyone working on this? zero-copy

[jira] [Created] (SPARK-2767) SparkSQL CLI doens't output error message if query failed.

2014-07-31 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-2767: Summary: SparkSQL CLI doens't output error message if query failed. Key: SPARK-2767 URL: https://issues.apache.org/jira/browse/SPARK-2767 Project: Spark Issue Type:

[jira] [Commented] (SPARK-2767) SparkSQL CLI doens't output error message if query failed.

2014-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080660#comment-14080660 ] Apache Spark commented on SPARK-2767: - User 'chenghao-intel' has created a pull

[jira] [Commented] (SPARK-2749) Spark SQL Java tests aren't compiling in Jenkins' Maven builds; missing junit:junit dep

2014-07-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080661#comment-14080661 ] Sean Owen commented on SPARK-2749: -- Thanks! PR merged so this can be closed as fixed.

[jira] [Created] (SPARK-2768) Add product, user recommend method to MatrixFactorizationModel

2014-07-31 Thread Sean Owen (JIRA)
Sean Owen created SPARK-2768: Summary: Add product, user recommend method to MatrixFactorizationModel Key: SPARK-2768 URL: https://issues.apache.org/jira/browse/SPARK-2768 Project: Spark Issue

[jira] [Commented] (SPARK-2768) Add product, user recommend method to MatrixFactorizationModel

2014-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080715#comment-14080715 ] Apache Spark commented on SPARK-2768: - User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-2728) Integer overflow in partition index calculation RangePartitioner

2014-07-31 Thread Jianshi Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080729#comment-14080729 ] Jianshi Huang commented on SPARK-2728: -- I see. Thanks for the fix Sean and Larry!

[jira] [Commented] (SPARK-2728) Integer overflow in partition index calculation RangePartitioner

2014-07-31 Thread Jianshi Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080741#comment-14080741 ] Jianshi Huang commented on SPARK-2728: -- Anyone can test it? I'll close the issue. My

[jira] [Created] (SPARK-2769) Ganglia Support Broken / Not working

2014-07-31 Thread Stephen Walsh (JIRA)
Stephen Walsh created SPARK-2769: Summary: Ganglia Support Broken / Not working Key: SPARK-2769 URL: https://issues.apache.org/jira/browse/SPARK-2769 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-2769) Ganglia Support Broken / Not working

2014-07-31 Thread Stephen Walsh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Walsh updated SPARK-2769: - Description: Hi all, I've build spark 1.1.0 with sbt with ganglia enabled and hadoop version

[jira] [Updated] (SPARK-2769) Ganglia Support Broken / Not working

2014-07-31 Thread Stephen Walsh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Walsh updated SPARK-2769: - Description: Hi all, I've build spark 1.1.0 with sbt with ganglia enabled and hadoop version

[jira] [Updated] (SPARK-2769) Ganglia Support Broken / Not working

2014-07-31 Thread Stephen Walsh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Walsh updated SPARK-2769: - Description: Hi all, I've build spark 1.1.0 with sbt with ganglia enabled and hadoop version

[jira] [Commented] (SPARK-2709) Add a tool for certifying Spark API compatiblity

2014-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080910#comment-14080910 ] Apache Spark commented on SPARK-2709: - User 'ScrapCodes' has created a pull request

[jira] [Commented] (SPARK-1021) sortByKey() launches a cluster job when it shouldn't

2014-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080935#comment-14080935 ] Apache Spark commented on SPARK-1021: - User 'erikerlandson' has created a pull request

[jira] [Commented] (SPARK-2749) Spark SQL Java tests aren't compiling in Jenkins' Maven builds; missing junit:junit dep

2014-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080953#comment-14080953 ] Apache Spark commented on SPARK-2749: - User 'srowen' has created a pull request for

[jira] [Updated] (SPARK-2769) Ganglia Support Broken / Not working

2014-07-31 Thread Stephen Walsh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Walsh updated SPARK-2769: - Description: Hi all, I've build spark 1.1.0 with sbt with ganglia enabled and hadoop version

[jira] [Commented] (SPARK-2700) Hidden files (such as .impala_insert_staging) should be filtered out by sqlContext.parquetFile

2014-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080969#comment-14080969 ] Apache Spark commented on SPARK-2700: - User 'chutium' has created a pull request for

[jira] [Commented] (SPARK-2381) streaming receiver crashed,but seems nothing happened

2014-07-31 Thread sunsc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081021#comment-14081021 ] sunsc commented on SPARK-2381: -- Send a PR here : https://github.com/apache/spark/pull/1693/

[jira] [Commented] (SPARK-2379) stopReceive in dead loop, cause stackoverflow exception

2014-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081033#comment-14081033 ] Apache Spark commented on SPARK-2379: - User 'joyyoj' has created a pull request for

[jira] [Updated] (SPARK-2769) Ganglia Support Broken / Not working

2014-07-31 Thread Stephen Walsh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Walsh updated SPARK-2769: - Description: Hi all, I've build spark 1.1.0 with sbt with ganglia enabled and hadoop version

[jira] [Created] (SPARK-2770) Rename spark-ganglia-lgpl to ganglia-lgpl

2014-07-31 Thread Chris Fregly (JIRA)
Chris Fregly created SPARK-2770: --- Summary: Rename spark-ganglia-lgpl to ganglia-lgpl Key: SPARK-2770 URL: https://issues.apache.org/jira/browse/SPARK-2770 Project: Spark Issue Type:

[jira] [Created] (SPARK-2771) GenerateMIMAIgnore fails scalastyle check due to long line

2014-07-31 Thread Ted Yu (JIRA)
Ted Yu created SPARK-2771: - Summary: GenerateMIMAIgnore fails scalastyle check due to long line Key: SPARK-2771 URL: https://issues.apache.org/jira/browse/SPARK-2771 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2771) GenerateMIMAIgnore fails scalastyle check due to long line

2014-07-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081050#comment-14081050 ] Sean Owen commented on SPARK-2771: -- Already on it :)

[jira] [Updated] (SPARK-2771) GenerateMIMAIgnore fails scalastyle check due to long line

2014-07-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-2771: -- Attachment: spark-2771-v1.txt Patch v1 shortens line 118 to 100 chars wide. GenerateMIMAIgnore fails

[jira] [Created] (SPARK-2772) Spark Project SQL fails compilation

2014-07-31 Thread Ted Yu (JIRA)
Ted Yu created SPARK-2772: - Summary: Spark Project SQL fails compilation Key: SPARK-2772 URL: https://issues.apache.org/jira/browse/SPARK-2772 Project: Spark Issue Type: Bug Reporter:

[jira] [Updated] (SPARK-2762) SparkILoop leaks memory in multi-repl configurations

2014-07-31 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-2762: - Assignee: Timothy Hunter SparkILoop leaks memory in multi-repl configurations

[jira] [Resolved] (SPARK-2762) SparkILoop leaks memory in multi-repl configurations

2014-07-31 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-2762. -- Resolution: Fixed Fix Version/s: 1.1.0 SparkILoop leaks memory in multi-repl

[jira] [Commented] (SPARK-2762) SparkILoop leaks memory in multi-repl configurations

2014-07-31 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081154#comment-14081154 ] Matei Zaharia commented on SPARK-2762: -- PR: https://github.com/apache/spark/pull/1674

[jira] [Created] (SPARK-2773) Shuffle:use growth rate to predict if need to spill

2014-07-31 Thread uncleGen (JIRA)
uncleGen created SPARK-2773: --- Summary: Shuffle:use growth rate to predict if need to spill Key: SPARK-2773 URL: https://issues.apache.org/jira/browse/SPARK-2773 Project: Spark Issue Type:

[jira] [Commented] (SPARK-2773) Shuffle:use growth rate to predict if need to spill

2014-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081163#comment-14081163 ] Apache Spark commented on SPARK-2773: - User 'uncleGen' has created a pull request for

[jira] [Commented] (SPARK-2773) Shuffle:use growth rate to predict if need to spill

2014-07-31 Thread uncleGen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081161#comment-14081161 ] uncleGen commented on SPARK-2773: - here is my improvement:

[jira] [Commented] (SPARK-2744) The configuration spark.history.retainedApplications is invalid

2014-07-31 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081191#comment-14081191 ] Marcelo Vanzin commented on SPARK-2744: --- Sort of. The docs say: {quote} The number

[jira] [Resolved] (SPARK-2743) Parquet has issues with capital letters and case insensitivity

2014-07-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2743. - Resolution: Fixed Fix Version/s: 1.1.0 Parquet has issues with capital letters

[jira] [Resolved] (SPARK-2397) Get rid of LocalHiveContext

2014-07-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2397. - Resolution: Fixed Fix Version/s: 1.1.0 Get rid of LocalHiveContext

[jira] [Created] (SPARK-2774) Set preferred locations for reduce tasks

2014-07-31 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-2774: Summary: Set preferred locations for reduce tasks Key: SPARK-2774 URL: https://issues.apache.org/jira/browse/SPARK-2774 Project: Spark Issue

[jira] [Resolved] (SPARK-2028) Let users of HadoopRDD access the partition InputSplits

2014-07-31 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-2028. -- Resolution: Fixed Fix Version/s: 1.1.0 Let users of HadoopRDD access the partition

[jira] [Commented] (SPARK-2774) Set preferred locations for reduce tasks

2014-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081256#comment-14081256 ] Apache Spark commented on SPARK-2774: - User 'shivaram' has created a pull request for

[jira] [Created] (SPARK-2775) HiveContext does not support dots in column names.

2014-07-31 Thread Yin Huai (JIRA)
Yin Huai created SPARK-2775: --- Summary: HiveContext does not support dots in column names. Key: SPARK-2775 URL: https://issues.apache.org/jira/browse/SPARK-2775 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-2664) Deal with `--conf` options in spark-submit that relate to flags

2014-07-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2664. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1665

[jira] [Created] (SPARK-2776) Add normalizeByCol method to mllib.util.MLUtils

2014-07-31 Thread Andres Perez (JIRA)
Andres Perez created SPARK-2776: --- Summary: Add normalizeByCol method to mllib.util.MLUtils Key: SPARK-2776 URL: https://issues.apache.org/jira/browse/SPARK-2776 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-2749) Spark SQL Java tests aren't compiling in Jenkins' Maven builds; missing junit:junit dep

2014-07-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2749: --- Assignee: Sean Owen Spark SQL Java tests aren't compiling in Jenkins' Maven builds; missing

[jira] [Resolved] (SPARK-2749) Spark SQL Java tests aren't compiling in Jenkins' Maven builds; missing junit:junit dep

2014-07-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2749. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1690

[jira] [Resolved] (SPARK-2772) Spark Project SQL fails compilation

2014-07-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SPARK-2772. --- Resolution: Not a Problem 'mvn install' solves the issue. Spark Project SQL fails compilation

[jira] [Commented] (SPARK-2678) `Spark-submit` overrides user application options

2014-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081302#comment-14081302 ] Apache Spark commented on SPARK-2678: - User 'liancheng' has created a pull request for

[jira] [Resolved] (SPARK-2646) log4j initialization not quite compatible with log4j 2.x

2014-07-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2646. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1547

[jira] [Resolved] (SPARK-2511) Add TF-IDF featurizer

2014-07-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-2511. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1671

[jira] [Commented] (SPARK-2468) zero-copy shuffle network communication

2014-07-31 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081357#comment-14081357 ] Reynold Xin commented on SPARK-2468: It's something I'd like to prototype for 1.2. Do

[jira] [Updated] (SPARK-2756) Decision Tree bugs

2014-07-31 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-2756: - Description: 3 bugs: Bug 1: Indexing is inconsistent for aggregate calculations for

[jira] [Commented] (SPARK-2777) ALS factors should be persist in memory and disk

2014-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081401#comment-14081401 ] Apache Spark commented on SPARK-2777: - User 'mengxr' has created a pull request for

[jira] [Updated] (SPARK-2272) Feature scaling which standardizes the range of independent variables or features of data.

2014-07-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2272: - Assignee: DB Tsai Feature scaling which standardizes the range of independent variables or

[jira] [Closed] (SPARK-2776) Add normalizeByCol method to mllib.util.MLUtils

2014-07-31 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-2776. Resolution: Duplicate Add normalizeByCol method to mllib.util.MLUtils

[jira] [Commented] (SPARK-1537) Add integration with Yarn's Application Timeline Server

2014-07-31 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081465#comment-14081465 ] Marcelo Vanzin commented on SPARK-1537: --- I'm working on this but this all sort of

[jira] [Commented] (SPARK-1576) Passing of JAVA_OPTS to YARN on command line

2014-07-31 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081490#comment-14081490 ] Marcelo Vanzin commented on SPARK-1576: --- With Sandy's recent patch

[jira] [Commented] (SPARK-1131) Better document the --args option for yarn-standalone mode

2014-07-31 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081497#comment-14081497 ] Marcelo Vanzin commented on SPARK-1131: --- This is probably obsolete now with

[jira] [Created] (SPARK-2778) Add unit tests for Yarn integration

2014-07-31 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-2778: - Summary: Add unit tests for Yarn integration Key: SPARK-2778 URL: https://issues.apache.org/jira/browse/SPARK-2778 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

2014-07-31 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081514#comment-14081514 ] Ted Malaska commented on SPARK-2447: Tell me if I'm wrong but the core offering of

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

2014-07-31 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081524#comment-14081524 ] Tathagata Das commented on SPARK-2447: -- Exactly!! That's why I feel that both have

[jira] [Updated] (SPARK-2063) Creating a SchemaRDD via sql() does not correctly resolve nested types

2014-07-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2063: Target Version/s: 1.2.0 (was: 1.1.0) Creating a SchemaRDD via sql() does not correctly

[jira] [Updated] (SPARK-2096) Correctly parse dot notations for accessing an array of structs

2014-07-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2096: Target Version/s: 1.2.0 (was: 1.1.0) Correctly parse dot notations for accessing an

[jira] [Resolved] (SPARK-2740) In JavaPairRdd, allow user to specify ascending and numPartitions for sortByKey

2014-07-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2740. --- Resolution: Fixed Fix Version/s: 1.1.0 Assignee: Rui Li In JavaPairRdd, allow user

[jira] [Commented] (SPARK-2017) web ui stage page becomes unresponsive when the number of tasks is large

2014-07-31 Thread Carlos Fuertes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081598#comment-14081598 ] Carlos Fuertes commented on SPARK-2017: --- I have done some tests with the solution

[jira] [Commented] (SPARK-2017) web ui stage page becomes unresponsive when the number of tasks is large

2014-07-31 Thread Carlos Fuertes (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081605#comment-14081605 ] Carlos Fuertes commented on SPARK-2017: --- I did not realize that the tasks all have

[jira] [Comment Edited] (SPARK-2282) PySpark crashes if too many tasks complete quickly

2014-07-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081616#comment-14081616 ] Josh Rosen edited comment on SPARK-2282 at 7/31/14 10:37 PM: -

[jira] [Updated] (SPARK-2282) PySpark crashes if too many tasks complete quickly

2014-07-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-2282: -- Fix Version/s: 1.1.0 PySpark crashes if too many tasks complete quickly

[jira] [Commented] (SPARK-2282) PySpark crashes if too many tasks complete quickly

2014-07-31 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081616#comment-14081616 ] Josh Rosen commented on SPARK-2282: --- Merged the improved fix from

[jira] [Resolved] (SPARK-2771) GenerateMIMAIgnore fails scalastyle check due to long line

2014-07-31 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SPARK-2771. --- Resolution: Fixed GenerateMIMAIgnore fails scalastyle check due to long line

[jira] [Commented] (SPARK-1812) Support cross-building with Scala 2.11

2014-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081642#comment-14081642 ] Apache Spark commented on SPARK-1812: - User 'avati' has created a pull request for

[jira] [Commented] (SPARK-1812) Support cross-building with Scala 2.11

2014-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081650#comment-14081650 ] Apache Spark commented on SPARK-1812: - User 'avati' has created a pull request for

[jira] [Commented] (SPARK-1812) Support cross-building with Scala 2.11

2014-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081657#comment-14081657 ] Apache Spark commented on SPARK-1812: - User 'avati' has created a pull request for

[jira] [Commented] (SPARK-695) Exponential recursion in getPreferredLocations

2014-07-31 Thread Aaron Staple (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081669#comment-14081669 ] Aaron Staple commented on SPARK-695: Progress has been made on a PR here:

[jira] [Commented] (SPARK-1812) Support cross-building with Scala 2.11

2014-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081671#comment-14081671 ] Apache Spark commented on SPARK-1812: - User 'avati' has created a pull request for

[jira] [Created] (SPARK-2779) asInstanceOf[Map[...]] should use scala.collection.Map instead of scala.collection.immutable.Map

2014-07-31 Thread Yin Huai (JIRA)
Yin Huai created SPARK-2779: --- Summary: asInstanceOf[Map[...]] should use scala.collection.Map instead of scala.collection.immutable.Map Key: SPARK-2779 URL: https://issues.apache.org/jira/browse/SPARK-2779

[jira] [Commented] (SPARK-2779) asInstanceOf[Map[...]] should use scala.collection.Map instead of scala.collection.immutable.Map

2014-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081732#comment-14081732 ] Apache Spark commented on SPARK-2779: - User 'yhuai' has created a pull request for

[jira] [Created] (SPARK-2780) Create a StreamingContext.setLocalProperty for setting local property of jobs launched by streaming

2014-07-31 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-2780: Summary: Create a StreamingContext.setLocalProperty for setting local property of jobs launched by streaming Key: SPARK-2780 URL: https://issues.apache.org/jira/browse/SPARK-2780

[jira] [Created] (SPARK-2781) Analyzer should check resolution of LogicalPlans

2014-07-31 Thread Aaron Staple (JIRA)
Aaron Staple created SPARK-2781: --- Summary: Analyzer should check resolution of LogicalPlans Key: SPARK-2781 URL: https://issues.apache.org/jira/browse/SPARK-2781 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-2781) Analyzer should check resolution of LogicalPlans

2014-07-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2781. - Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Assignee:

[jira] [Commented] (SPARK-2781) Analyzer should check resolution of LogicalPlans

2014-07-31 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081828#comment-14081828 ] Apache Spark commented on SPARK-2781: - User 'staple' has created a pull request for

[jira] [Reopened] (SPARK-2781) Analyzer should check resolution of LogicalPlans

2014-07-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reopened SPARK-2781: - I'm sorry... I thought this was stale and did not read it carefully. Reopening. Analyzer

[jira] [Commented] (SPARK-2781) Analyzer should check resolution of LogicalPlans

2014-07-31 Thread Aaron Staple (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081833#comment-14081833 ] Aaron Staple commented on SPARK-2781: - No problem, I think the current validation

[jira] [Updated] (SPARK-2781) Analyzer should check resolution of LogicalPlans

2014-07-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2781: Target Version/s: 1.2.0 Analyzer should check resolution of LogicalPlans

[jira] [Updated] (SPARK-2781) Analyzer should check resolution of LogicalPlans

2014-07-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2781: Fix Version/s: (was: 1.0.1) (was: 1.1.0) Analyzer should check

[jira] [Updated] (SPARK-2781) Analyzer should check resolution of LogicalPlans

2014-07-31 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2781: Affects Version/s: 1.1.0 1.0.1 Analyzer should check resolution of

  1   2   >