[jira] [Updated] (SPARK-10688) Python API for AFTSurvivalRegression

[ https://issues.apache.org/jira/browse/SPARK-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10688: -- Assignee: Kai Jiang > Python API for AFTSurvivalRegression > --

[jira] [Commented] (SPARK-10940) Too many open files Spark Shuffle

[ https://issues.apache.org/jira/browse/SPARK-10940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945642#comment-14945642 ] Sean Owen commented on SPARK-10940: --- I mean, just for the sake of testing, 100K? if tha

[jira] [Resolved] (SPARK-10688) Python API for AFTSurvivalRegression

[ https://issues.apache.org/jira/browse/SPARK-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10688. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8926 [https://gi

[jira] [Commented] (SPARK-10914) Incorrect empty join sets when executor-memory >= 32g

[ https://issues.apache.org/jira/browse/SPARK-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945638#comment-14945638 ] Sean Owen commented on SPARK-10914: --- Hm, it could be a valid lead after all. The size e

[jira] [Assigned] (SPARK-10956) Introduce common memory management interface for execution and storage

[ https://issues.apache.org/jira/browse/SPARK-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10956: Assignee: Apache Spark (was: Andrew Or) > Introduce common memory management interface fo

[jira] [Commented] (SPARK-10956) Introduce common memory management interface for execution and storage

[ https://issues.apache.org/jira/browse/SPARK-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945629#comment-14945629 ] Apache Spark commented on SPARK-10956: -- User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-10956) Introduce common memory management interface for execution and storage

[ https://issues.apache.org/jira/browse/SPARK-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10956: Assignee: Andrew Or (was: Apache Spark) > Introduce common memory management interface fo

[jira] [Updated] (SPARK-10956) Introduce common memory management interface for execution and storage

[ https://issues.apache.org/jira/browse/SPARK-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10956: -- Description: Memory management in Spark is currently broken down into two disjoint regions: one for ex

[jira] [Created] (SPARK-10956) Introduce common memory management interface for execution and storage

Andrew Or created SPARK-10956: - Summary: Introduce common memory management interface for execution and storage Key: SPARK-10956 URL: https://issues.apache.org/jira/browse/SPARK-10956 Project: Spark

[jira] [Commented] (SPARK-5508) Arrays and Maps stored with Hive Parquet Serde may not be able to read by the Parquet support in the Data Souce API

[ https://issues.apache.org/jira/browse/SPARK-5508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945610#comment-14945610 ] Apache Spark commented on SPARK-5508: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-5775) GenericRow cannot be cast to SpecificMutableRow when nested data and partitioned table

[ https://issues.apache.org/jira/browse/SPARK-5775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945609#comment-14945609 ] Apache Spark commented on SPARK-5775: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-10326) Cannot launch YARN job on Windows

[ https://issues.apache.org/jira/browse/SPARK-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945606#comment-14945606 ] Jose Antonio commented on SPARK-10326: -- Ok, give a moment its about half past Spai (

[jira] [Commented] (SPARK-10326) Cannot launch YARN job on Windows

[ https://issues.apache.org/jira/browse/SPARK-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945598#comment-14945598 ] Marcelo Vanzin commented on SPARK-10326: Can you post the actual exception? > Ca

[jira] [Commented] (SPARK-10326) Cannot launch YARN job on Windows

[ https://issues.apache.org/jira/browse/SPARK-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945594#comment-14945594 ] Jose Antonio commented on SPARK-10326: -- Hi Marcelo. I see the same exact error repor

[jira] [Commented] (SPARK-9443) Expose sampleByKey in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945593#comment-14945593 ] Felix Cheung commented on SPARK-9443: - is this sampleBy http://spark.apache.org/docs/

[jira] [Assigned] (SPARK-10955) Disable dynamic allocation for Streaming jobs

[ https://issues.apache.org/jira/browse/SPARK-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10955: Assignee: (was: Apache Spark) > Disable dynamic allocation for Streaming jobs > --

[jira] [Assigned] (SPARK-10955) Disable dynamic allocation for Streaming jobs

[ https://issues.apache.org/jira/browse/SPARK-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10955: Assignee: Apache Spark > Disable dynamic allocation for Streaming jobs > -

[jira] [Commented] (SPARK-10955) Disable dynamic allocation for Streaming jobs

[ https://issues.apache.org/jira/browse/SPARK-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945576#comment-14945576 ] Apache Spark commented on SPARK-10955: -- User 'harishreedharan' has created a pull re

[jira] [Created] (SPARK-10955) Disable dynamic allocation for Streaming jobs

Hari Shreedharan created SPARK-10955: Summary: Disable dynamic allocation for Streaming jobs Key: SPARK-10955 URL: https://issues.apache.org/jira/browse/SPARK-10955 Project: Spark Issue T

[jira] [Updated] (SPARK-10794) Spark-SQL- select query on table column with binary Data Type displays error message- java.lang.ClassCastException: java.lang.String cannot be cast to [B

[ https://issues.apache.org/jira/browse/SPARK-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jia Li updated SPARK-10794: --- Attachment: spark_1_5_0.png > Spark-SQL- select query on table column with binary Data Type displays error >

[jira] [Commented] (SPARK-10794) Spark-SQL- select query on table column with binary Data Type displays error message- java.lang.ClassCastException: java.lang.String cannot be cast to [B

[ https://issues.apache.org/jira/browse/SPARK-10794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945567#comment-14945567 ] Jia Li commented on SPARK-10794: I tried the repro steps on spark 1.5.0 for hadoop 2.6 an

[jira] [Created] (SPARK-10954) Parquet version in the "created_by" metadata field of Parquet files written by Spark 1.5 and 1.6 is wrong

Cheng Lian created SPARK-10954: -- Summary: Parquet version in the "created_by" metadata field of Parquet files written by Spark 1.5 and 1.6 is wrong Key: SPARK-10954 URL: https://issues.apache.org/jira/browse/SPARK-10

[jira] [Assigned] (SPARK-10902) Hive UDF current_database() does not work

[ https://issues.apache.org/jira/browse/SPARK-10902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10902: Assignee: Apache Spark > Hive UDF current_database() does not work > -

[jira] [Assigned] (SPARK-10902) Hive UDF current_database() does not work

[ https://issues.apache.org/jira/browse/SPARK-10902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10902: Assignee: (was: Apache Spark) > Hive UDF current_database() does not work > --

[jira] [Commented] (SPARK-10902) Hive UDF current_database() does not work

[ https://issues.apache.org/jira/browse/SPARK-10902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945530#comment-14945530 ] Apache Spark commented on SPARK-10902: -- User 'davies' has created a pull request for

[jira] [Commented] (SPARK-10953) Benchmark codegen vs. hand-written code for univariate statistics

[ https://issues.apache.org/jira/browse/SPARK-10953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945532#comment-14945532 ] Jihong MA commented on SPARK-10953: --- [~mengxr] do you mean comparing an implementation

[jira] [Updated] (SPARK-10951) Support private S3 repositories using spark-submit via --repositories flag

[ https://issues.apache.org/jira/browse/SPARK-10951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Lam updated SPARK-10951: -- Summary: Support private S3 repositories using spark-submit via --repositories flag (was: Support priv

[jira] [Commented] (SPARK-10913) Add attach() function for DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945510#comment-14945510 ] Apache Spark commented on SPARK-10913: -- User 'adrian555' has created a pull request

[jira] [Commented] (SPARK-10931) PySpark ML Models should contain Param values

[ https://issues.apache.org/jira/browse/SPARK-10931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945505#comment-14945505 ] Evan Chen commented on SPARK-10931: --- Hey Joseph, I can work on this. Thanks > PySpar

[jira] [Updated] (SPARK-10810) Improve session management for SQL

[ https://issues.apache.org/jira/browse/SPARK-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-10810: --- Attachment: Session management in Spark SQL 1.6.pdf Design doc > Improve session management for SQL

[jira] [Commented] (SPARK-10812) Spark Hadoop Util does not support stopping a non-yarn Spark Context & starting a Yarn spark context.

[ https://issues.apache.org/jira/browse/SPARK-10812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945492#comment-14945492 ] Apache Spark commented on SPARK-10812: -- User 'vanzin' has created a pull request for

[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945470#comment-14945470 ] Vincent Warmerdam commented on SPARK-8684: -- It seems that the most recent AMI fro

[jira] [Closed] (SPARK-9040) StructField datatype Conversion Error

[ https://issues.apache.org/jira/browse/SPARK-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Pal closed SPARK-9040. -- Resolution: Fixed Fix Version/s: 1.4.0 > StructField datatype Conversion Error >

[jira] [Commented] (SPARK-10940) Too many open files Spark Shuffle

[ https://issues.apache.org/jira/browse/SPARK-10940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945449#comment-14945449 ] Sandeep Pal commented on SPARK-10940: - Ok sure, how much do you suggest to increase f

[jira] [Commented] (SPARK-9325) Support `collect` on DataFrame columns

[ https://issues.apache.org/jira/browse/SPARK-9325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945446#comment-14945446 ] Felix Cheung commented on SPARK-9325: - My comment was on collect(df$Age). As I've stat

[jira] [Commented] (SPARK-10798) JsonMappingException with Spark Context Parallelize

[ https://issues.apache.org/jira/browse/SPARK-10798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945445#comment-14945445 ] Miao Wang commented on SPARK-10798: --- @Sean, Thanks for pointing it out. I come from C,C

[jira] [Commented] (SPARK-10914) Incorrect empty join sets when executor-memory >= 32g

[ https://issues.apache.org/jira/browse/SPARK-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945443#comment-14945443 ] Ben Moran commented on SPARK-10914: --- Ah, I did it the wrong way around! With a *small*

[jira] [Commented] (SPARK-10914) Incorrect empty join sets when executor-memory >= 32g

[ https://issues.apache.org/jira/browse/SPARK-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945441#comment-14945441 ] Ben Moran commented on SPARK-10914: --- I just ran with --executor-memory 100g --conf "s

[jira] [Commented] (SPARK-10914) Incorrect empty join sets when executor-memory >= 32g

[ https://issues.apache.org/jira/browse/SPARK-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945436#comment-14945436 ] Sean Owen commented on SPARK-10914: --- Sure, pass -XX:-UseCompressedOops. So if it fails

[jira] [Commented] (SPARK-10940) Too many open files Spark Shuffle

[ https://issues.apache.org/jira/browse/SPARK-10940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945438#comment-14945438 ] Sean Owen commented on SPARK-10940: --- I see your point, though what happens if you crank

[jira] [Commented] (SPARK-10914) Incorrect empty join sets when executor-memory >= 32g

[ https://issues.apache.org/jira/browse/SPARK-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945426#comment-14945426 ] Ben Moran commented on SPARK-10914: --- java -XX:+PrintFlagsFinal says: bool UseComp

[jira] [Commented] (SPARK-10914) Incorrect empty join sets when executor-memory >= 32g

[ https://issues.apache.org/jira/browse/SPARK-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945418#comment-14945418 ] Sean Owen commented on SPARK-10914: --- One long-shot question -- can you figure out wheth

[jira] [Commented] (SPARK-10641) skewness and kurtosis support

[ https://issues.apache.org/jira/browse/SPARK-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945412#comment-14945412 ] Xiangrui Meng commented on SPARK-10641: --- Btw, I checked the implementation of StdDe

[jira] [Commented] (SPARK-10914) Incorrect empty join sets when executor-memory >= 32g

[ https://issues.apache.org/jira/browse/SPARK-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945417#comment-14945417 ] Sean Owen commented on SPARK-10914: --- One long-shot question -- can you figure out wheth

[jira] [Resolved] (SPARK-10901) spark.yarn.user.classpath.first doesn't work

[ https://issues.apache.org/jira/browse/SPARK-10901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-10901. Resolution: Fixed Fix Version/s: 1.6.0 1.5.2 > spark.yarn.user.cl

[jira] [Issue Comment Deleted] (SPARK-10641) skewness and kurtosis support

[ https://issues.apache.org/jira/browse/SPARK-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10641: -- Comment: was deleted (was: If we want to implement the numerically stable version. We should r

[jira] [Updated] (SPARK-10953) Benchmark codegen vs. hand-written code for univariate statistics

[ https://issues.apache.org/jira/browse/SPARK-10953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10953: -- Target Version/s: 1.6.0 > Benchmark codegen vs. hand-written code for univariate statistics > -

[jira] [Comment Edited] (SPARK-10940) Too many open files Spark Shuffle

[ https://issues.apache.org/jira/browse/SPARK-10940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945390#comment-14945390 ] Sandeep Pal edited comment on SPARK-10940 at 10/6/15 5:30 PM: -

[jira] [Commented] (SPARK-10953) Benchmark codegen vs. hand-written code for univariate statistics

[ https://issues.apache.org/jira/browse/SPARK-10953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945409#comment-14945409 ] Xiangrui Meng commented on SPARK-10953: --- [~JihongMA] Do you have time to benchmark

[jira] [Created] (SPARK-10953) Benchmark codegen vs. hand-written code for univariate statistics

Xiangrui Meng created SPARK-10953: - Summary: Benchmark codegen vs. hand-written code for univariate statistics Key: SPARK-10953 URL: https://issues.apache.org/jira/browse/SPARK-10953 Project: Spark

[jira] [Commented] (SPARK-9318) Add `merge` as synonym for join

[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945402#comment-14945402 ] Shivaram Venkataraman commented on SPARK-9318: -- [~Narine] Could you post gene

[jira] [Commented] (SPARK-10940) Too many open files Spark Shuffle

[ https://issues.apache.org/jira/browse/SPARK-10940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945390#comment-14945390 ] Sandeep Pal commented on SPARK-10940: - Yes, I am using the default shuffle manager in

[jira] [Resolved] (SPARK-10916) YARN executors are launched with the default perm gen size

[ https://issues.apache.org/jira/browse/SPARK-10916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-10916. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 1.6.0 > YARN exec

[jira] [Updated] (SPARK-10765) use new aggregate interface for hive UDAF

[ https://issues.apache.org/jira/browse/SPARK-10765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10765: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-4366 > use new aggregate interface for hiv

[jira] [Resolved] (SPARK-9239) HiveUDAF support for AggregateFunction2

[ https://issues.apache.org/jira/browse/SPARK-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9239. - Resolution: Duplicate Fix Version/s: 1.6.0 > HiveUDAF support for AggregateFunction2 >

[jira] [Commented] (SPARK-10326) Cannot launch YARN job on Windows

[ https://issues.apache.org/jira/browse/SPARK-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945367#comment-14945367 ] Marcelo Vanzin commented on SPARK-10326: Can you provide a little more detail tha

[jira] [Assigned] (SPARK-9239) HiveUDAF support for AggregateFunction2

[ https://issues.apache.org/jira/browse/SPARK-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-9239: --- Assignee: Wenchen Fan > HiveUDAF support for AggregateFunction2 > ---

[jira] [Resolved] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-10937. Resolution: Invalid As I mentioned before, you have old Hive jars in your classpath! They'r

[jira] [Updated] (SPARK-10914) Incorrect empty join sets when executor-memory >= 32g

[ https://issues.apache.org/jira/browse/SPARK-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Moran updated SPARK-10914: -- Summary: Incorrect empty join sets when executor-memory >= 32g (was: Incorrect empty join sets) > Inc

[jira] [Updated] (SPARK-10585) only copy data once when generate unsafe projection

[ https://issues.apache.org/jira/browse/SPARK-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-10585: --- Assignee: Wenchen Fan > only copy data once when generate unsafe projection > ---

[jira] [Closed] (SPARK-9158) PyLint should only fail on error

[ https://issues.apache.org/jira/browse/SPARK-9158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-9158. - Resolution: Won't Fix > PyLint should only fail on error > > >

[jira] [Commented] (SPARK-10914) Incorrect empty join sets

[ https://issues.apache.org/jira/browse/SPARK-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945358#comment-14945358 ] Ben Moran commented on SPARK-10914: --- Thanks for looking into it. I have narrowed it do

[jira] [Commented] (SPARK-9158) PyLint should only fail on error

[ https://issues.apache.org/jira/browse/SPARK-9158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945359#comment-14945359 ] Davies Liu commented on SPARK-9158: --- Just realized that PyLint is not that useful, right

[jira] [Resolved] (SPARK-10944) org/slf4j/Logger is not provided in spark-1.5.1-bin-without-hadoop/lib/spark-assembly-1.5.1-hadoop2.2.0.jar

[ https://issues.apache.org/jira/browse/SPARK-10944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-10944. Resolution: Not A Problem Please read the documentation: https://spark.apache.org/docs/lat

[jira] [Commented] (SPARK-9158) PyLint should only fail on error

[ https://issues.apache.org/jira/browse/SPARK-9158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945346#comment-14945346 ] Alan Chin commented on SPARK-9158: -- Hi Davies, Do you by chance have a link to the failin

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945345#comment-14945345 ] Khaled Ammar commented on SPARK-10945: -- input dataset has no weights. I expect this

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945316#comment-14945316 ] Sean Owen commented on SPARK-10945: --- Are you talking about the input (Twitter data set)

[jira] [Commented] (SPARK-10641) skewness and kurtosis support

[ https://issues.apache.org/jira/browse/SPARK-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945309#comment-14945309 ] Xiangrui Meng commented on SPARK-10641: --- If we want to implement the numerically st

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945313#comment-14945313 ] Khaled Ammar commented on SPARK-10945: -- I did sort the input file and try it again.

[jira] [Commented] (SPARK-10641) skewness and kurtosis support

[ https://issues.apache.org/jira/browse/SPARK-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945308#comment-14945308 ] Xiangrui Meng commented on SPARK-10641: --- If we want to implement the numerically st

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945299#comment-14945299 ] Khaled Ammar commented on SPARK-10945: -- I am sorry, it looks like I am confusing you

[jira] [Commented] (SPARK-10952) Don't explode the environment when HIVE_HOME isn't set.

[ https://issues.apache.org/jira/browse/SPARK-10952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945296#comment-14945296 ] Apache Spark commented on SPARK-10952: -- User 'kevincox' has created a pull request f

[jira] [Updated] (SPARK-10949) Upgrade Snappy Java to 1.1.2

[ https://issues.apache.org/jira/browse/SPARK-10949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10949: -- Affects Version/s: (was: 1.5.2) (was: 1.6.0) Target Version/s: (wa

[jira] [Assigned] (SPARK-10952) Don't explode the environment when HIVE_HOME isn't set.

[ https://issues.apache.org/jira/browse/SPARK-10952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10952: Assignee: Apache Spark > Don't explode the environment when HIVE_HOME isn't set. > ---

[jira] [Created] (SPARK-10952) Don't explode the environment when HIVE_HOME isn't set.

Kevin Cox created SPARK-10952: - Summary: Don't explode the environment when HIVE_HOME isn't set. Key: SPARK-10952 URL: https://issues.apache.org/jira/browse/SPARK-10952 Project: Spark Issue Type:

[jira] [Commented] (SPARK-10949) Upgrade Snappy Java to 1.1.2

[ https://issues.apache.org/jira/browse/SPARK-10949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945295#comment-14945295 ] Apache Spark commented on SPARK-10949: -- User 'a-roberts' has created a pull request

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945267#comment-14945267 ] Sean Owen commented on SPARK-10945: --- Hm, do some vertices somehow have 0 out degree? I

[jira] [Assigned] (SPARK-10949) Upgrade Snappy Java to 1.1.2

[ https://issues.apache.org/jira/browse/SPARK-10949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10949: Assignee: (was: Apache Spark) > Upgrade Snappy Java to 1.1.2 > ---

[jira] [Assigned] (SPARK-10952) Don't explode the environment when HIVE_HOME isn't set.

[ https://issues.apache.org/jira/browse/SPARK-10952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10952: Assignee: (was: Apache Spark) > Don't explode the environment when HIVE_HOME isn't set

[jira] [Assigned] (SPARK-10949) Upgrade Snappy Java to 1.1.2

[ https://issues.apache.org/jira/browse/SPARK-10949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10949: Assignee: Apache Spark > Upgrade Snappy Java to 1.1.2 > > >

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945292#comment-14945292 ] Khaled Ammar commented on SPARK-10945: -- There are several vertices with 0 out degree

[jira] [Commented] (SPARK-10945) GraphX computes Pagerank with NaN (with some datasets)

[ https://issues.apache.org/jira/browse/SPARK-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945290#comment-14945290 ] Sean Owen commented on SPARK-10945: --- Some values in the input have infinite weight? tha

[jira] [Updated] (SPARK-10883) Document building each module individually

[ https://issues.apache.org/jira/browse/SPARK-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10883: -- Priority: Trivial (was: Major) Component/s: (was: Build) Documentation

[jira] [Updated] (SPARK-10951) Support private S3 pepositories using spark-submit via --repositories flag

[ https://issues.apache.org/jira/browse/SPARK-10951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry Lam updated SPARK-10951: -- Summary: Support private S3 pepositories using spark-submit via --repositories flag (was: Support S3 p

[jira] [Comment Edited] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945224#comment-14945224 ] Curtis Wilde edited comment on SPARK-10937 at 10/6/15 4:16 PM:

[jira] [Comment Edited] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945224#comment-14945224 ] Curtis Wilde edited comment on SPARK-10937 at 10/6/15 4:16 PM:

[jira] [Commented] (SPARK-9478) Add class weights to Random Forest

[ https://issues.apache.org/jira/browse/SPARK-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945282#comment-14945282 ] Patrick Crenshaw commented on SPARK-9478: - [~meihuawu] No, I am not working on thi

[jira] [Commented] (SPARK-10883) Be able to build each module individually

[ https://issues.apache.org/jira/browse/SPARK-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945278#comment-14945278 ] Jean-Baptiste Onofré commented on SPARK-10883: -- By the way, I think it would

[jira] [Commented] (SPARK-10883) Be able to build each module individually

[ https://issues.apache.org/jira/browse/SPARK-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945275#comment-14945275 ] Apache Spark commented on SPARK-10883: -- User 'jbonofre' has created a pull request f

[jira] [Reopened] (SPARK-10883) Be able to build each module individually

[ https://issues.apache.org/jira/browse/SPARK-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré reopened SPARK-10883: -- I added a note in the documentation how to build individual sub-module. > Be able

[jira] [Created] (SPARK-10951) Support S3 pepository using spark-submit via --repositories flag

Jerry Lam created SPARK-10951: - Summary: Support S3 pepository using spark-submit via --repositories flag Key: SPARK-10951 URL: https://issues.apache.org/jira/browse/SPARK-10951 Project: Spark I

[jira] [Commented] (SPARK-10326) Cannot launch YARN job on Windows

[ https://issues.apache.org/jira/browse/SPARK-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945246#comment-14945246 ] Jose Antonio commented on SPARK-10326: -- I have tested on windows with spark 1.5.0 an

[jira] [Comment Edited] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945224#comment-14945224 ] Curtis Wilde edited comment on SPARK-10937 at 10/6/15 3:58 PM:

[jira] [Comment Edited] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944264#comment-14944264 ] Curtis Wilde edited comment on SPARK-10937 at 10/6/15 3:56 PM:

[jira] [Comment Edited] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944213#comment-14944213 ] Curtis Wilde edited comment on SPARK-10937 at 10/6/15 3:57 PM:

[jira] [Comment Edited] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945224#comment-14945224 ] Curtis Wilde edited comment on SPARK-10937 at 10/6/15 3:55 PM:

[jira] [Comment Edited] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945224#comment-14945224 ] Curtis Wilde edited comment on SPARK-10937 at 10/6/15 3:55 PM:

[jira] [Comment Edited] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945224#comment-14945224 ] Curtis Wilde edited comment on SPARK-10937 at 10/6/15 3:55 PM:

[jira] [Comment Edited] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945224#comment-14945224 ] Curtis Wilde edited comment on SPARK-10937 at 10/6/15 3:46 PM:

[jira] [Comment Edited] (SPARK-10937) java.lang.NoSuchMethodError when instantiating sqlContext in spark-shell using hive 0.12.x, 0.13.x

[ https://issues.apache.org/jira/browse/SPARK-10937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14945224#comment-14945224 ] Curtis Wilde edited comment on SPARK-10937 at 10/6/15 3:47 PM:

<    1   2   3   >