[jira] [Commented] (SPARK-3169) make-distribution.sh failed

[ https://issues.apache.org/jira/browse/SPARK-3169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105277#comment-14105277 ] Sean Owen commented on SPARK-3169: -- Same as

[jira] [Commented] (SPARK-1449) Please delete old releases from mirroring system

[ https://issues.apache.org/jira/browse/SPARK-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105303#comment-14105303 ] Sean Owen commented on SPARK-1449: -- [~pwendell] can you or someone else on the PMC zap

[jira] [Commented] (SPARK-3202) Manipulating columns in CSV file or Transpose of Array[Array[String]] RDD

[ https://issues.apache.org/jira/browse/SPARK-3202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109128#comment-14109128 ] Sean Owen commented on SPARK-3202: -- JIRA is not a good place to ask questions -- please

[jira] [Commented] (SPARK-2798) Correct several small errors in Flume module pom.xml files

[ https://issues.apache.org/jira/browse/SPARK-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109675#comment-14109675 ] Sean Owen commented on SPARK-2798: -- [~tdas] Cool, I think this closes SPARK-3169 too if I

[jira] [Commented] (SPARK-3098) In some cases, operation zipWithIndex get a wrong results

[ https://issues.apache.org/jira/browse/SPARK-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110463#comment-14110463 ] Sean Owen commented on SPARK-3098: -- [~matei] The question isn't whether distinct returns

[jira] [Commented] (SPARK-3276) Provide a API to specify whether the old files need to be ignored in file input text DStream

[ https://issues.apache.org/jira/browse/SPARK-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113704#comment-14113704 ] Sean Owen commented on SPARK-3276: -- Given the nature of a stream processing framework,

[jira] [Commented] (SPARK-3274) Spark Streaming Java API reports java.lang.ClassCastException when calling collectAsMap on JavaPairDStream

[ https://issues.apache.org/jira/browse/SPARK-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113702#comment-14113702 ] Sean Owen commented on SPARK-3274: -- Same as the problem and solution in

[jira] [Commented] (SPARK-3266) JavaDoubleRDD doesn't contain max()

[ https://issues.apache.org/jira/browse/SPARK-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113710#comment-14113710 ] Sean Owen commented on SPARK-3266: -- The method is declared in the superclass,

[jira] [Commented] (SPARK-3266) JavaDoubleRDD doesn't contain max()

[ https://issues.apache.org/jira/browse/SPARK-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114391#comment-14114391 ] Sean Owen commented on SPARK-3266: -- (Mea culpa! The example shows this is a legitimate

[jira] [Commented] (SPARK-3292) Shuffle Tasks run indefinitely even though there's no inputs

[ https://issues.apache.org/jira/browse/SPARK-3292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114829#comment-14114829 ] Sean Owen commented on SPARK-3292: -- Can you elaborate this? it's not clear whether you're

[jira] [Commented] (SPARK-3302) The wrong version information in SparkContext

[ https://issues.apache.org/jira/browse/SPARK-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115126#comment-14115126 ] Sean Owen commented on SPARK-3302: -- This duplicates at least one of

[jira] [Commented] (SPARK-3324) YARN module has nonstandard structure which cause compile error In IntelliJ

[ https://issues.apache.org/jira/browse/SPARK-3324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116278#comment-14116278 ] Sean Owen commented on SPARK-3324: -- I agree, I've had a similar problem and just resolved

[jira] [Commented] (SPARK-3326) can't access a static variable after init in mapper

[ https://issues.apache.org/jira/browse/SPARK-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116327#comment-14116327 ] Sean Owen commented on SPARK-3326: -- The call to Foo.getSome() occurs remotely, on a

[jira] [Commented] (SPARK-3324) YARN module has nonstandard structure which cause compile error In IntelliJ

[ https://issues.apache.org/jira/browse/SPARK-3324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116667#comment-14116667 ] Sean Owen commented on SPARK-3324: -- Let me try to sketch what's funky about the

[jira] [Commented] (SPARK-3324) YARN module has nonstandard structure which cause compile error In IntelliJ

[ https://issues.apache.org/jira/browse/SPARK-3324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116801#comment-14116801 ] Sean Owen commented on SPARK-3324: -- [~tianyi] I seem to remember having a similar

[jira] [Created] (SPARK-3330) Successive test runs with different profiles fail SparkSubmitSuite

Sean Owen created SPARK-3330: Summary: Successive test runs with different profiles fail SparkSubmitSuite Key: SPARK-3330 URL: https://issues.apache.org/jira/browse/SPARK-3330 Project: Spark

[jira] [Created] (SPARK-3331) PEP8 tests fail in release because they check unzipped py4j code

Sean Owen created SPARK-3331: Summary: PEP8 tests fail in release because they check unzipped py4j code Key: SPARK-3331 URL: https://issues.apache.org/jira/browse/SPARK-3331 Project: Spark

[jira] [Updated] (SPARK-3331) PEP8 tests fail because they check unzipped py4j code

[ https://issues.apache.org/jira/browse/SPARK-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3331: - Summary: PEP8 tests fail because they check unzipped py4j code (was: PEP8 tests fail in release because

[jira] [Updated] (SPARK-3331) PEP8 tests fail because they check unzipped py4j code

[ https://issues.apache.org/jira/browse/SPARK-3331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3331: - Description: PEP8 tests run on files under ./python, but unzipped py4j code is found at

[jira] [Resolved] (SPARK-3330) Successive test runs with different profiles fail SparkSubmitSuite

[ https://issues.apache.org/jira/browse/SPARK-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3330. -- Resolution: Won't Fix It will be more suitable to change jenkins to run mvn clean mvn ... package to

[jira] [Created] (SPARK-3369) Java mapPartitions Iterator-Iterable is inconsistent with Scala's Iterator-Iterator

Sean Owen created SPARK-3369: Summary: Java mapPartitions Iterator-Iterable is inconsistent with Scala's Iterator-Iterator Key: SPARK-3369 URL: https://issues.apache.org/jira/browse/SPARK-3369 Project:

[jira] [Resolved] (SPARK-563) Run findBugs and IDEA inspections in the codebase

[ https://issues.apache.org/jira/browse/SPARK-563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-563. - Resolution: Won't Fix This appears to be obsolete/stale too. Run findBugs and IDEA inspections in the

[jira] [Commented] (SPARK-3384) Potential thread unsafe Breeze vector addition in KMeans

[ https://issues.apache.org/jira/browse/SPARK-3384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120314#comment-14120314 ] Sean Owen commented on SPARK-3384: -- [~rnowling] I think it fairly important for speed in

[jira] [Resolved] (SPARK-640) Update Hadoop 1 version to 1.1.0 (especially on AMIs)

[ https://issues.apache.org/jira/browse/SPARK-640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-640. - Resolution: Fixed This looks stale right? Hadoop 1 version has been at 1.2.1 for some time. Update

[jira] [Resolved] (SPARK-529) Have a single file that controls the environmental variables and spark config options

[ https://issues.apache.org/jira/browse/SPARK-529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-529. - Resolution: Won't Fix This looks obsolete and/or fixed, as variables like SPARK_MEM are deprecated, and I

[jira] [Created] (SPARK-3404) SparkSubmitSuite fails in Maven (only) - spark-submit exits with code 1

Sean Owen created SPARK-3404: Summary: SparkSubmitSuite fails in Maven (only) - spark-submit exits with code 1 Key: SPARK-3404 URL: https://issues.apache.org/jira/browse/SPARK-3404 Project: Spark

[jira] [Commented] (SPARK-3404) SparkSubmitSuite fails with spark-submit exits with code 1

[ https://issues.apache.org/jira/browse/SPARK-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121653#comment-14121653 ] Sean Owen commented on SPARK-3404: -- It's 100% repeatable in Maven for me locally, which

[jira] [Commented] (SPARK-3369) Java mapPartitions Iterator-Iterable is inconsistent with Scala's Iterator-Iterator

[ https://issues.apache.org/jira/browse/SPARK-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122921#comment-14122921 ] Sean Owen commented on SPARK-3369: -- The API change is unlikely to happen. Making a bunch

[jira] [Commented] (SPARK-3442) Create LengthBoundedInputStream

[ https://issues.apache.org/jira/browse/SPARK-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125948#comment-14125948 ] Sean Owen commented on SPARK-3442: -- This exists in Guava as LimitInputStream until Guava

[jira] [Resolved] (SPARK-3404) SparkSubmitSuite fails with spark-submit exits with code 1

[ https://issues.apache.org/jira/browse/SPARK-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3404. -- Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Tests are now failing due to

[jira] [Commented] (SPARK-3470) Have JavaSparkContext implement Closeable/AutoCloseable

[ https://issues.apache.org/jira/browse/SPARK-3470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128232#comment-14128232 ] Sean Owen commented on SPARK-3470: -- If you implement {{AutoCloseable}}, then Spark will

[jira] [Commented] (SPARK-3474) Rename the env variable SPARK_MASTER_IP to SPARK_MASTER_HOST

[ https://issues.apache.org/jira/browse/SPARK-3474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128300#comment-14128300 ] Sean Owen commented on SPARK-3474: -- (You can deprecate but still support old variable

[jira] [Commented] (SPARK-3470) Have JavaSparkContext implement Closeable/AutoCloseable

[ https://issues.apache.org/jira/browse/SPARK-3470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128764#comment-14128764 ] Sean Owen commented on SPARK-3470: -- Spark retains compatibility with Java 6 on purpose

[jira] [Commented] (SPARK-558) Simplify run script by relying on sbt to launch app

[ https://issues.apache.org/jira/browse/SPARK-558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129798#comment-14129798 ] Sean Owen commented on SPARK-558: - Is this stale too? given that SBT is less used, I don't

[jira] [Resolved] (SPARK-683) Spark 0.7 with Hadoop 1.0 does not work with current AMI's HDFS installation

[ https://issues.apache.org/jira/browse/SPARK-683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-683. - Resolution: Fixed I think this is likely long since obsolete or fixed, since Spark, Hadoop and AMI Hadoop

[jira] [Commented] (SPARK-880) When built with Hadoop2, spark-shell and examples don't initialize log4j properly

[ https://issues.apache.org/jira/browse/SPARK-880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129803#comment-14129803 ] Sean Owen commented on SPARK-880: - This should be resolved/obsoleted by subsequent updates

[jira] [Commented] (SPARK-3520) java version check in spark-class fails with openjdk

[ https://issues.apache.org/jira/browse/SPARK-3520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14133226#comment-14133226 ] Sean Owen commented on SPARK-3520: -- Duplicated / subsumed by

[jira] [Commented] (SPARK-3521) Missing modules in 1.1.0 source distribution - cant be build with maven

[ https://issues.apache.org/jira/browse/SPARK-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14133413#comment-14133413 ] Sean Owen commented on SPARK-3521: --

[jira] [Commented] (SPARK-3530) Pipeline and Parameters

[ https://issues.apache.org/jira/browse/SPARK-3530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14133760#comment-14133760 ] Sean Owen commented on SPARK-3530: -- A few high-level questions: Is this a rewrite of

[jira] [Resolved] (SPARK-3470) Have JavaSparkContext implement Closeable/AutoCloseable

[ https://issues.apache.org/jira/browse/SPARK-3470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3470. -- Resolution: Fixed Fix Version/s: 1.2.0 Have JavaSparkContext implement Closeable/AutoCloseable

[jira] [Commented] (SPARK-1895) Run tests on windows

[ https://issues.apache.org/jira/browse/SPARK-1895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14133964#comment-14133964 ] Sean Owen commented on SPARK-1895: -- Can anyone still reproduce this? I know test temp

[jira] [Resolved] (SPARK-1258) RDD.countByValue optimization

[ https://issues.apache.org/jira/browse/SPARK-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1258. -- Resolution: Won't Fix I'm taking the liberty of closing this, since this refers to an optimization

[jira] [Commented] (SPARK-3506) 1.1.0-SNAPSHOT in docs for 1.1.0 under docs/latest

[ https://issues.apache.org/jira/browse/SPARK-3506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14133976#comment-14133976 ] Sean Owen commented on SPARK-3506: -- Yeah, I imagine that can be touched up right now. For

[jira] [Commented] (SPARK-2620) case class cannot be used as key for reduce

[ https://issues.apache.org/jira/browse/SPARK-2620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14134096#comment-14134096 ] Sean Owen commented on SPARK-2620: -- FWIW, here is a mailing list comment that suggests

[jira] [Commented] (SPARK-3563) Shuffle data not always be cleaned

[ https://issues.apache.org/jira/browse/SPARK-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136899#comment-14136899 ] Sean Owen commented on SPARK-3563: -- I am no expert, but I believe this is on purpose, in

[jira] [Commented] (SPARK-3621) Provide a way to broadcast an RDD (instead of just a variable made of the RDD) so that a job can access

[ https://issues.apache.org/jira/browse/SPARK-3621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14142383#comment-14142383 ] Sean Owen commented on SPARK-3621: -- My understanding is that this is fairly fundamentally

[jira] [Commented] (SPARK-3621) Provide a way to broadcast an RDD (instead of just a variable made of the RDD) so that a job can access

[ https://issues.apache.org/jira/browse/SPARK-3621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143009#comment-14143009 ] Sean Owen commented on SPARK-3621: -- If the data is shipped to the worker node, and the

[jira] [Commented] (SPARK-3625) In some cases, the RDD.checkpoint does not work

[ https://issues.apache.org/jira/browse/SPARK-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143153#comment-14143153 ] Sean Owen commented on SPARK-3625: -- This prints 1000 both times for me, which is correct.

[jira] [Commented] (SPARK-3625) In some cases, the RDD.checkpoint does not work

[ https://issues.apache.org/jira/browse/SPARK-3625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143342#comment-14143342 ] Sean Owen commented on SPARK-3625: -- It still prints 1000 both times, which is correct.

[jira] [Commented] (SPARK-3431) Parallelize execution of tests

[ https://issues.apache.org/jira/browse/SPARK-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143724#comment-14143724 ] Sean Owen commented on SPARK-3431: -- It's trivial to configure Maven surefire/failsafe to

[jira] [Commented] (SPARK-3431) Parallelize execution of tests

[ https://issues.apache.org/jira/browse/SPARK-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14143835#comment-14143835 ] Sean Owen commented on SPARK-3431: -- For your experiments, scalatest just copies an old

[jira] [Commented] (SPARK-3656) IllegalArgumentException when I using sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-3656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144588#comment-14144588 ] Sean Owen commented on SPARK-3656: -- Duplicate of

[jira] [Commented] (SPARK-3662) Importing pandas breaks included pi.py example

[ https://issues.apache.org/jira/browse/SPARK-3662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14146017#comment-14146017 ] Sean Owen commented on SPARK-3662: -- Maybe I miss something, but, does this just mean you

[jira] [Commented] (SPARK-3676) jdk version lead to spark sql test suite error

[ https://issues.apache.org/jira/browse/SPARK-3676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14146040#comment-14146040 ] Sean Owen commented on SPARK-3676: -- (For the interested, I looked it up, since the

[jira] [Updated] (SPARK-3586) Support nested directories in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3586: - Issue Type: Improvement (was: Bug) Summary: Support nested directories in Spark Streaming (was:

[jira] [Commented] (SPARK-3603) InvalidClassException on a Linux VM - probably problem with serialization

[ https://issues.apache.org/jira/browse/SPARK-3603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150700#comment-14150700 ] Sean Owen commented on SPARK-3603: -- Can you clarify what works and doesn't work -- works

[jira] [Resolved] (SPARK-1279) Stage.name return apply at Option.scala:120

[ https://issues.apache.org/jira/browse/SPARK-1279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1279. -- Resolution: Duplicate Obvious accidental dupe of SPARK-1280 Stage.name return apply at

[jira] [Resolved] (SPARK-2960) Spark executables fail to start via symlinks

[ https://issues.apache.org/jira/browse/SPARK-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2960. -- Resolution: Duplicate Fix Version/s: (was: 1.0.2) I suggest this be marked a dupe of

[jira] [Commented] (SPARK-3504) KMeans clusterer is slow, can be sped up by 75%

[ https://issues.apache.org/jira/browse/SPARK-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150709#comment-14150709 ] Sean Owen commented on SPARK-3504: -- Is this the same as

[jira] [Resolved] (SPARK-3324) YARN module has nonstandard structure which cause compile error In IntelliJ

[ https://issues.apache.org/jira/browse/SPARK-3324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3324. -- Resolution: Won't Fix I propose considering this WontFix, as it will go away when yarn-alpha goes away

[jira] [Updated] (SPARK-3195) Can you add some statistics to do logistic regression better in mllib?

[ https://issues.apache.org/jira/browse/SPARK-3195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3195: - Priority: Minor (was: Major) Target Version/s: (was: 1.3.0) Fix Version/s: (was:

[jira] [Resolved] (SPARK-1046) Enable to build behind a proxy.

[ https://issues.apache.org/jira/browse/SPARK-1046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1046. -- Resolution: Fixed Enable to build behind a proxy. ---

[jira] [Resolved] (SPARK-3101) Missing volatile annotation in ApplicationMaster

[ https://issues.apache.org/jira/browse/SPARK-3101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3101. -- Resolution: Fixed This was actually subsumed by the commit for SPARK-2933 Missing volatile annotation

[jira] [Resolved] (SPARK-2815) Compilation failed upon the hadoop version 2.0.0-cdh4.5.0

[ https://issues.apache.org/jira/browse/SPARK-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2815. -- Resolution: Won't Fix Target Version/s: (was: 1.1.0) This looks like a WontFix, given the

[jira] [Commented] (SPARK-3652) upgrade spark sql hive version to 0.13.1

[ https://issues.apache.org/jira/browse/SPARK-3652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150719#comment-14150719 ] Sean Owen commented on SPARK-3652: -- Yes, there is a lot to updating to 0.13 as you can

[jira] [Commented] (SPARK-2655) Change the default logging level to WARN

[ https://issues.apache.org/jira/browse/SPARK-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150740#comment-14150740 ] Sean Owen commented on SPARK-2655: -- Given the PR discussion, this is a WontFix? Change

[jira] [Commented] (SPARK-2331) SparkContext.emptyRDD has wrong return type

[ https://issues.apache.org/jira/browse/SPARK-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150746#comment-14150746 ] Sean Owen commented on SPARK-2331: -- Yes your analysis is right-er, I think. I imagine

[jira] [Commented] (SPARK-2247) Data frame (or Pandas) like API for structured data

[ https://issues.apache.org/jira/browse/SPARK-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150748#comment-14150748 ] Sean Owen commented on SPARK-2247: -- For pandas, is this what Sparkling Pandas provides?

[jira] [Updated] (SPARK-2153) CassandraTest fails for newer Cassandra due to case insensitive key space

[ https://issues.apache.org/jira/browse/SPARK-2153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2153: - Summary: CassandraTest fails for newer Cassandra due to case insensitive key space (was: Spark Examples)

[jira] [Resolved] (SPARK-1895) Run tests on windows

[ https://issues.apache.org/jira/browse/SPARK-1895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1895. -- Resolution: Cannot Reproduce Run tests on windows Key:

[jira] [Commented] (SPARK-2517) Remove as many compilation warning messages as possible

[ https://issues.apache.org/jira/browse/SPARK-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150753#comment-14150753 ] Sean Owen commented on SPARK-2517: -- [~rxin] I think you resolved this? I don't see these

[jira] [Commented] (SPARK-3359) `sbt/sbt unidoc` doesn't work with Java 8

[ https://issues.apache.org/jira/browse/SPARK-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150778#comment-14150778 ] Sean Owen commented on SPARK-3359: -- Yeah I noticed this. The problem is that

[jira] [Commented] (SPARK-3714) Spark workflow scheduler

[ https://issues.apache.org/jira/browse/SPARK-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151422#comment-14151422 ] Sean Owen commented on SPARK-3714: -- Another meta-question for everyone: at what point

[jira] [Commented] (SPARK-3274) Spark Streaming Java API reports java.lang.ClassCastException when calling collectAsMap on JavaPairDStream

[ https://issues.apache.org/jira/browse/SPARK-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14151432#comment-14151432 ] Sean Owen commented on SPARK-3274: -- I don't think that's the same thing. It is just

[jira] [Resolved] (SPARK-2159) Spark shell exit() does not stop SparkContext

[ https://issues.apache.org/jira/browse/SPARK-2159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2159. -- Resolution: Won't Fix Fix Version/s: (was: 1.2.0) The discussion in the PR suggests this is

[jira] [Resolved] (SPARK-2643) Stages web ui has ERROR when pool name is None

[ https://issues.apache.org/jira/browse/SPARK-2643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2643. -- Resolution: Fixed Discussion suggests this was fixed by a related change:

[jira] [Resolved] (SPARK-1208) after some hours of working the :4040 monitoring UI stops working.

[ https://issues.apache.org/jira/browse/SPARK-1208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1208. -- Resolution: Fixed This appears to be a similar, if not the same issue, as in SPARK-2643. The

[jira] [Updated] (SPARK-3203) ClassNotFoundException in spark-shell with Cassandra

[ https://issues.apache.org/jira/browse/SPARK-3203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3203: - Summary: ClassNotFoundException in spark-shell with Cassandra (was: ClassNotFound Exception)

[jira] [Updated] (SPARK-1381) Spark to Shark direct streaming

[ https://issues.apache.org/jira/browse/SPARK-1381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1381: - Priority: Major (was: Blocker) It sounds like this is WontFix at this point, if there was a problem to

[jira] [Resolved] (SPARK-1381) Spark to Shark direct streaming

[ https://issues.apache.org/jira/browse/SPARK-1381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1381. -- Resolution: Won't Fix Spark to Shark direct streaming ---

[jira] [Updated] (SPARK-1313) Shark- JDBC driver

[ https://issues.apache.org/jira/browse/SPARK-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1313: - Priority: Minor (was: Blocker) Issue Type: Question (was: Task) Shark- JDBC driver

[jira] [Resolved] (SPARK-1313) Shark- JDBC driver

[ https://issues.apache.org/jira/browse/SPARK-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1313. -- Resolution: Not a Problem This looks like it was a question more than anything, and was answered.

[jira] [Resolved] (SPARK-1884) Shark failed to start

[ https://issues.apache.org/jira/browse/SPARK-1884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1884. -- Resolution: Won't Fix This appears to be a protobuf version mismatch, which suggests Shark is being

[jira] [Commented] (SPARK-3725) Link to building spark returns a 404

[ https://issues.apache.org/jira/browse/SPARK-3725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14152050#comment-14152050 ] Sean Owen commented on SPARK-3725: -- Yes of course, it's already in the repo and has been

[jira] [Commented] (SPARK-3725) Link to building spark returns a 404

[ https://issues.apache.org/jira/browse/SPARK-3725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14152138#comment-14152138 ] Sean Owen commented on SPARK-3725: -- No, that links to the raw markdown. Truly, the fix is

[jira] [Commented] (SPARK-3730) Any one else having building spark recently

[ https://issues.apache.org/jira/browse/SPARK-3730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14152140#comment-14152140 ] Sean Owen commented on SPARK-3730: -- (The profile is hadoop-2.3 but that's not the issue.)

[jira] [Commented] (SPARK-3732) Yarn Client: Add option to NOT System.exit() at end of main()

[ https://issues.apache.org/jira/browse/SPARK-3732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14152912#comment-14152912 ] Sean Owen commented on SPARK-3732: -- FWIW, I was also surprised in the past that there is

[jira] [Commented] (SPARK-3764) Invalid dependencies of artifacts in Maven Central Repository.

[ https://issues.apache.org/jira/browse/SPARK-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156311#comment-14156311 ] Sean Owen commented on SPARK-3764: -- This is correct and as intended. Without any

[jira] [Commented] (SPARK-2809) update chill to version 0.5.0

[ https://issues.apache.org/jira/browse/SPARK-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156362#comment-14156362 ] Sean Owen commented on SPARK-2809: -- PS chill 0.5.0 is the first to support Scala 2.11, so

[jira] [Commented] (SPARK-1834) NoSuchMethodError when invoking JavaPairRDD.reduce() in Java

[ https://issues.apache.org/jira/browse/SPARK-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156477#comment-14156477 ] Sean Owen commented on SPARK-1834: -- Weird, I can reproduce this. I have a new test case

[jira] [Comment Edited] (SPARK-1834) NoSuchMethodError when invoking JavaPairRDD.reduce() in Java

[ https://issues.apache.org/jira/browse/SPARK-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156477#comment-14156477 ] Sean Owen edited comment on SPARK-1834 at 10/2/14 12:46 PM:

[jira] [Commented] (SPARK-3764) Invalid dependencies of artifacts in Maven Central Repository.

[ https://issues.apache.org/jira/browse/SPARK-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156581#comment-14156581 ] Sean Owen commented on SPARK-3764: -- The artifacts themselves don't contain any Hadoop

[jira] [Commented] (SPARK-3764) Invalid dependencies of artifacts in Maven Central Repository.

[ https://issues.apache.org/jira/browse/SPARK-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156723#comment-14156723 ] Sean Owen commented on SPARK-3764: -- I'm not sure what you mean. Spark compiles versus

[jira] [Commented] (SPARK-3769) SparkFiles.get gives me the wrong fully qualified path

[ https://issues.apache.org/jira/browse/SPARK-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157156#comment-14157156 ] Sean Owen commented on SPARK-3769: -- My understanding is that you execute: {code}

[jira] [Resolved] (SPARK-3764) Invalid dependencies of artifacts in Maven Central Repository.

[ https://issues.apache.org/jira/browse/SPARK-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3764. -- Resolution: Not a Problem Invalid dependencies of artifacts in Maven Central Repository.

[jira] [Commented] (SPARK-3794) Building spark core fails with specific hadoop version

[ https://issues.apache.org/jira/browse/SPARK-3794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14159524#comment-14159524 ] Sean Owen commented on SPARK-3794: -- The real problem here is that commons-io is not a

[jira] [Commented] (SPARK-3561) Expose pluggable architecture to facilitate native integration with third-party execution environments.

[ https://issues.apache.org/jira/browse/SPARK-3561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14159573#comment-14159573 ] Sean Owen commented on SPARK-3561: -- I'd be interested to see a more specific motivating

[jira] [Commented] (SPARK-3803) ArrayIndexOutOfBoundsException found in executing computePrincipalComponents

[ https://issues.apache.org/jira/browse/SPARK-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14159587#comment-14159587 ] Sean Owen commented on SPARK-3803: -- I agree with your assessment. It would take some

[jira] [Resolved] (SPARK-3784) Support off-loading computations to a GPU

[ https://issues.apache.org/jira/browse/SPARK-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3784. -- Resolution: Duplicate Duplicate of SPARK-3785 Support off-loading computations to a GPU

[jira] [Commented] (SPARK-3785) Support off-loading computations to a GPU

[ https://issues.apache.org/jira/browse/SPARK-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14160139#comment-14160139 ] Sean Owen commented on SPARK-3785: -- In broad terms, I find there are few computations

<    1   2   3   4   5   6   7   8   9   10   >