[jira] [Commented] (SPARK-4338) Remove yarn-alpha support

[ https://issues.apache.org/jira/browse/SPARK-4338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206104#comment-14206104 ] Sandy Ryza commented on SPARK-4338: --- Planning to take a stab at this Remove yarn-alpha

[jira] [Created] (SPARK-4338) Remove yarn-alpha support

Sandy Ryza created SPARK-4338: - Summary: Remove yarn-alpha support Key: SPARK-4338 URL: https://issues.apache.org/jira/browse/SPARK-4338 Project: Spark Issue Type: Sub-task Components:

[jira] [Updated] (SPARK-3647) Shaded Guava patch causes access issues with package private classes

[ https://issues.apache.org/jira/browse/SPARK-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Ash updated SPARK-3647: -- Fix Version/s: 1.2.0 Shaded Guava patch causes access issues with package private classes

[jira] [Commented] (SPARK-3647) Shaded Guava patch causes access issues with package private classes

[ https://issues.apache.org/jira/browse/SPARK-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206112#comment-14206112 ] Andrew Ash commented on SPARK-3647: --- Based on poking at the git repo below I'm marking

[jira] [Created] (SPARK-4339) Use configuration instead of constant

DoingDone9 created SPARK-4339: - Summary: Use configuration instead of constant Key: SPARK-4339 URL: https://issues.apache.org/jira/browse/SPARK-4339 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-572) Forbid update of static mutable variables

[ https://issues.apache.org/jira/browse/SPARK-572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206143#comment-14206143 ] Andrew Ash commented on SPARK-572: -- Static mutable variables are now a standard way of

[jira] [Updated] (SPARK-4339) Use configuration instead of constant

[ https://issues.apache.org/jira/browse/SPARK-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-4339: -- Description: fixedPoint limits the max number of iterations,it should be Configurable. Use

[jira] [Closed] (SPARK-572) Forbid update of static mutable variables

[ https://issues.apache.org/jira/browse/SPARK-572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-572. - Resolution: Won't Fix Closing this as won't fix since it is very hard to enforce and we do abuse it to

[jira] [Updated] (SPARK-4339) Make fixedPoint Configurable in Analyzer.scala

[ https://issues.apache.org/jira/browse/SPARK-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-4339: -- Summary: Make fixedPoint Configurable in Analyzer.scala (was: Use configuration instead of constant)

[jira] [Updated] (SPARK-4339) Make fixedPoint Configurable in Analyzer.scala

[ https://issues.apache.org/jira/browse/SPARK-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-4339: -- Description: fixedPoint limits the max number of iterations,it should be Configurable.But it is a

[jira] [Updated] (SPARK-4339) Make fixedPoint Configurable in Analyzer

[ https://issues.apache.org/jira/browse/SPARK-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-4339: -- Summary: Make fixedPoint Configurable in Analyzer (was: Make fixedPoint Configurable in

[jira] [Updated] (SPARK-4339) Make fixedPoint Configurable in Analyzer

[ https://issues.apache.org/jira/browse/SPARK-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-4339: -- Description: fixedPoint limits the max number of iterations,it should be Configurable.But it is a

[jira] [Updated] (SPARK-4339) Make fixedPoint Configurable in Analyzer

[ https://issues.apache.org/jira/browse/SPARK-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-4339: -- Description: fixedPoint limits the max number of iterations,it should be Configurable. But it is a

[jira] [Updated] (SPARK-4339) Make fixedPoint Configurable in Analyzer

[ https://issues.apache.org/jira/browse/SPARK-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-4339: -- Description: fixedPoint limits the max number of iterations,it should be Configurable.But it is a

[jira] [Commented] (SPARK-632) Akka system names need to be normalized (since they are case-sensitive)

[ https://issues.apache.org/jira/browse/SPARK-632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206158#comment-14206158 ] Andrew Ash commented on SPARK-632: -- // link moved to

[jira] [Created] (SPARK-4340) add java opts argument substitute to avoid gc log overwritten

Haitao Yao created SPARK-4340: - Summary: add java opts argument substitute to avoid gc log overwritten Key: SPARK-4340 URL: https://issues.apache.org/jira/browse/SPARK-4340 Project: Spark Issue

[jira] [Updated] (SPARK-689) Task will crash when setting SPARK_WORKER_CORES 128

[ https://issues.apache.org/jira/browse/SPARK-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Ash updated SPARK-689: - Description: when I set SPARK_WORKER_CORES 128(for example 200), and run a job in standalone mode that

[jira] [Commented] (SPARK-650) Add a setup hook API for running initialization code on each executor

[ https://issues.apache.org/jira/browse/SPARK-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206182#comment-14206182 ] Andrew Ash commented on SPARK-650: -- As mentioned in SPARK-572 static classes'

[jira] [Commented] (SPARK-632) Akka system names need to be normalized (since they are case-sensitive)

[ https://issues.apache.org/jira/browse/SPARK-632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206197#comment-14206197 ] Reynold Xin commented on SPARK-632: --- Sounds good. In the future we might roll our own RPC

[jira] [Closed] (SPARK-632) Akka system names need to be normalized (since they are case-sensitive)

[ https://issues.apache.org/jira/browse/SPARK-632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-632. - Resolution: Fixed Akka system names need to be normalized (since they are case-sensitive)

[jira] [Created] (SPARK-4341) Spark need to set num-executors automatically

Hong Shen created SPARK-4341: Summary: Spark need to set num-executors automatically Key: SPARK-4341 URL: https://issues.apache.org/jira/browse/SPARK-4341 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-4341) Spark need to set num-executors automatically

[ https://issues.apache.org/jira/browse/SPARK-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206216#comment-14206216 ] Sean Owen commented on SPARK-4341: -- I don't agree with this. How would Spark know a

[jira] [Updated] (SPARK-4314) Exception when textFileStream attempts to read deleted _COPYING_ file

[ https://issues.apache.org/jira/browse/SPARK-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maji2014 updated SPARK-4314: Description: [Reproduce] 1. Run HdfsWordCount interface, such as ssc.textFileStream(args(0)) 2. Upload

[jira] [Issue Comment Deleted] (SPARK-4314) Exception when textFileStream attempts to read deleted _COPYING_ file

[ https://issues.apache.org/jira/browse/SPARK-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maji2014 updated SPARK-4314: Comment: was deleted (was: Yes, Not all of this intermediate state are caught. i wanna add following code

[jira] [Resolved] (SPARK-4295) [External]Exception throws in SparkSinkSuite although all test cases pass

[ https://issues.apache.org/jira/browse/SPARK-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-4295. -- Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 [External]Exception

[jira] [Resolved] (SPARK-2492) KafkaReceiver minor changes to align with Kafka 0.8

[ https://issues.apache.org/jira/browse/SPARK-2492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-2492. -- Resolution: Fixed Fix Version/s: 1.2.0 KafkaReceiver minor changes to align with Kafka

[jira] [Commented] (SPARK-4341) Spark need to set num-executors automatically

[ https://issues.apache.org/jira/browse/SPARK-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206263#comment-14206263 ] Hong Shen commented on SPARK-4341: -- There must be some relation between inputSplits,

[jira] [Commented] (SPARK-4326) unidoc is broken on master

[ https://issues.apache.org/jira/browse/SPARK-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206265#comment-14206265 ] Sean Owen commented on SPARK-4326: -- Hm. {{hashInt}} isn't in Guava 11, but is in 12. This

[jira] [Commented] (SPARK-4340) add java opts argument substitute to avoid gc log overwritten

[ https://issues.apache.org/jira/browse/SPARK-4340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206286#comment-14206286 ] Apache Spark commented on SPARK-4340: - User 'haitaoyao' has created a pull request for

[jira] [Commented] (SPARK-4341) Spark need to set num-executors automatically

[ https://issues.apache.org/jira/browse/SPARK-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206288#comment-14206288 ] Sean Owen commented on SPARK-4341: -- Yes, but, the executors live as long as the app does.

[jira] [Commented] (SPARK-4342) connection ack timeout improvement, replace Timer with ScheudledExecutor...

[ https://issues.apache.org/jira/browse/SPARK-4342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206305#comment-14206305 ] Apache Spark commented on SPARK-4342: - User 'haitaoyao' has created a pull request for

[jira] [Resolved] (SPARK-2055) bin$ ./run-example is bad. must run SPARK_HOME$ bin/run-example. look at the file run-example at line 54.

[ https://issues.apache.org/jira/browse/SPARK-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2055. -- Resolution: Invalid I think this is obsolete or at least quite unclear. The script does control the

[jira] [Commented] (SPARK-1858) Update third-party Hadoop distros doc to list more distros

[ https://issues.apache.org/jira/browse/SPARK-1858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206353#comment-14206353 ] Sean Owen commented on SPARK-1858: -- Same, this is one of two issues left under the

[jira] [Commented] (SPARK-1564) Add JavaScript into Javadoc to turn ::Experimental:: and such into badges

[ https://issues.apache.org/jira/browse/SPARK-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206352#comment-14206352 ] Sean Owen commented on SPARK-1564: -- This is one of two issues left under the

[jira] [Resolved] (SPARK-2092) This is a test issue

[ https://issues.apache.org/jira/browse/SPARK-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2092. -- Resolution: Not a Problem Patrick can these test issues be closed? I'm just looking over old issues.

[jira] [Resolved] (SPARK-1943) Testing use of target version field

[ https://issues.apache.org/jira/browse/SPARK-1943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1943. -- Resolution: Not a Problem Patrick can these test issues be closed? I'm just looking over old issues.

[jira] [Updated] (SPARK-4196) Streaming + checkpointing + saveAsNewAPIHadoopFiles = NotSerializableException for Hadoop Configuration

[ https://issues.apache.org/jira/browse/SPARK-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4196: - Summary: Streaming + checkpointing + saveAsNewAPIHadoopFiles = NotSerializableException for Hadoop

[jira] [Updated] (SPARK-1825) Windows Spark fails to work with Linux YARN

[ https://issues.apache.org/jira/browse/SPARK-1825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ángel Álvarez updated SPARK-1825: - Attachment: SPARK-1825.patch Is it really necessary to change the file

[jira] [Resolved] (SPARK-1493) Apache RAT excludes don't work with file path (instead of file name)

[ https://issues.apache.org/jira/browse/SPARK-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1493. -- Resolution: Fixed Looks like this was fixed? There are no paths of this form in .rat-excludes now.

[jira] [Commented] (SPARK-4301) StreamingContext should not allow start() to be called after calling stop()

[ https://issues.apache.org/jira/browse/SPARK-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206406#comment-14206406 ] Sean Owen commented on SPARK-4301: -- Sorry, a bit late, but I noticed this is pretty

[jira] [Resolved] (SPARK-2725) Add instructions about how to build with Hive to building-with-maven.md

[ https://issues.apache.org/jira/browse/SPARK-2725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2725. -- Resolution: Fixed The current {{building-spark.md}} has Hive-related build instructions. This was

[jira] [Resolved] (SPARK-2720) spark-examples should depend on HBase modules for HBase 0.96+

[ https://issues.apache.org/jira/browse/SPARK-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2720. -- Resolution: Duplicate Basically subsumed by SPARK-1297, which was resolved. spark-examples should

[jira] [Resolved] (SPARK-2732) Update build script to Tachyon 0.5.0

[ https://issues.apache.org/jira/browse/SPARK-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2732. -- Resolution: Duplicate Dupe of SPARK-2702, and resolved anyway. Update build script to Tachyon 0.5.0

[jira] [Resolved] (SPARK-2733) Update make-distribution.sh to download Tachyon 0.5.0

[ https://issues.apache.org/jira/browse/SPARK-2733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2733. -- Resolution: Duplicate Also roughly a duplicate of SPARK-2702, like its parent, and also resolved.

[jira] [Commented] (SPARK-2819) Difficult to turn on intercept with linear models

[ https://issues.apache.org/jira/browse/SPARK-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206415#comment-14206415 ] Sean Owen commented on SPARK-2819: -- Is this still in play ? the convenience methods can't

[jira] [Resolved] (SPARK-2982) Glitch of spark streaming

[ https://issues.apache.org/jira/browse/SPARK-2982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2982. -- Resolution: Invalid Target Version/s: (was: 1.0.2) Glitch of spark streaming

[jira] [Resolved] (SPARK-2121) Not fully cached when there is enough memory in ALS

[ https://issues.apache.org/jira/browse/SPARK-2121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2121. -- Resolution: Not a Problem Not fully cached when there is enough memory in ALS

[jira] [Resolved] (SPARK-3228) When DStream save RDD to hdfs , don't create directory and empty file if there are no data received from source in the batch duration .

[ https://issues.apache.org/jira/browse/SPARK-3228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3228. -- Resolution: Won't Fix Given PR discussion, sounds like a WontFix When DStream save RDD to hdfs ,

[jira] [Resolved] (SPARK-3624) Failed to find Spark assembly in /usr/share/spark/lib for RELEASED debian packages

[ https://issues.apache.org/jira/browse/SPARK-3624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3624. -- Resolution: Won't Fix PR discussion seems to have several votes for WontFix Failed to find Spark

[jira] [Resolved] (SPARK-1317) sbt doesn't work for building Spark programs

[ https://issues.apache.org/jira/browse/SPARK-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1317. -- Resolution: Not a Problem sbt doesn't work for building Spark programs

[jira] [Resolved] (SPARK-1463) cleanup unnecessary dependency jars in the spark assembly jars

[ https://issues.apache.org/jira/browse/SPARK-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1463. -- Resolution: Fixed Fix Version/s: (was: 1.0.0) Fixed at some point, it seems. No longer in

[jira] [Created] (SPARK-4343) Mima considers protected API methods for exclusion from binary checks.

Prashant Sharma created SPARK-4343: -- Summary: Mima considers protected API methods for exclusion from binary checks. Key: SPARK-4343 URL: https://issues.apache.org/jira/browse/SPARK-4343 Project:

[jira] [Commented] (SPARK-4343) Mima considers protected API methods for exclusion from binary checks.

[ https://issues.apache.org/jira/browse/SPARK-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206472#comment-14206472 ] Prashant Sharma commented on SPARK-4343: I am not sure if its a desired behaviour.

[jira] [Commented] (SPARK-4034) get java.lang.NoClassDefFoundError: com/google/common/util/concurrent/ThreadFactoryBuilder in idea

[ https://issues.apache.org/jira/browse/SPARK-4034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206505#comment-14206505 ] Sean Owen commented on SPARK-4034: -- I use IDEA and I have never encountered this. From

[jira] [Commented] (SPARK-1216) Add a OneHotEncoder for handling categorical features

[ https://issues.apache.org/jira/browse/SPARK-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206526#comment-14206526 ] Sean Owen commented on SPARK-1216: -- [~sandyr] This is basically

[jira] [Reopened] (SPARK-3624) Failed to find Spark assembly in /usr/share/spark/lib for RELEASED debian packages

[ https://issues.apache.org/jira/browse/SPARK-3624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-3624: -- I jumped the gun; per Mark's comments this still deserves some resolution. Failed to find Spark assembly

[jira] [Resolved] (SPARK-1830) Deploy failover, Make Persistence engine and LeaderAgent Pluggable.

[ https://issues.apache.org/jira/browse/SPARK-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson resolved SPARK-1830. --- Resolution: Fixed Fix Version/s: (was: 1.2.0) (was: 1.0.1)

[jira] [Created] (SPARK-4344) spark.yarn.user.classpath.first is undocumented

Arun Ahuja created SPARK-4344: - Summary: spark.yarn.user.classpath.first is undocumented Key: SPARK-4344 URL: https://issues.apache.org/jira/browse/SPARK-4344 Project: Spark Issue Type:

[jira] [Commented] (SPARK-4344) spark.yarn.user.classpath.first is undocumented

[ https://issues.apache.org/jira/browse/SPARK-4344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206722#comment-14206722 ] Apache Spark commented on SPARK-4344: - User 'arahuja' has created a pull request for

[jira] [Created] (SPARK-4345) Spark SQL Hive throws exception when drop a none-exist table

Alex Liu created SPARK-4345: --- Summary: Spark SQL Hive throws exception when drop a none-exist table Key: SPARK-4345 URL: https://issues.apache.org/jira/browse/SPARK-4345 Project: Spark Issue

[jira] [Created] (SPARK-4346) YarnClientSchedulerBack.asyncMonitorApplication should be common with Client.monitorApplication

Thomas Graves created SPARK-4346: Summary: YarnClientSchedulerBack.asyncMonitorApplication should be common with Client.monitorApplication Key: SPARK-4346 URL: https://issues.apache.org/jira/browse/SPARK-4346

[jira] [Resolved] (SPARK-4282) Stopping flag in YarnClientSchedulerBackend should be volatile

[ https://issues.apache.org/jira/browse/SPARK-4282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-4282. -- Resolution: Fixed Fix Version/s: 1.3.0 1.2.0 Assignee:

[jira] [Created] (SPARK-4347) GradientBoostingSuite takes more than 1 minute to finish

Xiangrui Meng created SPARK-4347: Summary: GradientBoostingSuite takes more than 1 minute to finish Key: SPARK-4347 URL: https://issues.apache.org/jira/browse/SPARK-4347 Project: Spark Issue

[jira] [Updated] (SPARK-4169) [Core] Locale dependent code

[ https://issues.apache.org/jira/browse/SPARK-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-4169: - Assignee: Niklas Wilcke [Core] Locale dependent code

[jira] [Commented] (SPARK-3682) Add helpful warnings to the UI

[ https://issues.apache.org/jira/browse/SPARK-3682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14206891#comment-14206891 ] Kay Ousterhout commented on SPARK-3682: --- Some of the metrics you mentioned fall

[jira] [Updated] (SPARK-4347) GradientBoostingSuite takes more than 1 minute to finish

[ https://issues.apache.org/jira/browse/SPARK-4347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4347: - Assignee: Manish Amde GradientBoostingSuite takes more than 1 minute to finish

[jira] [Commented] (SPARK-2205) Unnecessary exchange operators in a join on multiple tables with the same join key.

[ https://issues.apache.org/jira/browse/SPARK-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207031#comment-14207031 ] Yin Huai commented on SPARK-2205: - Just a note to myself. It will be good to also look at

[jira] [Commented] (SPARK-4205) Timestamp and Date objects with comparison operators

[ https://issues.apache.org/jira/browse/SPARK-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207037#comment-14207037 ] Apache Spark commented on SPARK-4205: - User 'culler' has created a pull request for

[jira] [Commented] (SPARK-1739) Close PR's after period of inactivity

[ https://issues.apache.org/jira/browse/SPARK-1739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207112#comment-14207112 ] Josh Rosen commented on SPARK-1739: --- My proposal would be to have SparkQA post a comment

[jira] [Commented] (SPARK-4326) unidoc is broken on master

[ https://issues.apache.org/jira/browse/SPARK-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207156#comment-14207156 ] Marcelo Vanzin commented on SPARK-4326: --- Funny that it doesn't happen on 1.2 since

[jira] [Created] (SPARK-4348) pyspark.mllib.random conflicts with random module

Davies Liu created SPARK-4348: - Summary: pyspark.mllib.random conflicts with random module Key: SPARK-4348 URL: https://issues.apache.org/jira/browse/SPARK-4348 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4345) Spark SQL Hive throws exception when drop a none-exist table

[ https://issues.apache.org/jira/browse/SPARK-4345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207171#comment-14207171 ] Alex Liu commented on SPARK-4345: - Swallow NoSuchObjectException exception when drop a

[jira] [Commented] (SPARK-4326) unidoc is broken on master

[ https://issues.apache.org/jira/browse/SPARK-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207177#comment-14207177 ] Nicholas Chammas commented on SPARK-4326: - Side question: Should we be (or are we

[jira] [Created] (SPARK-4349) Spark driver hangs on sc.parallelize() if exception is thrown during serialization

Matt Cheah created SPARK-4349: - Summary: Spark driver hangs on sc.parallelize() if exception is thrown during serialization Key: SPARK-4349 URL: https://issues.apache.org/jira/browse/SPARK-4349 Project:

[jira] [Commented] (SPARK-4349) Spark driver hangs on sc.parallelize() if exception is thrown during serialization

[ https://issues.apache.org/jira/browse/SPARK-4349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207185#comment-14207185 ] Matt Cheah commented on SPARK-4349: --- I'm investigating this now. Someone can assign to

[jira] [Commented] (SPARK-4348) pyspark.mllib.random conflicts with random module

[ https://issues.apache.org/jira/browse/SPARK-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207199#comment-14207199 ] Doris Xin commented on SPARK-4348: -- I fully support this. It took a lot of hacking just

[jira] [Commented] (SPARK-4092) Input metrics don't work for coalesce()'d RDD's

[ https://issues.apache.org/jira/browse/SPARK-4092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207190#comment-14207190 ] Kostas Sakellis commented on SPARK-4092: [~aash], yes this should solve a superset

[jira] [Created] (SPARK-4350) aggregate doesn't make copies of zeroValue in local mode

Xiangrui Meng created SPARK-4350: Summary: aggregate doesn't make copies of zeroValue in local mode Key: SPARK-4350 URL: https://issues.apache.org/jira/browse/SPARK-4350 Project: Spark Issue

[jira] [Closed] (SPARK-2269) Clean up and add unit tests for resourceOffers in MesosSchedulerBackend

[ https://issues.apache.org/jira/browse/SPARK-2269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-2269. Resolution: Fixed Fix Version/s: 1.2.0 Target Version/s: 1.2.0 Clean up and add unit

[jira] [Commented] (SPARK-4228) Save a ScheamRDD in JSON format

[ https://issues.apache.org/jira/browse/SPARK-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207262#comment-14207262 ] Apache Spark commented on SPARK-4228: - User 'dwmclary' has created a pull request for

[jira] [Commented] (SPARK-4228) Save a ScheamRDD in JSON format

[ https://issues.apache.org/jira/browse/SPARK-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207261#comment-14207261 ] Dan McClary commented on SPARK-4228: Pull request here:

[jira] [Commented] (SPARK-3066) Support recommendAll in matrix factorization model

[ https://issues.apache.org/jira/browse/SPARK-3066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207298#comment-14207298 ] Debasish Das commented on SPARK-3066: - [~mengxr] I am testing recommendAllUsers and

[jira] [Resolved] (SPARK-4157) Task input statistics incomplete when a task reads from multiple locations

[ https://issues.apache.org/jira/browse/SPARK-4157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Reiss resolved SPARK-4157. -- Resolution: Duplicate Task input statistics incomplete when a task reads from multiple

[jira] [Commented] (SPARK-4349) Spark driver hangs on sc.parallelize() if exception is thrown during serialization

[ https://issues.apache.org/jira/browse/SPARK-4349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207392#comment-14207392 ] Matt Cheah commented on SPARK-4349: --- Investigation showed that the DAGScheduler may not

[jira] [Updated] (SPARK-4322) Analysis incorrectly rejects accessing grouping fields

[ https://issues.apache.org/jira/browse/SPARK-4322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-4322: Assignee: Cheng Lian Analysis incorrectly rejects accessing grouping fields

[jira] [Updated] (SPARK-4258) NPE with new Parquet Filters

[ https://issues.apache.org/jira/browse/SPARK-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-4258: Assignee: Cheng Lian NPE with new Parquet Filters

[jira] [Commented] (SPARK-4347) GradientBoostingSuite takes more than 1 minute to finish

[ https://issues.apache.org/jira/browse/SPARK-4347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207435#comment-14207435 ] Apache Spark commented on SPARK-4347: - User 'manishamde' has created a pull request

[jira] [Created] (SPARK-4351) Record cacheable RDD reads and display RDD miss rates

Charles Reiss created SPARK-4351: Summary: Record cacheable RDD reads and display RDD miss rates Key: SPARK-4351 URL: https://issues.apache.org/jira/browse/SPARK-4351 Project: Spark Issue

[jira] [Commented] (SPARK-4338) Remove yarn-alpha support

[ https://issues.apache.org/jira/browse/SPARK-4338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207450#comment-14207450 ] Apache Spark commented on SPARK-4338: - User 'sryza' has created a pull request for

[jira] [Created] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

Sandy Ryza created SPARK-4352: - Summary: Incorporate locality preferences in dynamic allocation requests Key: SPARK-4352 URL: https://issues.apache.org/jira/browse/SPARK-4352 Project: Spark

[jira] [Commented] (SPARK-2429) Hierarchical Implementation of KMeans

[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207463#comment-14207463 ] Yu Ishikawa commented on SPARK-2429: [~rnowling] Sorry for commenting again. Could you

[jira] [Commented] (SPARK-4348) pyspark.mllib.random conflicts with random module

[ https://issues.apache.org/jira/browse/SPARK-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207511#comment-14207511 ] Apache Spark commented on SPARK-4348: - User 'davies' has created a pull request for

[jira] [Commented] (SPARK-4348) pyspark.mllib.random conflicts with random module

[ https://issues.apache.org/jira/browse/SPARK-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207529#comment-14207529 ] Davies Liu commented on SPARK-4348: --- After some experiments, I found it's more harder

[jira] [Commented] (SPARK-4038) Outlier Detection Algorithm for MLlib

[ https://issues.apache.org/jira/browse/SPARK-4038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207550#comment-14207550 ] Ashutosh Trivedi commented on SPARK-4038: - similar issue was opened at Mahout

[jira] [Created] (SPARK-4353) Delete the val that never used

DoingDone9 created SPARK-4353: - Summary: Delete the val that never used Key: SPARK-4353 URL: https://issues.apache.org/jira/browse/SPARK-4353 Project: Spark Issue Type: Wish

[jira] [Updated] (SPARK-4353) Delete the val that never used

[ https://issues.apache.org/jira/browse/SPARK-4353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-4353: -- Issue Type: Improvement (was: Wish) Delete the val that never used --

[jira] [Updated] (SPARK-4353) Delete the val that never used

[ https://issues.apache.org/jira/browse/SPARK-4353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-4353: -- Component/s: SQL Delete the val that never used -- Key:

[jira] [Updated] (SPARK-4353) Delete the val that never used

[ https://issues.apache.org/jira/browse/SPARK-4353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DoingDone9 updated SPARK-4353: -- Description: dbName in Catalog never used, like that val (dbName, tblName) =

[jira] [Commented] (SPARK-4351) Record cacheable RDD reads and display RDD miss rates

[ https://issues.apache.org/jira/browse/SPARK-4351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207566#comment-14207566 ] Apache Spark commented on SPARK-4351: - User 'woggle' has created a pull request for

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14207568#comment-14207568 ] Ryan Williams commented on SPARK-3630: -- I'm seeing many Snappy

  1   2   >