[jira] [Commented] (SPARK-6884) Random forest: predict class probabilities

[ https://issues.apache.org/jira/browse/SPARK-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646014#comment-14646014 ] Max Kaznady commented on SPARK-6884: Thanks, this is a better way going forward. > Ra

[jira] [Created] (SPARK-9436) Merge joins in Pregel

Alexander Ulanov created SPARK-9436: --- Summary: Merge joins in Pregel Key: SPARK-9436 URL: https://issues.apache.org/jira/browse/SPARK-9436 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-9434) Need how-to for resuming direct Kafka streaming consumers where they had left off before getting terminated, OR actual support for that mode in the Streaming API

[ https://issues.apache.org/jira/browse/SPARK-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646011#comment-14646011 ] Sean Owen commented on SPARK-9434: -- Yes, I mean "direct stream". While I don't think you

[jira] [Commented] (SPARK-6884) Random forest: predict class probabilities

[ https://issues.apache.org/jira/browse/SPARK-6884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646013#comment-14646013 ] Max Kaznady commented on SPARK-6884: Sorry, I've been trying to setup a work environme

[jira] [Commented] (SPARK-8786) Create a wrapper for BinaryType

[ https://issues.apache.org/jira/browse/SPARK-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645999#comment-14645999 ] Takeshi Yamamuro commented on SPARK-8786: - Right now, spark can correctly handle b

[jira] [Comment Edited] (SPARK-9434) Need how-to for resuming direct Kafka streaming consumers where they had left off before getting terminated, OR actual support for that mode in the Streaming API

[ https://issues.apache.org/jira/browse/SPARK-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645992#comment-14645992 ] Dmitry Goldenberg edited comment on SPARK-9434 at 7/29/15 12:50 PM:

[jira] [Commented] (SPARK-9434) Need how-to for resuming direct Kafka streaming consumers where they had left off before getting terminated, OR actual support for that mode in the Streaming API

[ https://issues.apache.org/jira/browse/SPARK-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645992#comment-14645992 ] Dmitry Goldenberg commented on SPARK-9434: -- @Sean Owen: Per your point about plac

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645988#comment-14645988 ] Thomas Graves commented on SPARK-4352: -- thanks, its definitely better to have it auto

[jira] [Commented] (SPARK-4557) Spark Streaming' foreachRDD method should accept a VoidFunction<...>, not a Function<..., Void>

[ https://issues.apache.org/jira/browse/SPARK-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645983#comment-14645983 ] somil deshmukh commented on SPARK-4557: --- I have made changes in JavaDStreamLike.scal

[jira] [Comment Edited] (SPARK-9434) Need how-to for resuming direct Kafka streaming consumers where they had left off before getting terminated, OR actual support for that mode in the Streaming API

[ https://issues.apache.org/jira/browse/SPARK-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645971#comment-14645971 ] Dmitry Goldenberg edited comment on SPARK-9434 at 7/29/15 12:30 PM:

[jira] [Comment Edited] (SPARK-9434) Need how-to for resuming direct Kafka streaming consumers where they had left off before getting terminated, OR actual support for that mode in the Streaming API

[ https://issues.apache.org/jira/browse/SPARK-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645971#comment-14645971 ] Dmitry Goldenberg edited comment on SPARK-9434 at 7/29/15 12:30 PM:

[jira] [Commented] (SPARK-9434) Need how-to for resuming direct Kafka streaming consumers where they had left off before getting terminated, OR actual support for that mode in the Streaming API

[ https://issues.apache.org/jira/browse/SPARK-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645971#comment-14645971 ] Dmitry Goldenberg commented on SPARK-9434: -- [~tdas]: Could you weigh in on this d

[jira] [Created] (SPARK-9435) Java UDFs don't work with GROUP BY expressions

James Aley created SPARK-9435: - Summary: Java UDFs don't work with GROUP BY expressions Key: SPARK-9435 URL: https://issues.apache.org/jira/browse/SPARK-9435 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-9435) Java UDFs don't work with GROUP BY expressions

[ https://issues.apache.org/jira/browse/SPARK-9435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Aley updated SPARK-9435: -- Attachment: points.txt IncMain.java Attaching minimal reproduction code. > Java UDFs do

[jira] [Commented] (SPARK-9434) Need how-to for resuming direct Kafka streaming consumers where they had left off before getting terminated, OR actual support for that mode in the Streaming API

[ https://issues.apache.org/jira/browse/SPARK-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645965#comment-14645965 ] Dmitry Goldenberg commented on SPARK-9434: -- [~sowen]: Putting this here was the o

[jira] [Commented] (SPARK-9434) Need how-to for resuming direct Kafka streaming consumers where they had left off before getting terminated, OR actual support for that mode in the Streaming API

[ https://issues.apache.org/jira/browse/SPARK-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645952#comment-14645952 ] Sean Owen commented on SPARK-9434: -- [~dgoldenberg] Discussion is good; I'm asking you to

[jira] [Comment Edited] (SPARK-1239) Don't fetch all map output statuses at each reducer during shuffles

[ https://issues.apache.org/jira/browse/SPARK-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645913#comment-14645913 ] Alex Slusarenko edited comment on SPARK-1239 at 7/29/15 12:00 PM: --

[jira] [Commented] (SPARK-9434) Need how-to for resuming direct Kafka streaming consumers where they had left off before getting terminated, OR actual support for that mode in the Streaming API

[ https://issues.apache.org/jira/browse/SPARK-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645923#comment-14645923 ] Dmitry Goldenberg commented on SPARK-9434: -- Sean, I specifically did not want to

[jira] [Reopened] (SPARK-9434) Need how-to for resuming direct Kafka streaming consumers where they had left off before getting terminated, OR actual support for that mode in the Streaming API

[ https://issues.apache.org/jira/browse/SPARK-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitry Goldenberg reopened SPARK-9434: -- Not resolved. > Need how-to for resuming direct Kafka streaming consumers where they had le

[jira] [Updated] (SPARK-572) Forbid update of static mutable variables

[ https://issues.apache.org/jira/browse/SPARK-572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Francke updated SPARK-572: --- Description: Consider the following piece of code: {code} object Foo { var xx = -1 def main() { x

[jira] [Commented] (SPARK-650) Add a "setup hook" API for running initialization code on each executor

[ https://issues.apache.org/jira/browse/SPARK-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645919#comment-14645919 ] Lars Francke commented on SPARK-650: Not [~matei] but I think this would be a good idea

[jira] [Commented] (SPARK-3862) MultiWayBroadcastInnerHashJoin

[ https://issues.apache.org/jira/browse/SPARK-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645915#comment-14645915 ] David Sabater commented on SPARK-3862: -- This may sound too extreme but it will be gre

[jira] [Comment Edited] (SPARK-1239) Don't fetch all map output statuses at each reducer during shuffles

[ https://issues.apache.org/jira/browse/SPARK-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645913#comment-14645913 ] Alex Slusarenko edited comment on SPARK-1239 at 7/29/15 11:50 AM: --

[jira] [Commented] (SPARK-1239) Don't fetch all map output statuses at each reducer during shuffles

[ https://issues.apache.org/jira/browse/SPARK-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645913#comment-14645913 ] Alex Slusarenko commented on SPARK-1239: Hi, all. We have faced this issue many ti

[jira] [Resolved] (SPARK-9434) Need how-to for resuming direct Kafka streaming consumers where they had left off before getting terminated, OR actual support for that mode in the Streaming API

[ https://issues.apache.org/jira/browse/SPARK-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9434. -- Resolution: Duplicate I think this is a duplicate of SPARK-6249 as you note -- please add your comment

[jira] [Created] (SPARK-9434) Need how-to for resuming direct Kafka streaming consumers where they had left off before getting terminated, OR actual support for that mode in the Streaming API

Dmitry Goldenberg created SPARK-9434: Summary: Need how-to for resuming direct Kafka streaming consumers where they had left off before getting terminated, OR actual support for that mode in the Streaming API Key: SPARK-9434

[jira] [Resolved] (SPARK-9253) Allow to create machines with different AWS credentials than will be used for accessing the S3

[ https://issues.apache.org/jira/browse/SPARK-9253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9253. -- Resolution: Won't Fix > Allow to create machines with different AWS credentials than will be used for >

[jira] [Commented] (SPARK-8786) Create a wrapper for BinaryType

[ https://issues.apache.org/jira/browse/SPARK-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645697#comment-14645697 ] James Aley commented on SPARK-8786: --- Will this change mean that joins, distinct, equalit

[jira] [Assigned] (SPARK-9428) Add test cases for null inputs for expression unit tests

[ https://issues.apache.org/jira/browse/SPARK-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9428: --- Assignee: Apache Spark (was: Yijie Shen) > Add test cases for null inputs for expression uni

[jira] [Assigned] (SPARK-9428) Add test cases for null inputs for expression unit tests

[ https://issues.apache.org/jira/browse/SPARK-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9428: --- Assignee: Yijie Shen (was: Apache Spark) > Add test cases for null inputs for expression uni

[jira] [Commented] (SPARK-9428) Add test cases for null inputs for expression unit tests

[ https://issues.apache.org/jira/browse/SPARK-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645669#comment-14645669 ] Apache Spark commented on SPARK-9428: - User 'yjshen' has created a pull request for th

[jira] [Closed] (SPARK-9374) unix_timestamp throws AnalysisException

[ https://issues.apache.org/jira/browse/SPARK-9374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-9374. -- Resolution: Duplicate Marking this as closed since it duplicates SPARK-8174, which we will include in 1

[jira] [Updated] (SPARK-8174) date/time function: unix_timestamp

[ https://issues.apache.org/jira/browse/SPARK-8174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8174: --- Priority: Blocker (was: Major) > date/time function: unix_timestamp > ---

[jira] [Assigned] (SPARK-9127) Rand/Randn codegen fails with long seed

[ https://issues.apache.org/jira/browse/SPARK-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-9127: -- Assignee: Reynold Xin (was: Wenchen Fan) > Rand/Randn codegen fails with long seed > -

[jira] [Created] (SPARK-9433) Audit expression unit tests to test for non-foldable codegen path

Reynold Xin created SPARK-9433: -- Summary: Audit expression unit tests to test for non-foldable codegen path Key: SPARK-9433 URL: https://issues.apache.org/jira/browse/SPARK-9433 Project: Spark

[jira] [Resolved] (SPARK-8768) SparkSubmitSuite fails on Hadoop 1.x builds due to java.lang.VerifyError in Akka Protobuf

[ https://issues.apache.org/jira/browse/SPARK-8768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8768. --- Resolution: Fixed This was fixed by the Maven download changes in SPARK-8933 > SparkSubmitSuite fails

[jira] [Updated] (SPARK-8505) Add settings to kick `lint-r` from `./dev/run-test.py`

[ https://issues.apache.org/jira/browse/SPARK-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8505: -- Target Version/s: (was: 1.5.0) > Add settings to kick `lint-r` from `./dev/run-test.py` >

[jira] [Updated] (SPARK-9428) Add test cases for null inputs for expression unit tests

[ https://issues.apache.org/jira/browse/SPARK-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9428: --- Description: We need to audit expression unit tests to make sure we pass in null inputs to test null b

[jira] [Updated] (SPARK-9428) Add test cases for null inputs for expression unit tests

[ https://issues.apache.org/jira/browse/SPARK-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9428: --- Summary: Add test cases for null inputs for expression unit tests (was: Add unit test for null inputs

[jira] [Updated] (SPARK-7721) Generate test coverage report from Python

[ https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7721: -- Target Version/s: (was: 1.5.0) > Generate test coverage report from Python > -

[jira] [Updated] (SPARK-9428) Add test cases for null inputs for expression unit tests

[ https://issues.apache.org/jira/browse/SPARK-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9428: --- Priority: Blocker (was: Major) > Add test cases for null inputs for expression unit tests > -

[jira] [Updated] (SPARK-2004) Automate QA of Spark Build/Deploy Matrix

[ https://issues.apache.org/jira/browse/SPARK-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-2004: -- Target Version/s: (was: 1.5.0) > Automate QA of Spark Build/Deploy Matrix > --

[jira] [Updated] (SPARK-9428) Add test cases for null inputs for expression unit tests

[ https://issues.apache.org/jira/browse/SPARK-9428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9428: --- Assignee: Yijie Shen > Add test cases for null inputs for expression unit tests >

[jira] [Created] (SPARK-9432) Audit expression unit tests to make sure we pass the proper numeric ranges

Reynold Xin created SPARK-9432: -- Summary: Audit expression unit tests to make sure we pass the proper numeric ranges Key: SPARK-9432 URL: https://issues.apache.org/jira/browse/SPARK-9432 Project: Spark

[jira] [Updated] (SPARK-7019) Build docs on doc changes

[ https://issues.apache.org/jira/browse/SPARK-7019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7019: -- Target Version/s: (was: 1.5.0) > Build docs on doc changes > - > >

[jira] [Updated] (SPARK-8725) Test modules in topological order in dev/run-tests and python/run-tests

[ https://issues.apache.org/jira/browse/SPARK-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8725: -- Target Version/s: (was: 1.5.0) > Test modules in topological order in dev/run-tests and python/run-tes

[jira] [Updated] (SPARK-7448) Implement custom bye array serializer for use in PySpark shuffle

[ https://issues.apache.org/jira/browse/SPARK-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7448: -- Target Version/s: (was: 1.5.0) > Implement custom bye array serializer for use in PySpark shuffle > --

[jira] [Updated] (SPARK-6218) Upgrade spark-ec2 from optparse to argparse

[ https://issues.apache.org/jira/browse/SPARK-6218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-6218: -- Target Version/s: (was: 1.5.0) > Upgrade spark-ec2 from optparse to argparse > ---

[jira] [Updated] (SPARK-7021) JUnit output for Python tests

[ https://issues.apache.org/jira/browse/SPARK-7021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7021: -- Target Version/s: (was: 1.5.0) > JUnit output for Python tests > - > >

[jira] [Updated] (SPARK-8569) Documentation for SPARK_HISTORY_OPTS unclear

[ https://issues.apache.org/jira/browse/SPARK-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8569: -- Target Version/s: (was: 1.5.0) > Documentation for SPARK_HISTORY_OPTS unclear > --

[jira] [Updated] (SPARK-5971) Add Mesos support to spark-ec2

[ https://issues.apache.org/jira/browse/SPARK-5971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5971: -- Target Version/s: (was: 1.5.0) > Add Mesos support to spark-ec2 > -- > >

[jira] [Commented] (SPARK-6484) Ganglia metrics xml reporter doesn't escape correctly

[ https://issues.apache.org/jira/browse/SPARK-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645630#comment-14645630 ] Josh Rosen commented on SPARK-6484: --- IIRC this may have been fixed by a metrics version

[jira] [Updated] (SPARK-8829) Improve expression performance

[ https://issues.apache.org/jira/browse/SPARK-8829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8829: --- Target Version/s: 1.6.0 > Improve expression performance > -- > >

[jira] [Updated] (SPARK-9403) Implement code generation for In / InSet

[ https://issues.apache.org/jira/browse/SPARK-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9403: --- Description: In expression doesn't have any code generation. Would be great to code gen those. Note th

[jira] [Resolved] (SPARK-8732) Compilation warning for existentials code

[ https://issues.apache.org/jira/browse/SPARK-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8732. -- Resolution: Not A Problem > Compilation warning for existentials code >

[jira] [Commented] (SPARK-9277) SparseVector constructor must throw an error when declared number of elements less than array length

[ https://issues.apache.org/jira/browse/SPARK-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645629#comment-14645629 ] Sean Owen commented on SPARK-9277: -- [~MechCoder] Are you working on this? > SparseVector

[jira] [Updated] (SPARK-5787) Protect JVM from some not-important exceptions

[ https://issues.apache.org/jira/browse/SPARK-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5787: --- Target Version/s: 1.6.0 (was: 1.5.0) > Protect JVM from some not-important exceptions > -

[jira] [Comment Edited] (SPARK-6028) Provide an alternative RPC implementation based on the network transport module

[ https://issues.apache.org/jira/browse/SPARK-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14637472#comment-14637472 ] Reynold Xin edited comment on SPARK-6028 at 7/29/15 7:35 AM: -

[jira] [Updated] (SPARK-6028) Provide an alternative RPC implementation based on the network transport module

[ https://issues.apache.org/jira/browse/SPARK-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6028: --- Assignee: Shixiong Zhu > Provide an alternative RPC implementation based on the network transport > m

[jira] [Commented] (SPARK-6319) DISTINCT doesn't work for binary type

[ https://issues.apache.org/jira/browse/SPARK-6319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645628#comment-14645628 ] Liang-Chi Hsieh commented on SPARK-6319: [~joshrosen] I will do it later. Thanks.

[jira] [Updated] (SPARK-6028) Provide an alternative RPC implementation based on the network transport module

[ https://issues.apache.org/jira/browse/SPARK-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6028: --- Target Version/s: 1.6.0 (was: 1.5.0) > Provide an alternative RPC implementation based on the network

[jira] [Commented] (SPARK-9218) Falls back to getAllPartitions when getPartitionsByFilter fails

[ https://issues.apache.org/jira/browse/SPARK-9218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645627#comment-14645627 ] Josh Rosen commented on SPARK-9218: --- Does this still need to be done for 1.5.0? > Falls

[jira] [Updated] (SPARK-9239) HiveUDAF support for AggregateFunction2

[ https://issues.apache.org/jira/browse/SPARK-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9239: --- Target Version/s: 1.6.0 (was: 1.5.0) > HiveUDAF support for AggregateFunction2 >

[jira] [Updated] (SPARK-9413) Support MapType in Tungsten

[ https://issues.apache.org/jira/browse/SPARK-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9413: --- Priority: Major (was: Critical) > Support MapType in Tungsten > --- > >

[jira] [Updated] (SPARK-9412) Support records larger than a page size

[ https://issues.apache.org/jira/browse/SPARK-9412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9412: --- Priority: Blocker (was: Critical) > Support records larger than a page size > ---

[jira] [Assigned] (SPARK-9127) Rand/Randn codegen fails with long seed

[ https://issues.apache.org/jira/browse/SPARK-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9127: --- Assignee: Apache Spark (was: Wenchen Fan) > Rand/Randn codegen fails with long seed > --

[jira] [Assigned] (SPARK-9127) Rand/Randn codegen fails with long seed

[ https://issues.apache.org/jira/browse/SPARK-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9127: --- Assignee: Wenchen Fan (was: Apache Spark) > Rand/Randn codegen fails with long seed > --

[jira] [Commented] (SPARK-9127) Rand/Randn codegen fails with long seed

[ https://issues.apache.org/jira/browse/SPARK-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645623#comment-14645623 ] Apache Spark commented on SPARK-9127: - User 'rxin' has created a pull request for this

[jira] [Updated] (SPARK-9127) Rand/Randn codegen fails with long seed

[ https://issues.apache.org/jira/browse/SPARK-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9127: --- Summary: Rand/Randn codegen fails with long seed (was: Codegen of Random may fail to compile with lon

[jira] [Updated] (SPARK-9127) Codegen of Random may fail to compile with long seed

[ https://issues.apache.org/jira/browse/SPARK-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9127: --- Summary: Codegen of Random may fail to compile with long seed (was: Codegen of Random may fail to com

[jira] [Commented] (SPARK-9127) Codegen of Random may fail to compile

[ https://issues.apache.org/jira/browse/SPARK-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645621#comment-14645621 ] Reynold Xin commented on SPARK-9127: I'm going to fix this. > Codegen of Random may

[jira] [Updated] (SPARK-9127) Codegen of Random may fail to compile

[ https://issues.apache.org/jira/browse/SPARK-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9127: --- Priority: Blocker (was: Critical) > Codegen of Random may fail to compile > -

[jira] [Commented] (SPARK-8118) Turn off noisy log output produced by Parquet 1.7.0

[ https://issues.apache.org/jira/browse/SPARK-8118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645613#comment-14645613 ] Josh Rosen commented on SPARK-8118: --- Was this fixed by Parquet 1.7.0? > Turn off noisy

[jira] [Closed] (SPARK-6759) Do not borrow/release a kryo instance for every value in a complex type value when doing serialization/deserialization in in-memory columnar store

[ https://issues.apache.org/jira/browse/SPARK-6759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-6759. -- Resolution: Won't Fix Marking this as won't fix for now -- since maybe the solution is to replace the e

[jira] [Updated] (SPARK-3665) Java API for GraphX

[ https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-3665: -- Target Version/s: 1.6.0 (was: 1.5.0) > Java API for GraphX > --- > > Ke

[jira] [Commented] (SPARK-3665) Java API for GraphX

[ https://issues.apache.org/jira/browse/SPARK-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645605#comment-14645605 ] Josh Rosen commented on SPARK-3665: --- I'm going to retarget this to 1.6.0. > Java API fo

[jira] [Updated] (SPARK-8414) Ensure ContextCleaner actually triggers clean ups

[ https://issues.apache.org/jira/browse/SPARK-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8414: -- Summary: Ensure ContextCleaner actually triggers clean ups (was: Ensure ClosureCleaner actually trigger

[jira] [Updated] (SPARK-8414) Ensure ClosureCleaner actually triggers clean ups

[ https://issues.apache.org/jira/browse/SPARK-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8414: -- Priority: Critical (was: Major) > Ensure ClosureCleaner actually triggers clean ups > -

[jira] [Commented] (SPARK-8414) Ensure ClosureCleaner actually triggers clean ups

[ https://issues.apache.org/jira/browse/SPARK-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645598#comment-14645598 ] Josh Rosen commented on SPARK-8414: --- I think the title here should refer to ContextClean

[jira] [Assigned] (SPARK-7165) Sort Merge Join for outer joins

[ https://issues.apache.org/jira/browse/SPARK-7165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-7165: -- Assignee: Reynold Xin > Sort Merge Join for outer joins > --- > >

[jira] [Updated] (SPARK-8108) Build Hive module by default (i.e. remove -Phive profile)

[ https://issues.apache.org/jira/browse/SPARK-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8108: --- Target Version/s: 1.6.0 (was: 1.5.0) > Build Hive module by default (i.e. remove -Phive profile) > --

[jira] [Updated] (SPARK-5517) Add input types for Java UDFs

[ https://issues.apache.org/jira/browse/SPARK-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5517: --- Priority: Critical (was: Blocker) > Add input types for Java UDFs > - > >

[jira] [Updated] (SPARK-5180) Data source API improvement

[ https://issues.apache.org/jira/browse/SPARK-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5180: --- Target Version/s: 1.6.0 (was: 1.5.0) > Data source API improvement > --- > >

[jira] [Updated] (SPARK-5517) Add input types for Java UDFs

[ https://issues.apache.org/jira/browse/SPARK-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-5517: --- Target Version/s: 1.6.0 (was: 1.5.0) > Add input types for Java UDFs > -

[jira] [Resolved] (SPARK-5048) Add Flume to the Python Streaming API

[ https://issues.apache.org/jira/browse/SPARK-5048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5048. --- Resolution: Duplicate Assignee: (was: Hari Shreedharan) Fix Version/s: 1.5.0 Resol

[jira] [Updated] (SPARK-6116) DataFrame API improvement umbrella ticket

[ https://issues.apache.org/jira/browse/SPARK-6116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6116: --- Target Version/s: 1.6.0 (was: 1.5.0) > DataFrame API improvement umbrella ticket > --

[jira] [Updated] (SPARK-9251) do not order by expressions which still need evaluation

[ https://issues.apache.org/jira/browse/SPARK-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9251: --- Issue Type: Improvement (was: Bug) > do not order by expressions which still need evaluation > --

[jira] [Resolved] (SPARK-9251) do not order by expressions which still need evaluation

[ https://issues.apache.org/jira/browse/SPARK-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9251. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 > do not order by expre

[jira] [Updated] (SPARK-9352) Add tests for standalone scheduling code

[ https://issues.apache.org/jira/browse/SPARK-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9352: -- Labels: backport-needed (was: ) > Add tests for standalone scheduling code > --

[jira] [Commented] (SPARK-9352) Add tests for standalone scheduling code

[ https://issues.apache.org/jira/browse/SPARK-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645589#comment-14645589 ] Josh Rosen commented on SPARK-9352: --- Added the 'backport-needed' label so that it's easi

[jira] [Updated] (SPARK-9308) ml.NaiveBayesModel support predicting class probabilities

[ https://issues.apache.org/jira/browse/SPARK-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9308: - Assignee: Yanbo Liang > ml.NaiveBayesModel support predicting class probabilities > --

[jira] [Commented] (SPARK-6319) DISTINCT doesn't work for binary type

[ https://issues.apache.org/jira/browse/SPARK-6319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645588#comment-14645588 ] Josh Rosen commented on SPARK-6319: --- I think it would be nice to add this AnalysisExcept

[jira] [Updated] (SPARK-9308) ml.NaiveBayesModel support predicting class probabilities

[ https://issues.apache.org/jira/browse/SPARK-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9308: - Shepherd: Joseph K. Bradley Target Version/s: 1.5.0 > ml.NaiveBayesModel suppo

[jira] [Commented] (SPARK-9408) Refactor mllib/linalg.py to mllib/linalg

[ https://issues.apache.org/jira/browse/SPARK-9408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645587#comment-14645587 ] Apache Spark commented on SPARK-9408: - User 'mengxr' has created a pull request for th

[jira] [Assigned] (SPARK-9430) Rename IntervalType to CalendarInterval

[ https://issues.apache.org/jira/browse/SPARK-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-9430: -- Assignee: Reynold Xin > Rename IntervalType to CalendarInterval > -

[jira] [Assigned] (SPARK-8943) CalendarIntervalType for time intervals

[ https://issues.apache.org/jira/browse/SPARK-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-8943: -- Assignee: Reynold Xin > CalendarIntervalType for time intervals > -

<    1   2   3   4