[jira] [Commented] (SPARK-12199) Follow-up: Refine example code in ml-features.md

[ https://issues.apache.org/jira/browse/SPARK-12199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046557#comment-15046557 ] Apache Spark commented on SPARK-12199: -- User 'yinxusen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12199) Follow-up: Refine example code in ml-features.md

[ https://issues.apache.org/jira/browse/SPARK-12199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12199: Assignee: somil deshmukh (was: Apache Spark) > Follow-up: Refine example code in

[jira] [Assigned] (SPARK-12199) Follow-up: Refine example code in ml-features.md

[ https://issues.apache.org/jira/browse/SPARK-12199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12199: Assignee: Apache Spark (was: somil deshmukh) > Follow-up: Refine example code in

[jira] [Commented] (SPARK-6982) Data Frame and Spark SQL should allow filtering on key portion of incremental parquet files

[ https://issues.apache.org/jira/browse/SPARK-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046556#comment-15046556 ] Hyukjin Kwon commented on SPARK-6982: - Would this be done now by partition key [partition

[jira] [Resolved] (SPARK-12193) Spark-Submit from node.js and call the process

[ https://issues.apache.org/jira/browse/SPARK-12193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12193. --- Resolution: Invalid Target Version/s: (was: 1.3.1) Questions go to

[jira] [Updated] (SPARK-12200) pyspark.sql.types.Row should implement __contains__

[ https://issues.apache.org/jira/browse/SPARK-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-12200: --- Component/s: PySpark > pyspark.sql.types.Row should implement __contains__ >

[jira] [Commented] (SPARK-11652) Remote code execution with InvokerTransformer

[ https://issues.apache.org/jira/browse/SPARK-11652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046619#comment-15046619 ] meiyoula commented on SPARK-11652: -- [~darabos] Can you have a look on the patch merged by owen, I think

[jira] [Resolved] (SPARK-11928) Master retry deadlock

[ https://issues.apache.org/jira/browse/SPARK-11928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11928. --- Resolution: Cannot Reproduce > Master retry deadlock > - > >

[jira] [Resolved] (SPARK-12190) spark does not start cleanly windows 7 64 bit

[ https://issues.apache.org/jira/browse/SPARK-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12190. --- Resolution: Duplicate Please search JIRA first; plenty of comment about /tmp/hive > spark does not

[jira] [Resolved] (SPARK-11487) Spark Master shutdown automatically after some applications execution

[ https://issues.apache.org/jira/browse/SPARK-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11487. --- Resolution: Not A Problem > Spark Master shutdown automatically after some applications execution >

[jira] [Assigned] (SPARK-12200) pyspark.sql.types.Row should implement __contains__

[ https://issues.apache.org/jira/browse/SPARK-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12200: Assignee: Apache Spark > pyspark.sql.types.Row should implement __contains__ >

[jira] [Assigned] (SPARK-12201) add type coercion rule for greatest/least

[ https://issues.apache.org/jira/browse/SPARK-12201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12201: Assignee: (was: Apache Spark) > add type coercion rule for greatest/least >

[jira] [Commented] (SPARK-12201) add type coercion rule for greatest/least

[ https://issues.apache.org/jira/browse/SPARK-12201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046611#comment-15046611 ] Apache Spark commented on SPARK-12201: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-12202) Pass additional Scala REPL options to the underlying REPL

Iulian Dragos created SPARK-12202: - Summary: Pass additional Scala REPL options to the underlying REPL Key: SPARK-12202 URL: https://issues.apache.org/jira/browse/SPARK-12202 Project: Spark

[jira] [Updated] (SPARK-12146) SparkR jsonFile should support multiple input files

[ https://issues.apache.org/jira/browse/SPARK-12146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12146: Issue Type: Sub-task (was: Bug) Parent: SPARK-12144 > SparkR jsonFile should support

[jira] [Commented] (SPARK-12045) Use joda's DateTime to replace Calendar

[ https://issues.apache.org/jira/browse/SPARK-12045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046631#comment-15046631 ] Sean Owen commented on SPARK-12045: --- I'm generally pretty negative on punting on semantics questions

[jira] [Commented] (SPARK-6918) Secure HBase with Kerberos does not work over YARN

[ https://issues.apache.org/jira/browse/SPARK-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046606#comment-15046606 ] mark vervuurt commented on SPARK-6918: -- I am also doubting wether this issue has been resolved we are

[jira] [Assigned] (SPARK-12201) add type coercion rule for greatest/least

[ https://issues.apache.org/jira/browse/SPARK-12201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12201: Assignee: Apache Spark > add type coercion rule for greatest/least >

[jira] [Assigned] (SPARK-12200) pyspark.sql.types.Row should implement __contains__

[ https://issues.apache.org/jira/browse/SPARK-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12200: Assignee: (was: Apache Spark) > pyspark.sql.types.Row should implement __contains__ >

[jira] [Commented] (SPARK-12200) pyspark.sql.types.Row should implement __contains__

[ https://issues.apache.org/jira/browse/SPARK-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046566#comment-15046566 ] Apache Spark commented on SPARK-12200: -- User 'maver1ck' has created a pull request for this issue:

[jira] [Resolved] (SPARK-12192) recommendProductsForUsers(num: Int) can run OK when the dataset is small,but run wrong when large amount of data

[ https://issues.apache.org/jira/browse/SPARK-12192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12192. --- Resolution: Not A Problem The error shows you that something in your code is attempting to write to

[jira] [Comment Edited] (SPARK-6982) Data Frame and Spark SQL should allow filtering on key portion of incremental parquet files

[ https://issues.apache.org/jira/browse/SPARK-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046556#comment-15046556 ] Hyukjin Kwon edited comment on SPARK-6982 at 12/8/15 8:15 AM: -- Would this be

[jira] [Comment Edited] (SPARK-6982) Data Frame and Spark SQL should allow filtering on key portion of incremental parquet files

[ https://issues.apache.org/jira/browse/SPARK-6982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046556#comment-15046556 ] Hyukjin Kwon edited comment on SPARK-6982 at 12/8/15 8:15 AM: -- Would this be

[jira] [Created] (SPARK-12200) pyspark.sql.types.Row should implement __contains__

Maciej Bryński created SPARK-12200: -- Summary: pyspark.sql.types.Row should implement __contains__ Key: SPARK-12200 URL: https://issues.apache.org/jira/browse/SPARK-12200 Project: Spark

[jira] [Assigned] (SPARK-10123) Cannot set "--deploy-mode" in default configuration

[ https://issues.apache.org/jira/browse/SPARK-10123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10123: Assignee: (was: Apache Spark) > Cannot set "--deploy-mode" in default configuration >

[jira] [Assigned] (SPARK-10123) Cannot set "--deploy-mode" in default configuration

[ https://issues.apache.org/jira/browse/SPARK-10123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10123: Assignee: Apache Spark > Cannot set "--deploy-mode" in default configuration >

[jira] [Commented] (SPARK-12178) Expose reporting of StreamInputInfo for custom made streams

[ https://issues.apache.org/jira/browse/SPARK-12178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046602#comment-15046602 ] Saisai Shao commented on SPARK-12178: - This is a good idea to make it generic if there's more direct

[jira] [Created] (SPARK-12201) add type coercion rule for greatest/least

Wenchen Fan created SPARK-12201: --- Summary: add type coercion rule for greatest/least Key: SPARK-12201 URL: https://issues.apache.org/jira/browse/SPARK-12201 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-12203) Add KafkaDirectInputDStream that directly pulls messages from Kafka Brokers using receivers

Liang-Chi Hsieh created SPARK-12203: --- Summary: Add KafkaDirectInputDStream that directly pulls messages from Kafka Brokers using receivers Key: SPARK-12203 URL: https://issues.apache.org/jira/browse/SPARK-12203

[jira] [Assigned] (SPARK-12202) Pass additional Scala REPL options to the underlying REPL (2.11)

[ https://issues.apache.org/jira/browse/SPARK-12202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12202: Assignee: (was: Apache Spark) > Pass additional Scala REPL options to the underlying

[jira] [Commented] (SPARK-12202) Pass additional Scala REPL options to the underlying REPL (2.11)

[ https://issues.apache.org/jira/browse/SPARK-12202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046752#comment-15046752 ] Apache Spark commented on SPARK-12202: -- User 'dragos' has created a pull request for this issue:

[jira] [Resolved] (SPARK-11439) Optimization of creating sparse feature without dense one

[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11439. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9756

[jira] [Resolved] (SPARK-12137) Spark Streaming State Recovery limitations

[ https://issues.apache.org/jira/browse/SPARK-12137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12137. --- Resolution: Not A Problem > Spark Streaming State Recovery limitations >

[jira] [Updated] (SPARK-11439) Optimization of creating sparse feature without dense one

[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11439: -- Assignee: Nakul Jindal > Optimization of creating sparse feature without dense one >

[jira] [Assigned] (SPARK-12203) Add KafkaDirectInputDStream that directly pulls messages from Kafka Brokers using receivers

[ https://issues.apache.org/jira/browse/SPARK-12203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12203: Assignee: Apache Spark > Add KafkaDirectInputDStream that directly pulls messages from

[jira] [Updated] (SPARK-12202) Pass additional Scala REPL options to the underlying REPL (2.11)

[ https://issues.apache.org/jira/browse/SPARK-12202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iulian Dragos updated SPARK-12202: -- Description: Sometimes it is useful to be able to pass Scala options to the underlying Spark

[jira] [Created] (SPARK-12204) Implement drop method for DataFrame in SparkR

Sun Rui created SPARK-12204: --- Summary: Implement drop method for DataFrame in SparkR Key: SPARK-12204 URL: https://issues.apache.org/jira/browse/SPARK-12204 Project: Spark Issue Type: New Feature

[jira] [Resolved] (SPARK-12166) Unset hadoop related environment in testing

[ https://issues.apache.org/jira/browse/SPARK-12166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12166. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull

[jira] [Updated] (SPARK-12166) Unset hadoop related environment in testing

[ https://issues.apache.org/jira/browse/SPARK-12166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12166: -- Assignee: Jeff Zhang > Unset hadoop related environment in testing >

[jira] [Assigned] (SPARK-12204) Implement drop method for DataFrame in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12204: Assignee: Apache Spark > Implement drop method for DataFrame in SparkR >

[jira] [Updated] (SPARK-12103) Clarify documentation of KafkaUtils createStream with multiple topics

[ https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12103: -- Summary: Clarify documentation of KafkaUtils createStream with multiple topics (was: KafkaUtils

[jira] [Updated] (SPARK-12103) KafkaUtils createStream with multiple topics -- does not work as expected

[ https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12103: -- Assignee: Cody Koeninger > KafkaUtils createStream with multiple topics -- does not work as expected >

[jira] [Commented] (SPARK-11551) Replace example code in ml-features.md using include_example

[ https://issues.apache.org/jira/browse/SPARK-11551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046763#comment-15046763 ] Apache Spark commented on SPARK-11551: -- User 'liancheng' has created a pull request for this issue:

[jira] [Resolved] (SPARK-12156) SPARK_EXECUTOR_INSTANCES is not effective

[ https://issues.apache.org/jira/browse/SPARK-12156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12156. --- Resolution: Won't Fix > SPARK_EXECUTOR_INSTANCES is not effective >

[jira] [Resolved] (SPARK-12127) Spark sql Support Cross join with Mongo DB

[ https://issues.apache.org/jira/browse/SPARK-12127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12127. --- Resolution: Duplicate Target Version/s: (was: 1.4.1) > Spark sql Support Cross join with

[jira] [Commented] (SPARK-12203) Add KafkaDirectInputDStream that directly pulls messages from Kafka Brokers using receivers

[ https://issues.apache.org/jira/browse/SPARK-12203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046711#comment-15046711 ] Sean Owen commented on SPARK-12203: --- Can you just maintain this implementation for your own purposes to

[jira] [Commented] (SPARK-12203) Add KafkaDirectInputDStream that directly pulls messages from Kafka Brokers using receivers

[ https://issues.apache.org/jira/browse/SPARK-12203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046708#comment-15046708 ] Liang-Chi Hsieh commented on SPARK-12203: - Our need is to have exactly once feature of

[jira] [Commented] (SPARK-11652) Remote code execution with InvokerTransformer

[ https://issues.apache.org/jira/browse/SPARK-11652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046738#comment-15046738 ] Apache Spark commented on SPARK-11652: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12202) Pass additional Scala REPL options to the underlying REPL (2.11)

[ https://issues.apache.org/jira/browse/SPARK-12202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12202: Assignee: Apache Spark > Pass additional Scala REPL options to the underlying REPL (2.11)

[jira] [Commented] (SPARK-12203) Add KafkaDirectInputDStream that directly pulls messages from Kafka Brokers using receivers

[ https://issues.apache.org/jira/browse/SPARK-12203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046678#comment-15046678 ] Apache Spark commented on SPARK-12203: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12203) Add KafkaDirectInputDStream that directly pulls messages from Kafka Brokers using receivers

[ https://issues.apache.org/jira/browse/SPARK-12203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12203: Assignee: (was: Apache Spark) > Add KafkaDirectInputDStream that directly pulls

[jira] [Commented] (SPARK-12203) Add KafkaDirectInputDStream that directly pulls messages from Kafka Brokers using receivers

[ https://issues.apache.org/jira/browse/SPARK-12203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046679#comment-15046679 ] Sean Owen commented on SPARK-12203: --- Is this really worth a third implementation? it seems to have

[jira] [Resolved] (SPARK-12103) KafkaUtils createStream with multiple topics -- does not work as expected

[ https://issues.apache.org/jira/browse/SPARK-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12103. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull

[jira] [Commented] (SPARK-12204) Implement drop method for DataFrame in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046792#comment-15046792 ] Apache Spark commented on SPARK-12204: -- User 'sun-rui' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12204) Implement drop method for DataFrame in SparkR

[ https://issues.apache.org/jira/browse/SPARK-12204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12204: Assignee: (was: Apache Spark) > Implement drop method for DataFrame in SparkR >

[jira] [Comment Edited] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046079#comment-15046079 ] Jean-Baptiste Onofré edited comment on SPARK-11193 at 12/8/15 4:06 PM:

[jira] [Created] (SPARK-12205) Pivot fails Analysis when aggregate is UnresolvedFunction

Andrew Ray created SPARK-12205: -- Summary: Pivot fails Analysis when aggregate is UnresolvedFunction Key: SPARK-12205 URL: https://issues.apache.org/jira/browse/SPARK-12205 Project: Spark Issue

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047036#comment-15047036 ] Jean-Baptiste Onofré commented on SPARK-11193: -- It could be possible. Let me check with the

[jira] [Assigned] (SPARK-12205) Pivot fails Analysis when aggregate is UnresolvedFunction

[ https://issues.apache.org/jira/browse/SPARK-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12205: Assignee: Apache Spark > Pivot fails Analysis when aggregate is UnresolvedFunction >

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046975#comment-15046975 ] Cody Koeninger commented on SPARK-12177: I really think this needs to be handled as a separate

[jira] [Assigned] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11193: Assignee: Apache Spark > Spark 1.5+ Kinesis Streaming - ClassCastException when starting

[jira] [Assigned] (SPARK-12205) Pivot fails Analysis when aggregate is UnresolvedFunction

[ https://issues.apache.org/jira/browse/SPARK-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12205: Assignee: (was: Apache Spark) > Pivot fails Analysis when aggregate is

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047027#comment-15047027 ] Fabien Comte commented on SPARK-11193: -- Thank you for working on this issue. I guess it's too late

[jira] [Assigned] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11193: Assignee: (was: Apache Spark) > Spark 1.5+ Kinesis Streaming - ClassCastException

[jira] [Commented] (SPARK-11193) Spark 1.5+ Kinesis Streaming - ClassCastException when starting KinesisReceiver

[ https://issues.apache.org/jira/browse/SPARK-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047056#comment-15047056 ] Apache Spark commented on SPARK-11193: -- User 'jbonofre' has created a pull request for this issue:

[jira] [Commented] (SPARK-9059) Update Python Direct Kafka Word count examples to show the use of HasOffsetRanges

[ https://issues.apache.org/jira/browse/SPARK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047132#comment-15047132 ] Neelesh Srinivas Salian commented on SPARK-9059: Is this JIRA still active? The PR seems

[jira] [Created] (SPARK-12207) "org.datanucleus" is already registered

stefan created SPARK-12207: -- Summary: "org.datanucleus" is already registered Key: SPARK-12207 URL: https://issues.apache.org/jira/browse/SPARK-12207 Project: Spark Issue Type: Bug Affects

[jira] [Created] (SPARK-12208) Abstract the examples into a common place

Timothy Hunter created SPARK-12208: -- Summary: Abstract the examples into a common place Key: SPARK-12208 URL: https://issues.apache.org/jira/browse/SPARK-12208 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-12074) Avoid memory copy involving ByteBuffer.wrap(ByteArrayOutputStream.toByteArray)

[ https://issues.apache.org/jira/browse/SPARK-12074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12074. -- Resolution: Fixed Assignee: Ted Yu Fix Version/s: 2.0.0 > Avoid memory copy

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047186#comment-15047186 ] Davies Liu commented on SPARK-12179: Could you also test 1.6-RC1? I'm just wondering that the window

[jira] [Resolved] (SPARK-10393) use ML pipeline in LDA example

[ https://issues.apache.org/jira/browse/SPARK-10393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-10393. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8551

[jira] [Comment Edited] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047194#comment-15047194 ] Adam Roberts edited comment on SPARK-9858 at 12/8/15 6:33 PM: -- Several

[jira] [Created] (SPARK-12206) Streaming WebUI shows incorrect batch statistics when using Window operations

Anand Iyer created SPARK-12206: -- Summary: Streaming WebUI shows incorrect batch statistics when using Window operations Key: SPARK-12206 URL: https://issues.apache.org/jira/browse/SPARK-12206 Project:

[jira] [Resolved] (SPARK-11155) Stage summary json should include stage duration

[ https://issues.apache.org/jira/browse/SPARK-11155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-11155. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10107

[jira] [Resolved] (SPARK-12201) add type coercion rule for greatest/least

[ https://issues.apache.org/jira/browse/SPARK-12201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12201. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10196

[jira] [Created] (SPARK-12209) spark.streaming.concurrentJobs and spark.streaming.backpressure.enabled

Andrej Kazakov created SPARK-12209: -- Summary: spark.streaming.concurrentJobs and spark.streaming.backpressure.enabled Key: SPARK-12209 URL: https://issues.apache.org/jira/browse/SPARK-12209 Project:

[jira] [Resolved] (SPARK-12188) [SQL] Code refactoring and comment correction in Dataset APIs

[ https://issues.apache.org/jira/browse/SPARK-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12188. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10184

[jira] [Updated] (SPARK-12071) Programming guide should explain NULL in JVM translate to NA in R

[ https://issues.apache.org/jira/browse/SPARK-12071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated SPARK-12071: Labels: releasenotes starter (was: releasenotes) > Programming guide

[jira] [Comment Edited] (SPARK-12179) Spark SQL get different result with the same code

[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047193#comment-15047193 ] Davies Liu edited comment on SPARK-12179 at 12/8/15 6:24 PM: - There are two

[jira] [Commented] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047194#comment-15047194 ] Adam Roberts commented on SPARK-9858: - Several potential issues here, may well not be with this code

[jira] [Updated] (SPARK-12206) Streaming WebUI shows incorrect batch statistics when using Window operations

[ https://issues.apache.org/jira/browse/SPARK-12206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anand Iyer updated SPARK-12206: --- Attachment: streaming-webui.png > Streaming WebUI shows incorrect batch statistics when using Window

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047193#comment-15047193 ] Davies Liu commented on SPARK-12179: There are two direction to narrow down the problem: 1) simplify

[jira] [Comment Edited] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047194#comment-15047194 ] Adam Roberts edited comment on SPARK-9858 at 12/8/15 6:28 PM: -- Several

[jira] [Resolved] (SPARK-12195) Adding BigDecimal, Date and Timestamp into Encoder

[ https://issues.apache.org/jira/browse/SPARK-12195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12195. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10188

[jira] [Commented] (SPARK-12118) SparkR: Documentation change for isNaN

[ https://issues.apache.org/jira/browse/SPARK-12118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047180#comment-15047180 ] Neelesh Srinivas Salian commented on SPARK-12118: - Hi [~yanboliang] This looks similar

[jira] [Resolved] (SPARK-12078) Fix ByteBuffer.limit misuse

[ https://issues.apache.org/jira/browse/SPARK-12078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12078. -- Resolution: Won't Fix For now, we can assume position is 0 > Fix ByteBuffer.limit misuse >

[jira] [Commented] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047222#comment-15047222 ] Yin Huai commented on SPARK-9858: - [~aroberts] Thanks for your comments. For 1, can you provide more

[jira] [Commented] (SPARK-10872) Derby error (XSDB6) when creating new HiveContext after restarting SparkContext

[ https://issues.apache.org/jira/browse/SPARK-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047280#comment-15047280 ] Andrew King commented on SPARK-10872: - I am running into the same issue. I am calling HiveContext

[jira] [Created] (SPARK-12210) Small example that shows how to integrate spark.mllib with spark.ml

Timothy Hunter created SPARK-12210: -- Summary: Small example that shows how to integrate spark.mllib with spark.ml Key: SPARK-12210 URL: https://issues.apache.org/jira/browse/SPARK-12210 Project:

[jira] [Assigned] (SPARK-12211) Incorrect version number in graphx doc for migration from 1.1

[ https://issues.apache.org/jira/browse/SPARK-12211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12211: Assignee: Apache Spark > Incorrect version number in graphx doc for migration from 1.1 >

[jira] [Commented] (SPARK-8517) Improve the organization and style of MLlib's user guide

[ https://issues.apache.org/jira/browse/SPARK-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047342#comment-15047342 ] Apache Spark commented on SPARK-8517: - User 'thunterdb' has created a pull request for this issue:

[jira] [Created] (SPARK-12212) Clarify the distinction between spark.mllib and spark.ml

Timothy Hunter created SPARK-12212: -- Summary: Clarify the distinction between spark.mllib and spark.ml Key: SPARK-12212 URL: https://issues.apache.org/jira/browse/SPARK-12212 Project: Spark

[jira] [Commented] (SPARK-10931) PySpark ML Models should contain Param values

[ https://issues.apache.org/jira/browse/SPARK-10931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047324#comment-15047324 ] Joseph K. Bradley commented on SPARK-10931: --- OK great! Btw, I just thought that this might be

[jira] [Commented] (SPARK-12211) Incorrect version number in graphx doc for migration from 1.1

[ https://issues.apache.org/jira/browse/SPARK-12211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047336#comment-15047336 ] Apache Spark commented on SPARK-12211: -- User 'aray' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12211) Incorrect version number in graphx doc for migration from 1.1

[ https://issues.apache.org/jira/browse/SPARK-12211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12211: Assignee: (was: Apache Spark) > Incorrect version number in graphx doc for migration

[jira] [Commented] (SPARK-12040) Add toJson/fromJson to Vector/Vectors for PySpark

[ https://issues.apache.org/jira/browse/SPARK-12040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047352#comment-15047352 ] Joseph K. Bradley commented on SPARK-12040: --- Let's hold off on this until there's a need

[jira] [Resolved] (SPARK-12205) Pivot fails Analysis when aggregate is UnresolvedFunction

[ https://issues.apache.org/jira/browse/SPARK-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12205. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10202

[jira] [Updated] (SPARK-12205) Pivot fails Analysis when aggregate is UnresolvedFunction

[ https://issues.apache.org/jira/browse/SPARK-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12205: - Assignee: Andrew Ray > Pivot fails Analysis when aggregate is UnresolvedFunction >

[jira] [Commented] (SPARK-11219) Make Parameter Description Format Consistent in PySpark.MLlib

[ https://issues.apache.org/jira/browse/SPARK-11219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047262#comment-15047262 ] Joseph K. Bradley commented on SPARK-11219: --- Thanks for the careful assessment! Creating

[jira] [Commented] (SPARK-12208) Abstract the examples into a common place

[ https://issues.apache.org/jira/browse/SPARK-12208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047278#comment-15047278 ] Joseph K. Bradley commented on SPARK-12208: --- This seems reasonable, as long as it's easy for

  1   2   3   >