[jira] [Commented] (SPARK-8621) crosstab exception when one of the value is empty

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14607904#comment-14607904 ] Apache Spark commented on SPARK-8621: - User 'animeshbaranawal' has created a pull

[jira] [Commented] (SPARK-8552) Using incorrect database in multiple sessions

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14607910#comment-14607910 ] Apache Spark commented on SPARK-8552: - User 'navis' has created a pull request for

[jira] [Assigned] (SPARK-8552) Using incorrect database in multiple sessions

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8552: --- Assignee: (was: Apache Spark) Using incorrect database in multiple sessions

[jira] [Assigned] (SPARK-8552) Using incorrect database in multiple sessions

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8552: --- Assignee: Apache Spark Using incorrect database in multiple sessions

[jira] [Created] (SPARK-8728) Add configuration for limiting the maximum number of active stages in a fair scheduling queue

2015-06-30 Thread Keuntae Park (JIRA)
Keuntae Park created SPARK-8728: --- Summary: Add configuration for limiting the maximum number of active stages in a fair scheduling queue Key: SPARK-8728 URL: https://issues.apache.org/jira/browse/SPARK-8728

[jira] [Commented] (SPARK-8041) Consistently pass SparkR library directory to SparkR application

2015-06-30 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14607877#comment-14607877 ] Sun Rui commented on SPARK-8041: sorry, this JIRA is obsolete as we are addressing

[jira] [Assigned] (SPARK-8621) crosstab exception when one of the value is empty

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8621: --- Assignee: (was: Apache Spark) crosstab exception when one of the value is empty

[jira] [Assigned] (SPARK-8621) crosstab exception when one of the value is empty

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8621: --- Assignee: Apache Spark crosstab exception when one of the value is empty

[jira] [Updated] (SPARK-8717) Update mllib-data-types docs to include missing matrix Python examples

2015-06-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8717: - Component/s: PySpark Documentation [~Rosstin] Please set components Update

[jira] [Commented] (SPARK-8560) The Executors page will have negative if having resubmitted tasks

2015-06-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14607889#comment-14607889 ] Sean Owen commented on SPARK-8560: -- Please fix the title The Executors page will have

[jira] [Assigned] (SPARK-8271) string function: soundex

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8271: --- Assignee: Apache Spark (was: Cheng Hao) string function: soundex

[jira] [Commented] (SPARK-8271) string function: soundex

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14607899#comment-14607899 ] Apache Spark commented on SPARK-8271: - User 'HuJiayin' has created a pull request for

[jira] [Assigned] (SPARK-8728) Add configuration for limiting the maximum number of active stages in a fair scheduling queue

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8728: --- Assignee: Apache Spark Add configuration for limiting the maximum number of active stages

[jira] [Commented] (SPARK-8728) Add configuration for limiting the maximum number of active stages in a fair scheduling queue

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14607985#comment-14607985 ] Apache Spark commented on SPARK-8728: - User 'sirpkt' has created a pull request for

[jira] [Commented] (SPARK-7334) Implement RandomProjection for Dimensionality Reduction

2015-06-30 Thread Sebastian Alfers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14607994#comment-14607994 ] Sebastian Alfers commented on SPARK-7334: - [~josephkb] any progress on this one?

[jira] [Commented] (SPARK-7402) JSON serialization of params

2015-06-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14607890#comment-14607890 ] Sean Owen commented on SPARK-7402: -- Is this still critical and targeted for 1.4.1 now

[jira] [Assigned] (SPARK-2505) Weighted Regularizer

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2505: --- Assignee: Apache Spark Weighted Regularizer Key:

[jira] [Assigned] (SPARK-2505) Weighted Regularizer

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-2505: --- Assignee: (was: Apache Spark) Weighted Regularizer

[jira] [Closed] (SPARK-8041) Consistently pass SparkR library directory to SparkR application

2015-06-30 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui closed SPARK-8041. -- Resolution: Duplicate This issue is covered by SPARK-6797 Consistently pass SparkR library directory to

[jira] [Updated] (SPARK-8699) Select command not working for SparkR built on Spark Version: 1.4.0 and R 3.2.0

2015-06-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8699: - Target Version/s: (was: 1.4.0) [~kamlesh.kumar] Please first read

[jira] [Assigned] (SPARK-8271) string function: soundex

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8271: --- Assignee: Cheng Hao (was: Apache Spark) string function: soundex

[jira] [Created] (SPARK-8743) Deregister Codahale metrics for streaming when StreamingContext is closed

2015-06-30 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-8743: Summary: Deregister Codahale metrics for streaming when StreamingContext is closed Key: SPARK-8743 URL: https://issues.apache.org/jira/browse/SPARK-8743 Project:

[jira] [Commented] (SPARK-8529) Set metadata for MinMaxScaler

2015-06-30 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609497#comment-14609497 ] Joseph K. Bradley commented on SPARK-8529: -- Here's an example of setting the

[jira] [Updated] (SPARK-8366) When task fails and append a new one, the ExecutorAllocationManager can't sense the new tasks

2015-06-30 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated SPARK-8366: Description: I use the *dynamic executor allocation* function. When an executor is killed, all running

[jira] [Updated] (SPARK-8366) When task fails and append a new one, the ExecutorAllocationManager can't sense the new tasks

2015-06-30 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated SPARK-8366: Description: I use the *dynamic executor allocation* function. When an executor is killed, all running

[jira] [Updated] (SPARK-8366) When task fails and append a new one, the ExecutorAllocationManager can't sense the new tasks

2015-06-30 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated SPARK-8366: Description: I use the *dynamic executor allocation* function. When an executor is killed, all running

[jira] [Commented] (SPARK-8743) Deregister Codahale metrics for streaming when StreamingContext is closed

2015-06-30 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609437#comment-14609437 ] Neelesh Srinivas Salian commented on SPARK-8743: I would like to work on

[jira] [Resolved] (SPARK-8727) Add missing python api

2015-06-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8727. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7114

[jira] [Closed] (SPARK-6892) Recovery from checkpoint will also reuse the application id when write eventLog in yarn-cluster mode

2015-06-30 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-6892. Resolution: Not A Problem Recovery from checkpoint will also reuse the application id when write

[jira] [Commented] (SPARK-8318) Spark Streaming Starter JIRAs

2015-06-30 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609399#comment-14609399 ] Tathagata Das commented on SPARK-8318: -- I think the starter label is not very easy to

[jira] [Commented] (SPARK-8313) Support Spark Packages containing R code with --packages

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609403#comment-14609403 ] Apache Spark commented on SPARK-8313: - User 'brkyvz' has created a pull request for

[jira] [Assigned] (SPARK-8313) Support Spark Packages containing R code with --packages

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8313: --- Assignee: (was: Apache Spark) Support Spark Packages containing R code with --packages

[jira] [Assigned] (SPARK-8313) Support Spark Packages containing R code with --packages

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8313: --- Assignee: Apache Spark Support Spark Packages containing R code with --packages

[jira] [Commented] (SPARK-6990) Add Java linting script

2015-06-30 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609509#comment-14609509 ] Yu Ishikawa commented on SPARK-6990: Please assign this issue to me? Add Java

[jira] [Commented] (SPARK-3444) Provide a way to easily change the log level in the Spark shell while running

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609455#comment-14609455 ] Apache Spark commented on SPARK-3444: - User 'vanzin' has created a pull request for

[jira] [Created] (SPARK-8742) Improve SparkR error messages for DataFrame API

2015-06-30 Thread Hossein Falaki (JIRA)
Hossein Falaki created SPARK-8742: - Summary: Improve SparkR error messages for DataFrame API Key: SPARK-8742 URL: https://issues.apache.org/jira/browse/SPARK-8742 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-8318) Spark Streaming Starter JIRAs

2015-06-30 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609399#comment-14609399 ] Tathagata Das edited comment on SPARK-8318 at 7/1/15 1:19 AM: --

[jira] [Created] (SPARK-8744) StringIndexerModel should have public constructor

2015-06-30 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-8744: Summary: StringIndexerModel should have public constructor Key: SPARK-8744 URL: https://issues.apache.org/jira/browse/SPARK-8744 Project: Spark

[jira] [Commented] (SPARK-8628) Race condition in AbstractSparkSQLParser.parse

2015-06-30 Thread Vinod KC (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609477#comment-14609477 ] Vinod KC commented on SPARK-8628: - Can you please assign this to me Race condition in

[jira] [Commented] (SPARK-6602) Replace direct use of Akka with Spark RPC interface

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609481#comment-14609481 ] Apache Spark commented on SPARK-6602: - User 'zsxwing' has created a pull request for

[jira] [Resolved] (SPARK-8535) PySpark : Can't create DataFrame from Pandas dataframe with no explicit column name

2015-06-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8535. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7124

[jira] [Comment Edited] (SPARK-6990) Add Java linting script

2015-06-30 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609531#comment-14609531 ] Yu Ishikawa edited comment on SPARK-6990 at 7/1/15 3:59 AM: I

[jira] [Commented] (SPARK-8742) Improve SparkR error messages for DataFrame API

2015-06-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609558#comment-14609558 ] Shivaram Venkataraman commented on SPARK-8742: -- Thanks [~falaki] for creating

[jira] [Commented] (SPARK-8746) Need to update download link for Hive 0.13.1 jars (HiveComparisonTest)

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609563#comment-14609563 ] Apache Spark commented on SPARK-8746: - User 'ckadner' has created a pull request for

[jira] [Created] (SPARK-8748) Move castability test out from Cast case class into Cast object

2015-06-30 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8748: -- Summary: Move castability test out from Cast case class into Cast object Key: SPARK-8748 URL: https://issues.apache.org/jira/browse/SPARK-8748 Project: Spark

[jira] [Comment Edited] (SPARK-6101) Create a SparkSQL DataSource API implementation for DynamoDB

2015-06-30 Thread venu k tangirala (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609569#comment-14609569 ] venu k tangirala edited comment on SPARK-6101 at 7/1/15 5:21 AM:

[jira] [Commented] (SPARK-8653) Add constraint for Children expression for data type

2015-06-30 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609579#comment-14609579 ] Davies Liu commented on SPARK-8653: --- [~rxin] With the new `ExpectsInputTypes`, we still

[jira] [Commented] (SPARK-8647) Potential issues with the constant hashCode

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609580#comment-14609580 ] Apache Spark commented on SPARK-8647: - User 'aloknsingh' has created a pull request

[jira] [Assigned] (SPARK-8647) Potential issues with the constant hashCode

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8647: --- Assignee: (was: Apache Spark) Potential issues with the constant hashCode

[jira] [Assigned] (SPARK-8647) Potential issues with the constant hashCode

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8647: --- Assignee: Apache Spark Potential issues with the constant hashCode

[jira] [Commented] (SPARK-8708) MatrixFactorizationModel.predictAll() populates single partition only

2015-06-30 Thread Antony Mayi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608169#comment-14608169 ] Antony Mayi commented on SPARK-8708: The real case is about 13M of users, few hundreds

[jira] [Resolved] (SPARK-8044) Avoid to use directMemory while put or get disk level block from file

2015-06-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8044. -- Resolution: Won't Fix Avoid to use directMemory while put or get disk level block from file

[jira] [Commented] (SPARK-8708) MatrixFactorizationModel.predictAll() populates single partition only

2015-06-30 Thread Antony Mayi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608214#comment-14608214 ] Antony Mayi commented on SPARK-8708: ok, more detailed example showing there really

[jira] [Comment Edited] (SPARK-8708) MatrixFactorizationModel.predictAll() populates single partition only

2015-06-30 Thread Antony Mayi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608169#comment-14608169 ] Antony Mayi edited comment on SPARK-8708 at 6/30/15 11:55 AM: --

[jira] [Commented] (SPARK-8708) MatrixFactorizationModel.predictAll() populates single partition only

2015-06-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608194#comment-14608194 ] Sean Owen commented on SPARK-8708: -- Does that actually make 5 partitions? I see that's

[jira] [Commented] (SPARK-8437) Using directory path without wildcard for filename slow for large number of files with wholeTextFiles and binaryFiles

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608174#comment-14608174 ] Apache Spark commented on SPARK-8437: - User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-8707) RDD#toDebugString fails if any cached RDD has invalid partitions

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608242#comment-14608242 ] Apache Spark commented on SPARK-8707: - User 'navis' has created a pull request for

[jira] [Assigned] (SPARK-7820) Java8-tests suite compile error under SBT

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7820: --- Assignee: (was: Apache Spark) Java8-tests suite compile error under SBT

[jira] [Commented] (SPARK-7820) Java8-tests suite compile error under SBT

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608063#comment-14608063 ] Apache Spark commented on SPARK-7820: - User 'jerryshao' has created a pull request for

[jira] [Commented] (SPARK-8731) Beeline doesn't work with -e option when started in background

2015-06-30 Thread Wang Yiguang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608079#comment-14608079 ] Wang Yiguang commented on SPARK-8731: - Here is more discussion about this issue

[jira] [Commented] (SPARK-8731) Beeline doesn't work with -e option when started in background

2015-06-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608084#comment-14608084 ] Sean Owen commented on SPARK-8731: -- Is this Spark-specific or just about beeline?

[jira] [Commented] (SPARK-8729) Spark app unable to instantiate the classes using the reflection

2015-06-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608087#comment-14608087 ] Sean Owen commented on SPARK-8729: -- [~kmurt...@gmail.com] This isn't really useful as you

[jira] [Commented] (SPARK-8729) Spark app unable to instantiate the classes using the reflection

2015-06-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608111#comment-14608111 ] Sean Owen commented on SPARK-8729: -- It just sounds like one of your jars is not deployed

[jira] [Created] (SPARK-8732) Compilation warning for existentials code

2015-06-30 Thread Tijo Thomas (JIRA)
Tijo Thomas created SPARK-8732: -- Summary: Compilation warning for existentials code Key: SPARK-8732 URL: https://issues.apache.org/jira/browse/SPARK-8732 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-6735) Provide options to make maximum executor failure count ( which kills the application ) relative to a window duration or disable it.

2015-06-30 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608280#comment-14608280 ] Thomas Graves commented on SPARK-6735: -- Pull request was up but didn't have time to

[jira] [Assigned] (SPARK-8707) RDD#toDebugString fails if any cached RDD has invalid partitions

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8707: --- Assignee: (was: Apache Spark) RDD#toDebugString fails if any cached RDD has invalid

[jira] [Assigned] (SPARK-8707) RDD#toDebugString fails if any cached RDD has invalid partitions

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8707: --- Assignee: Apache Spark RDD#toDebugString fails if any cached RDD has invalid partitions

[jira] [Created] (SPARK-8729) Spark app unable to instantiate the classes using the reflection

2015-06-30 Thread Murthy Chelankuri (JIRA)
Murthy Chelankuri created SPARK-8729: Summary: Spark app unable to instantiate the classes using the reflection Key: SPARK-8729 URL: https://issues.apache.org/jira/browse/SPARK-8729 Project:

[jira] [Created] (SPARK-8731) Beeline doesn't work with -e option when started in background

2015-06-30 Thread Wang Yiguang (JIRA)
Wang Yiguang created SPARK-8731: --- Summary: Beeline doesn't work with -e option when started in background Key: SPARK-8731 URL: https://issues.apache.org/jira/browse/SPARK-8731 Project: Spark

[jira] [Assigned] (SPARK-8730) Deser primitive class with Java serialization

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8730: --- Assignee: Apache Spark Deser primitive class with Java serialization

[jira] [Assigned] (SPARK-8730) Deser primitive class with Java serialization

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8730: --- Assignee: (was: Apache Spark) Deser primitive class with Java serialization

[jira] [Commented] (SPARK-8730) Deser primitive class with Java serialization

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608076#comment-14608076 ] Apache Spark commented on SPARK-8730: - User 'EugenCepoi' has created a pull request

[jira] [Commented] (SPARK-6951) History server slow startup if the event log directory is large

2015-06-30 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608287#comment-14608287 ] Thomas Graves commented on SPARK-6951: -- This actually happens more then just at start

[jira] [Commented] (SPARK-8464) Consider separating aggregator and non-aggregator paths in ExternalSorter

2015-06-30 Thread Ilya Ganelin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608292#comment-14608292 ] Ilya Ganelin commented on SPARK-8464: - Josh - I'd be happy to look into this, I'll

[jira] [Commented] (SPARK-8699) Select command not working for SparkR built on Spark Version: 1.4.0 and R 3.2.0

2015-06-30 Thread Kamlesh Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609545#comment-14609545 ] Kamlesh Kumar commented on SPARK-8699: -- Thanks Shivaram, it works. Select command

[jira] [Resolved] (SPARK-8699) Select command not working for SparkR built on Spark Version: 1.4.0 and R 3.2.0

2015-06-30 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8699. -- Resolution: Not A Problem Select command not working for SparkR built on Spark

[jira] [Comment Edited] (SPARK-8699) Select command not working for SparkR built on Spark Version: 1.4.0 and R 3.2.0

2015-06-30 Thread Kamlesh Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609545#comment-14609545 ] Kamlesh Kumar edited comment on SPARK-8699 at 7/1/15 4:39 AM: --

[jira] [Updated] (SPARK-8699) Select command not working for SparkR built on Spark Version: 1.4.0 and R 3.2.0

2015-06-30 Thread Kamlesh Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamlesh Kumar updated SPARK-8699: - Priority: Trivial (was: Critical) Select command not working for SparkR built on Spark Version:

[jira] [Created] (SPARK-8747) fix EqualNullSafe for binary type

2015-06-30 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-8747: -- Summary: fix EqualNullSafe for binary type Key: SPARK-8747 URL: https://issues.apache.org/jira/browse/SPARK-8747 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-8747) fix EqualNullSafe for binary type

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609562#comment-14609562 ] Apache Spark commented on SPARK-8747: - User 'cloud-fan' has created a pull request for

[jira] [Assigned] (SPARK-8748) Move castability test out from Cast case class into Cast object

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8748: --- Assignee: Reynold Xin (was: Apache Spark) Move castability test out from Cast case class

[jira] [Commented] (SPARK-6101) Create a SparkSQL DataSource API implementation for DynamoDB

2015-06-30 Thread Murtaza Kanchwala (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609598#comment-14609598 ] Murtaza Kanchwala commented on SPARK-6101: --

[jira] [Commented] (SPARK-8535) PySpark : Can't create DataFrame from Pandas dataframe with no explicit column name

2015-06-30 Thread Yuri Saito (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609552#comment-14609552 ] Yuri Saito commented on SPARK-8535: --- Could you change assignee from no-assignee to me?

[jira] [Assigned] (SPARK-8746) Need to update download link for Hive 0.13.1 jars (HiveComparisonTest)

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8746: --- Assignee: (was: Apache Spark) Need to update download link for Hive 0.13.1 jars

[jira] [Assigned] (SPARK-8746) Need to update download link for Hive 0.13.1 jars (HiveComparisonTest)

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8746: --- Assignee: Apache Spark Need to update download link for Hive 0.13.1 jars

[jira] [Commented] (SPARK-6101) Create a SparkSQL DataSource API implementation for DynamoDB

2015-06-30 Thread venu k tangirala (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609569#comment-14609569 ] venu k tangirala commented on SPARK-6101: - Hi Chris, does this include writing

[jira] [Commented] (SPARK-8748) Move castability test out from Cast case class into Cast object

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609576#comment-14609576 ] Apache Spark commented on SPARK-8748: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-8748) Move castability test out from Cast case class into Cast object

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8748: --- Assignee: Apache Spark (was: Reynold Xin) Move castability test out from Cast case class

[jira] [Assigned] (SPARK-8749) Remove HiveTypeCoercion trait

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8749: --- Assignee: Reynold Xin (was: Apache Spark) Remove HiveTypeCoercion trait

[jira] [Assigned] (SPARK-8749) Remove HiveTypeCoercion trait

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8749: --- Assignee: Apache Spark (was: Reynold Xin) Remove HiveTypeCoercion trait

[jira] [Commented] (SPARK-8749) Remove HiveTypeCoercion trait

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609594#comment-14609594 ] Apache Spark commented on SPARK-8749: - User 'rxin' has created a pull request for this

[jira] [Created] (SPARK-8750) Remove the closure in functions.callUdf

2015-06-30 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8750: -- Summary: Remove the closure in functions.callUdf Key: SPARK-8750 URL: https://issues.apache.org/jira/browse/SPARK-8750 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6990) Add Java linting script

2015-06-30 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609531#comment-14609531 ] Yu Ishikawa commented on SPARK-6990: I think it would be nice to execute `mvn

[jira] [Created] (SPARK-8745) Remove GenerateMutableProjection

2015-06-30 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8745: -- Summary: Remove GenerateMutableProjection Key: SPARK-8745 URL: https://issues.apache.org/jira/browse/SPARK-8745 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-8746) Need to update download link for Hive 0.13.1 jars (HiveComparisonTest)

2015-06-30 Thread Christian Kadner (JIRA)
Christian Kadner created SPARK-8746: --- Summary: Need to update download link for Hive 0.13.1 jars (HiveComparisonTest) Key: SPARK-8746 URL: https://issues.apache.org/jira/browse/SPARK-8746 Project:

[jira] [Assigned] (SPARK-8747) fix EqualNullSafe for binary type

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8747: --- Assignee: Apache Spark fix EqualNullSafe for binary type -

[jira] [Assigned] (SPARK-8747) fix EqualNullSafe for binary type

2015-06-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8747: --- Assignee: (was: Apache Spark) fix EqualNullSafe for binary type

[jira] [Commented] (SPARK-8745) Remove GenerateMutableProjection

2015-06-30 Thread Akhil Thatipamula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609566#comment-14609566 ] Akhil Thatipamula commented on SPARK-8745: -- [~rxin] I will work on this. Remove

[jira] [Commented] (SPARK-8653) Add constraint for Children expression for data type

2015-06-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14609583#comment-14609583 ] Reynold Xin commented on SPARK-8653: Implicit type casts should be up to the query

[jira] [Assigned] (SPARK-8653) Add constraint for Children expression for data type

2015-06-30 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-8653: -- Assignee: Reynold Xin Add constraint for Children expression for data type

  1   2   3   >