[jira] [Commented] (SPARK-11472) SparkContext creation error after sc.stop() when Spark is compiled for Hive

2015-11-03 Thread Pierre Beauvois (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989072#comment-14989072 ] Pierre Beauvois commented on SPARK-11472: - Thank you both for your replies. In t

[jira] [Assigned] (SPARK-11501) spark.rpc config not propagated to executors

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11501: Assignee: Apache Spark > spark.rpc config not propagated to executors > -

[jira] [Assigned] (SPARK-11501) spark.rpc config not propagated to executors

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11501: Assignee: (was: Apache Spark) > spark.rpc config not propagated to executors > --

[jira] [Commented] (SPARK-11501) spark.rpc config not propagated to executors

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989063#comment-14989063 ] Apache Spark commented on SPARK-11501: -- User 'nishkamravi2' has created a pull reque

[jira] [Created] (SPARK-11501) spark.rpc config not propagated to executors

2015-11-03 Thread Nishkam Ravi (JIRA)
Nishkam Ravi created SPARK-11501: Summary: spark.rpc config not propagated to executors Key: SPARK-11501 URL: https://issues.apache.org/jira/browse/SPARK-11501 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11500) Not deterministic order of columns when using merging schemas.

2015-11-03 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-11500: - Description: When executing {{sqlContext.read.option("mergeSchema", "true").parquet(pathOne, p

[jira] [Created] (SPARK-11500) Not deterministic order of columns when using merging schemas.

2015-11-03 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-11500: Summary: Not deterministic order of columns when using merging schemas. Key: SPARK-11500 URL: https://issues.apache.org/jira/browse/SPARK-11500 Project: Spark

[jira] [Commented] (SPARK-11475) DataFrame API saveAsTable() does not work well for HDFS HA

2015-11-03 Thread zhangxiongfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988998#comment-14988998 ] zhangxiongfei commented on SPARK-11475: --- Hi [~rekhajoshm] I think my Hive/Hdfs conf

[jira] [Updated] (SPARK-11475) DataFrame API saveAsTable() does not work well for HDFS HA

2015-11-03 Thread zhangxiongfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangxiongfei updated SPARK-11475: -- Attachment: hive-site.xml hdfs-site.xml > DataFrame API saveAsTable() does not

[jira] [Commented] (SPARK-10304) Partition discovery does not throw an exception if the dir structure is invalid

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988980#comment-14988980 ] Apache Spark commented on SPARK-10304: -- User 'viirya' has created a pull request for

[jira] [Commented] (SPARK-11263) lintr Throws Warnings on Commented Code in Documentation

2015-11-03 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988965#comment-14988965 ] Yu Ishikawa commented on SPARK-11263: - [~felixcheung] I think it would be great to ig

[jira] [Closed] (SPARK-10729) word2vec model save for python

2015-11-03 Thread Joseph A Gartner III (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph A Gartner III closed SPARK-10729. Resolution: Duplicate Fix Version/s: 1.5.0 Need to update documentation. >

[jira] [Commented] (SPARK-10729) word2vec model save for python

2015-11-03 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988962#comment-14988962 ] Yu Ishikawa commented on SPARK-10729: - Got it. That's because Word2VecModel in Python

[jira] [Commented] (SPARK-11492) Ignore commented code warnings in SparkR

2015-11-03 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988952#comment-14988952 ] Yu Ishikawa commented on SPARK-11492: - [~andreas.fe...@herold.at] sorry, thank you fo

[jira] [Closed] (SPARK-11492) Ignore commented code warnings in SparkR

2015-11-03 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Ishikawa closed SPARK-11492. --- Resolution: Duplicate > Ignore commented code warnings in SparkR > --

[jira] [Commented] (SPARK-10729) word2vec model save for python

2015-11-03 Thread Joseph A Gartner III (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988950#comment-14988950 ] Joseph A Gartner III commented on SPARK-10729: -- I believe they are the same

[jira] [Commented] (SPARK-11492) Ignore commented code warnings in SparkR

2015-11-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988949#comment-14988949 ] Felix Cheung commented on SPARK-11492: -- please see SPARK-11263 > Ignore commented c

[jira] [Commented] (SPARK-11499) Spark History Server UI should respect protocol when doing redirection

2015-11-03 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988945#comment-14988945 ] Marcelo Vanzin commented on SPARK-11499: Shouldn't the load balancer be doing tha

[jira] [Commented] (SPARK-11474) Options to jdbc load are lower cased

2015-11-03 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988939#comment-14988939 ] Huaxin Gao commented on SPARK-11474: In DefaultDataSource.scala, it has override

[jira] [Created] (SPARK-11499) Spark Web UI should respect protocol when doing redirection

2015-11-03 Thread Lukasz Jastrzebski (JIRA)
Lukasz Jastrzebski created SPARK-11499: -- Summary: Spark Web UI should respect protocol when doing redirection Key: SPARK-11499 URL: https://issues.apache.org/jira/browse/SPARK-11499 Project: Spar

[jira] [Updated] (SPARK-11499) Spark History Server UI should respect protocol when doing redirection

2015-11-03 Thread Lukasz Jastrzebski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukasz Jastrzebski updated SPARK-11499: --- Summary: Spark History Server UI should respect protocol when doing redirection (was

[jira] [Commented] (SPARK-10729) word2vec model save for python

2015-11-03 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988926#comment-14988926 ] Yu Ishikawa commented on SPARK-10729: - [~jgartner] Is this issue same as https://is

[jira] [Updated] (SPARK-11498) TreeNodeException under very special condition

2015-11-03 Thread Antony Mayi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antony Mayi updated SPARK-11498: Description: {code} from pyspark import SparkContext from pyspark.sql import SQLContext, Row sc =

[jira] [Created] (SPARK-11498) TreeNodeException under very special condition

2015-11-03 Thread Antony Mayi (JIRA)
Antony Mayi created SPARK-11498: --- Summary: TreeNodeException under very special condition Key: SPARK-11498 URL: https://issues.apache.org/jira/browse/SPARK-11498 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11455) case sensitivity of partition by is broken

2015-11-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11455: - Assignee: Wenchen Fan > case sensitivity of partition by is broken >

[jira] [Resolved] (SPARK-11455) case sensitivity of partition by is broken

2015-11-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11455. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9410 [https://github.com/a

[jira] [Commented] (SPARK-11202) Unsupported dataType

2015-11-03 Thread nauu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988797#comment-14988797 ] nauu commented on SPARK-11202: -- i have the same error. is there any solution? > Unsupported

[jira] [Assigned] (SPARK-11497) PySpark RowMatrix Constructor Has Type Erasure Issue

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11497: Assignee: (was: Apache Spark) > PySpark RowMatrix Constructor Has Type Erasure Issue >

[jira] [Commented] (SPARK-11497) PySpark RowMatrix Constructor Has Type Erasure Issue

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988774#comment-14988774 ] Apache Spark commented on SPARK-11497: -- User 'dusenberrymw' has created a pull reque

[jira] [Assigned] (SPARK-11497) PySpark RowMatrix Constructor Has Type Erasure Issue

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11497: Assignee: Apache Spark > PySpark RowMatrix Constructor Has Type Erasure Issue > --

[jira] [Created] (SPARK-11497) PySpark RowMatrix Constructor Has Type Erasure Issue

2015-11-03 Thread Mike Dusenberry (JIRA)
Mike Dusenberry created SPARK-11497: --- Summary: PySpark RowMatrix Constructor Has Type Erasure Issue Key: SPARK-11497 URL: https://issues.apache.org/jira/browse/SPARK-11497 Project: Spark Is

[jira] [Commented] (SPARK-11496) Parallel implementation of personalized pagerank

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988745#comment-14988745 ] Apache Spark commented on SPARK-11496: -- User 'moustaki' has created a pull request f

[jira] [Assigned] (SPARK-11496) Parallel implementation of personalized pagerank

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11496: Assignee: Yves Raimond (was: Apache Spark) > Parallel implementation of personalized page

[jira] [Assigned] (SPARK-11496) Parallel implementation of personalized pagerank

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11496: Assignee: Apache Spark (was: Yves Raimond) > Parallel implementation of personalized page

[jira] [Commented] (SPARK-5575) Artificial neural networks for MLlib deep learning

2015-11-03 Thread Alexander Ulanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988705#comment-14988705 ] Alexander Ulanov commented on SPARK-5575: - Hi Disha, RNN is a major feature. I su

[jira] [Commented] (SPARK-9103) Tracking spark's memory usage

2015-11-03 Thread Zhang, Liye (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988674#comment-14988674 ] Zhang, Liye commented on SPARK-9103: [~pwendell], [~andrewor14] would you please take

[jira] [Updated] (SPARK-11496) Parallel implementation of personalized pagerank

2015-11-03 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-11496: Shepherd: DB Tsai > Parallel implementation of personalized pagerank >

[jira] [Updated] (SPARK-11496) Parallel implementation of personalized pagerank

2015-11-03 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-11496: Assignee: Yves Raimond > Parallel implementation of personalized pagerank > ---

[jira] [Created] (SPARK-11496) Parallel implementation of personalized pagerank

2015-11-03 Thread Yves Raimond (JIRA)
Yves Raimond created SPARK-11496: Summary: Parallel implementation of personalized pagerank Key: SPARK-11496 URL: https://issues.apache.org/jira/browse/SPARK-11496 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-11495) Fix potential socket / file handle leaks identified via static analysis

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11495: Assignee: Apache Spark (was: Josh Rosen) > Fix potential socket / file handle leaks ident

[jira] [Assigned] (SPARK-11495) Fix potential socket / file handle leaks identified via static analysis

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11495: Assignee: Josh Rosen (was: Apache Spark) > Fix potential socket / file handle leaks ident

[jira] [Commented] (SPARK-11495) Fix potential socket / file handle leaks identified via static analysis

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988629#comment-14988629 ] Apache Spark commented on SPARK-11495: -- User 'JoshRosen' has created a pull request

[jira] [Created] (SPARK-11495) Fix potential socket / file handle leaks identified via static analysis

2015-11-03 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-11495: -- Summary: Fix potential socket / file handle leaks identified via static analysis Key: SPARK-11495 URL: https://issues.apache.org/jira/browse/SPARK-11495 Project: Spark

[jira] [Commented] (SPARK-11329) Expand Star when creating a struct

2015-11-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988618#comment-14988618 ] Yin Huai commented on SPARK-11329: -- The follow-up pr (https://github.com/apache/spark/pu

[jira] [Commented] (SPARK-11475) DataFrame API saveAsTable() does not work well for HDFS HA

2015-11-03 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988602#comment-14988602 ] Rekha Joshi commented on SPARK-11475: - Hi [~zhangxiongfei] Do you have the hive buil

[jira] [Commented] (SPARK-9837) Provide R-like summary statistics for GLMs via iteratively reweighted least squares

2015-11-03 Thread Soila Kavulya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988594#comment-14988594 ] Soila Kavulya commented on SPARK-9837: -- I am out of the office until Thursday, Novemb

[jira] [Updated] (SPARK-11475) DataFrame API saveAsTable() does not work well for HDFS HA

2015-11-03 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi updated SPARK-11475: Attachment: dataFrame_saveAsTable.txt DataFrame API saveAsTable() working > DataFrame API saveAsTa

[jira] [Commented] (SPARK-9837) Provide R-like summary statistics for GLMs via iteratively reweighted least squares

2015-11-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988582#comment-14988582 ] Xiangrui Meng commented on SPARK-9837: -- [~skavulya] Is it open-sourced? Our least squ

[jira] [Resolved] (SPARK-11489) Only include common first order statistics in GroupedData

2015-11-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11489. - Resolution: Fixed Fix Version/s: 1.6.0 > Only include common first order statistics in Gro

[jira] [Resolved] (SPARK-11466) FsHistoryProviderSuite breaks hadoop1 test

2015-11-03 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11466. Resolution: Fixed Fix Version/s: 1.6.0 > FsHistoryProviderSuite breaks hadoop1 test

[jira] [Created] (SPARK-11494) Expose R-like summary statistics in SparkR::glm for linear regression

2015-11-03 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-11494: - Summary: Expose R-like summary statistics in SparkR::glm for linear regression Key: SPARK-11494 URL: https://issues.apache.org/jira/browse/SPARK-11494 Project: Spar

[jira] [Commented] (SPARK-11217) Model import/export for non-meta estimators and transformers

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988560#comment-14988560 ] Apache Spark commented on SPARK-11217: -- User 'mengxr' has created a pull request for

[jira] [Commented] (SPARK-9858) Introduce an ExchangeCoordinator to estimate the number of post-shuffle partitions.

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988510#comment-14988510 ] Apache Spark commented on SPARK-9858: - User 'yhuai' has created a pull request for thi

[jira] [Commented] (SPARK-11493) Remove Bitset in BytesToBytesMap

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988507#comment-14988507 ] Apache Spark commented on SPARK-11493: -- User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-11493) Remove Bitset in BytesToBytesMap

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11493: Assignee: Davies Liu (was: Apache Spark) > Remove Bitset in BytesToBytesMap > ---

[jira] [Assigned] (SPARK-11493) Remove Bitset in BytesToBytesMap

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11493: Assignee: Apache Spark (was: Davies Liu) > Remove Bitset in BytesToBytesMap > ---

[jira] [Created] (SPARK-11493) Remove Bitset in BytesToBytesMap

2015-11-03 Thread Davies Liu (JIRA)
Davies Liu created SPARK-11493: -- Summary: Remove Bitset in BytesToBytesMap Key: SPARK-11493 URL: https://issues.apache.org/jira/browse/SPARK-11493 Project: Spark Issue Type: Task Compo

[jira] [Commented] (SPARK-7336) Sometimes the status of finished job show on JobHistory UI will be active, and never update.

2015-11-03 Thread Thomas Omans (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988467#comment-14988467 ] Thomas Omans commented on SPARK-7336: - This consistently breaks the history UI for me

[jira] [Resolved] (SPARK-11477) support create Dataset from RDD

2015-11-03 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11477. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9434 [http

[jira] [Created] (SPARK-11492) Ignore commented code warnings in SparkR

2015-11-03 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created SPARK-11492: --- Summary: Ignore commented code warnings in SparkR Key: SPARK-11492 URL: https://issues.apache.org/jira/browse/SPARK-11492 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-11491) Use Scala 2.10.5

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11491: Assignee: Josh Rosen (was: Apache Spark) > Use Scala 2.10.5 > > >

[jira] [Commented] (SPARK-11491) Use Scala 2.10.5

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988405#comment-14988405 ] Apache Spark commented on SPARK-11491: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-11491) Use Scala 2.10.5

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11491: Assignee: Apache Spark (was: Josh Rosen) > Use Scala 2.10.5 > > >

[jira] [Created] (SPARK-11491) Use Scala 2.10.5

2015-11-03 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-11491: -- Summary: Use Scala 2.10.5 Key: SPARK-11491 URL: https://issues.apache.org/jira/browse/SPARK-11491 Project: Spark Issue Type: Improvement Reporter: Jo

[jira] [Updated] (SPARK-11408) Display scientific notation properly in DataFrame.show()

2015-11-03 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11408: -- Summary: Display scientific notation properly in DataFrame.show() (was: Display scientific not

[jira] [Commented] (SPARK-11490) variance should alias var_samp instead of var_pop

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988362#comment-14988362 ] Apache Spark commented on SPARK-11490: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-11490) variance should alias var_samp instead of var_pop

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11490: Assignee: Apache Spark (was: Reynold Xin) > variance should alias var_samp instead of var

[jira] [Assigned] (SPARK-11490) variance should alias var_samp instead of var_pop

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11490: Assignee: Reynold Xin (was: Apache Spark) > variance should alias var_samp instead of var

[jira] [Created] (SPARK-11490) variance should alias var_samp instead of var_pop

2015-11-03 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11490: --- Summary: variance should alias var_samp instead of var_pop Key: SPARK-11490 URL: https://issues.apache.org/jira/browse/SPARK-11490 Project: Spark Issue Type: S

[jira] [Updated] (SPARK-11487) Spark Master shutdown automatically after some applications execution

2015-11-03 Thread Sandeep Pal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Pal updated SPARK-11487: Environment: Spark Standalone on CentOS 6.6, One Master and 5 worker nodes cluster (Each Node Memo

[jira] [Resolved] (SPARK-9296) variance, var_pop, and var_samp aggregate functions

2015-11-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9296. Resolution: Fixed Assignee: Seth Hendrickson Fix Version/s: 1.6.0 > variance, var_po

[jira] [Commented] (SPARK-11428) Schema Merging Broken for Some Queries

2015-11-03 Thread Brad Willard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988337#comment-14988337 ] Brad Willard commented on SPARK-11428: -- As a work around. You can create a new parqu

[jira] [Commented] (SPARK-11390) Query plan with/without filterPushdown indistinguishable

2015-11-03 Thread Zee Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988330#comment-14988330 ] Zee Chen commented on SPARK-11390: -- I will take a look at this. If I understand your pr

[jira] [Commented] (SPARK-11484) Strange Spark UI issue when running on Oozie uber mode ON

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988288#comment-14988288 ] Apache Spark commented on SPARK-11484: -- User 'vundela' has created a pull request fo

[jira] [Assigned] (SPARK-11484) Strange Spark UI issue when running on Oozie uber mode ON

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11484: Assignee: Apache Spark > Strange Spark UI issue when running on Oozie uber mode ON > -

[jira] [Assigned] (SPARK-11484) Strange Spark UI issue when running on Oozie uber mode ON

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11484: Assignee: (was: Apache Spark) > Strange Spark UI issue when running on Oozie uber mode

[jira] [Commented] (SPARK-11486) TungstenAggregate may fail when switching to sort-based aggregation when there are string in grouping columns and no aggregation buffer columns

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988289#comment-14988289 ] Apache Spark commented on SPARK-11486: -- User 'davies' has created a pull request for

[jira] [Resolved] (SPARK-11424) Guard against MAPREDUCE-5918 by ensuring RecordReader is only closed once in *HadoopRDD

2015-11-03 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11424. Resolution: Fixed Fix Version/s: 1.6.0 1.5.2 1.4.2

[jira] [Commented] (SPARK-11486) TungstenAggregate may fail when switching to sort-based aggregation when there are string in grouping columns and no aggregation buffer columns

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988259#comment-14988259 ] Apache Spark commented on SPARK-11486: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-11486) TungstenAggregate may fail when switching to sort-based aggregation when there are string in grouping columns and no aggregation buffer columns

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11486: Assignee: (was: Apache Spark) > TungstenAggregate may fail when switching to sort-base

[jira] [Assigned] (SPARK-11486) TungstenAggregate may fail when switching to sort-based aggregation when there are string in grouping columns and no aggregation buffer columns

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11486: Assignee: Apache Spark > TungstenAggregate may fail when switching to sort-based aggregati

[jira] [Updated] (SPARK-11489) Only include common first order statistics in GroupedData

2015-11-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11489: Description: We added a bunch of higher order statistics such as skewness and kurtosis to GroupedD

[jira] [Commented] (SPARK-11489) Only include common first order statistics in GroupedData

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988212#comment-14988212 ] Apache Spark commented on SPARK-11489: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-11489) Only include common first order statistics in GroupedData

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11489: Assignee: Reynold Xin (was: Apache Spark) > Only include common first order statistics in

[jira] [Assigned] (SPARK-11489) Only include common first order statistics in GroupedData

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11489: Assignee: Apache Spark (was: Reynold Xin) > Only include common first order statistics in

[jira] [Created] (SPARK-11489) Only include common first order statistics in GroupedData

2015-11-03 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11489: --- Summary: Only include common first order statistics in GroupedData Key: SPARK-11489 URL: https://issues.apache.org/jira/browse/SPARK-11489 Project: Spark Issue

[jira] [Resolved] (SPARK-11467) Add Python API stddev/variance

2015-11-03 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11467. - Resolution: Fixed Fix Version/s: 1.6.0 > Add Python API stddev/variance >

[jira] [Created] (SPARK-11488) GroupedData should only keep common first order statistics

2015-11-03 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11488: --- Summary: GroupedData should only keep common first order statistics Key: SPARK-11488 URL: https://issues.apache.org/jira/browse/SPARK-11488 Project: Spark Issu

[jira] [Commented] (SPARK-11484) Strange Spark UI issue when running on Oozie uber mode ON

2015-11-03 Thread Srinivasa Reddy Vundela (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988195#comment-14988195 ] Srinivasa Reddy Vundela commented on SPARK-11484: - [~sowen] Oozie mapredu

[jira] [Updated] (SPARK-11487) Spark Master shutdown automatically after some applications execution

2015-11-03 Thread Sandeep Pal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Pal updated SPARK-11487: Description: The master logs are as follow after the spark automatic shutdown: 15/11/02 20:50:01 I

[jira] [Updated] (SPARK-11469) Initial implementation of allowing users to define UDFs that will not be evaluated more than once

2015-11-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11469: - Description: Right now, we have a projection collapsing optimization rule, that will collapse multiple pr

[jira] [Commented] (SPARK-11469) Initial implementation of allowing users to define UDFs that will not be evaluated more than once

2015-11-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988174#comment-14988174 ] Yin Huai commented on SPARK-11469: -- Updated the title and description. > Initial imple

[jira] [Updated] (SPARK-11469) Initial implementation of allowing users to define UDFs that will not be evaluated more than once

2015-11-03 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11469: - Summary: Initial implementation of allowing users to define UDFs that will not be evaluated more than onc

[jira] [Updated] (SPARK-11487) Spark Master shutdown automatically after some applications execution

2015-11-03 Thread Sandeep Pal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Pal updated SPARK-11487: Environment: Spark Standalone on CentOS 6.6, One Master and 5 Node cluster (Worker Memory: > 150 G

[jira] [Created] (SPARK-11487) Spark Master shutdown automatically after some applications execution

2015-11-03 Thread Sandeep Pal (JIRA)
Sandeep Pal created SPARK-11487: --- Summary: Spark Master shutdown automatically after some applications execution Key: SPARK-11487 URL: https://issues.apache.org/jira/browse/SPARK-11487 Project: Spark

[jira] [Created] (SPARK-11486) TungstenAggregate may fail when switching to sort-based aggregation when there are string in grouping columns and no aggregation buffer columns

2015-11-03 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-11486: -- Summary: TungstenAggregate may fail when switching to sort-based aggregation when there are string in grouping columns and no aggregation buffer columns Key: SPARK-11486 URL: https:/

[jira] [Assigned] (SPARK-11485) Make DataFrameHolder and DatasetHolder public

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11485: Assignee: Apache Spark (was: Reynold Xin) > Make DataFrameHolder and DatasetHolder public

[jira] [Commented] (SPARK-11485) Make DataFrameHolder and DatasetHolder public

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14988133#comment-14988133 ] Apache Spark commented on SPARK-11485: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-11485) Make DataFrameHolder and DatasetHolder public

2015-11-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11485: Assignee: Reynold Xin (was: Apache Spark) > Make DataFrameHolder and DatasetHolder public

[jira] [Created] (SPARK-11485) Make DataFrameHolder and DatasetHolder public

2015-11-03 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11485: --- Summary: Make DataFrameHolder and DatasetHolder public Key: SPARK-11485 URL: https://issues.apache.org/jira/browse/SPARK-11485 Project: Spark Issue Type: Impro

  1   2   3   4   >