[jira] [Resolved] (SPARK-14786) Remove hive-cli dependency from hive subproject

2016-04-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14786. - Resolution: Fixed Fix Version/s: 2.0.0 > Remove hive-cli dependency from hive subproject

[jira] [Resolved] (SPARK-14778) Remove HiveSessionState.substitutor

2016-04-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14778. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12550

[jira] [Assigned] (SPARK-14571) Log instrumentation in ALS

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14571: Assignee: Apache Spark > Log instrumentation in ALS > -- > >

[jira] [Commented] (SPARK-14571) Log instrumentation in ALS

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251311#comment-15251311 ] Apache Spark commented on SPARK-14571: -- User 'wangmiao1981' has created a pull request for this

[jira] [Assigned] (SPARK-14571) Log instrumentation in ALS

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14571: Assignee: (was: Apache Spark) > Log instrumentation in ALS >

[jira] [Commented] (SPARK-14653) Remove NumericParser and jackson dependency from mllib-local

2016-04-20 Thread Vishnu Prasad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251308#comment-15251308 ] Vishnu Prasad commented on SPARK-14653: --- Hey I've just written an example of a UDT for DenseVector

[jira] [Commented] (SPARK-10001) Allow Ctrl-C in spark-shell to kill running job

2016-04-20 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251304#comment-15251304 ] Jakob Odersky commented on SPARK-10001: --- FYI, I took up the issue (previous pr #8216) > Allow

[jira] [Commented] (SPARK-14525) DataFrameWriter's save method should delegate to jdbc for jdbc datasource

2016-04-20 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251301#comment-15251301 ] Takeshi Yamamuro commented on SPARK-14525: -- Nobody here? If so, I'll try to take on this. >

[jira] [Assigned] (SPARK-14793) Code generation for large complex type exceeds JVM size limit.

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14793: Assignee: Apache Spark > Code generation for large complex type exceeds JVM size limit. >

[jira] [Assigned] (SPARK-14793) Code generation for large complex type exceeds JVM size limit.

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14793: Assignee: (was: Apache Spark) > Code generation for large complex type exceeds JVM

[jira] [Commented] (SPARK-14793) Code generation for large complex type exceeds JVM size limit.

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251300#comment-15251300 ] Apache Spark commented on SPARK-14793: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-14597) Streaming Listener timing metrics should include time spent in JobGenerator's graph.generateJobs

2016-04-20 Thread Mario Briggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251285#comment-15251285 ] Mario Briggs commented on SPARK-14597: -- Yeah i think it is neat. Good to me. Thanks > Streaming

[jira] [Created] (SPARK-14793) Code generation for large complex type exceeds JVM size limit.

2016-04-20 Thread Takuya Ueshin (JIRA)
Takuya Ueshin created SPARK-14793: - Summary: Code generation for large complex type exceeds JVM size limit. Key: SPARK-14793 URL: https://issues.apache.org/jira/browse/SPARK-14793 Project: Spark

[jira] [Resolved] (SPARK-14782) Remove HiveConf dependency from HiveSqlAstBuilder

2016-04-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14782. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12550

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-04-20 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251201#comment-15251201 ] Zhongshuai Pei edited comment on SPARK-4105 at 4/21/16 3:51 AM: I find

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-04-20 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251201#comment-15251201 ] Zhongshuai Pei edited comment on SPARK-4105 at 4/21/16 3:49 AM: I find

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-04-20 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251201#comment-15251201 ] Zhongshuai Pei commented on SPARK-4105: --- I find that some task recompute before this problem

[jira] [Commented] (SPARK-12922) Implement gapply() on DataFrame in SparkR

2016-04-20 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251196#comment-15251196 ] Sun Rui commented on SPARK-12922: - cool. If possible, could you make it a WIP PR so that I can take a

[jira] [Commented] (SPARK-10001) Allow Ctrl-C in spark-shell to kill running job

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251192#comment-15251192 ] Apache Spark commented on SPARK-10001: -- User 'jodersky' has created a pull request for this issue:

[jira] [Commented] (SPARK-14750) Make historyServer refer application log in hdfs

2016-04-20 Thread SuYan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251184#comment-15251184 ] SuYan commented on SPARK-14750: --- In yarn mode, spark user can't refer executor log on historyServer logUrl,

[jira] [Commented] (SPARK-14790) Scalastyle should run on compile in sbt

2016-04-20 Thread Eric Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251171#comment-15251171 ] Eric Liang commented on SPARK-14790: You can cache the style results so it's not that different >

[jira] [Assigned] (SPARK-14792) Move as many parsing rules as possible into SQL parser

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14792: Assignee: Reynold Xin (was: Apache Spark) > Move as many parsing rules as possible into

[jira] [Assigned] (SPARK-14792) Move as many parsing rules as possible into SQL parser

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14792: Assignee: Apache Spark (was: Reynold Xin) > Move as many parsing rules as possible into

[jira] [Commented] (SPARK-14792) Move as many parsing rules as possible into SQL parser

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251167#comment-15251167 ] Apache Spark commented on SPARK-14792: -- User 'rxin' has created a pull request for this issue:

[jira] [Commented] (SPARK-14778) Remove HiveSessionState.substitutor

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251164#comment-15251164 ] Apache Spark commented on SPARK-14778: -- User 'rxin' has created a pull request for this issue:

[jira] [Updated] (SPARK-14792) Move as many parsing rules as possible into SQL parser

2016-04-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14792: Description: This patch moves as many parsing rules as possible into SQL parser. There are only

[jira] [Updated] (SPARK-14792) Move as many parsing rules as possible into SQL parser

2016-04-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14792: Summary: Move as many parsing rules as possible into SQL parser (was: Move all parsing rules

[jira] [Created] (SPARK-14792) Move all parsing rules except view & analyze into SQL parser

2016-04-20 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14792: --- Summary: Move all parsing rules except view & analyze into SQL parser Key: SPARK-14792 URL: https://issues.apache.org/jira/browse/SPARK-14792 Project: Spark

[jira] [Commented] (SPARK-14790) Scalastyle should run on compile in sbt

2016-04-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251160#comment-15251160 ] Reynold Xin commented on SPARK-14790: - Hm I think part of the problem is that it is slower to run

[jira] [Created] (SPARK-14791) TPCDS Q23B generate different result each time

2016-04-20 Thread Davies Liu (JIRA)
Davies Liu created SPARK-14791: -- Summary: TPCDS Q23B generate different result each time Key: SPARK-14791 URL: https://issues.apache.org/jira/browse/SPARK-14791 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-14790) Scalastyle should run on compile in sbt

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251158#comment-15251158 ] Apache Spark commented on SPARK-14790: -- User 'ericl' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14790) Scalastyle should run on compile in sbt

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14790: Assignee: Apache Spark > Scalastyle should run on compile in sbt >

[jira] [Assigned] (SPARK-14790) Scalastyle should run on compile in sbt

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14790: Assignee: (was: Apache Spark) > Scalastyle should run on compile in sbt >

[jira] [Commented] (SPARK-14746) Support transformations in R source code for Dataset/DataFrame

2016-04-20 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251152#comment-15251152 ] Sun Rui commented on SPARK-14746: - fine. > Support transformations in R source code for

[jira] [Comment Edited] (SPARK-13525) SparkR: java.net.SocketTimeoutException: Accept timed out when running any dataframe function

2016-04-20 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251144#comment-15251144 ] Sun Rui edited comment on SPARK-13525 at 4/21/16 2:43 AM: -- We need to find the

[jira] [Commented] (SPARK-13525) SparkR: java.net.SocketTimeoutException: Accept timed out when running any dataframe function

2016-04-20 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251144#comment-15251144 ] Sun Rui commented on SPARK-13525: - We need to find the root cause before we have a fix for it. The

[jira] [Created] (SPARK-14790) Scalastyle should run on compile in sbt

2016-04-20 Thread Eric Liang (JIRA)
Eric Liang created SPARK-14790: -- Summary: Scalastyle should run on compile in sbt Key: SPARK-14790 URL: https://issues.apache.org/jira/browse/SPARK-14790 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-14789) Move FunctionResourceLoader into SessionState

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14789: Assignee: Apache Spark (was: Andrew Or) > Move FunctionResourceLoader into SessionState

[jira] [Commented] (SPARK-14789) Move FunctionResourceLoader into SessionState

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251126#comment-15251126 ] Apache Spark commented on SPARK-14789: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14789) Move FunctionResourceLoader into SessionState

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14789: Assignee: Andrew Or (was: Apache Spark) > Move FunctionResourceLoader into SessionState

[jira] [Created] (SPARK-14789) Move FunctionResourceLoader into SessionState

2016-04-20 Thread Andrew Or (JIRA)
Andrew Or created SPARK-14789: - Summary: Move FunctionResourceLoader into SessionState Key: SPARK-14789 URL: https://issues.apache.org/jira/browse/SPARK-14789 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-13643) Create SparkSession interface

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251114#comment-15251114 ] Apache Spark commented on SPARK-13643: -- User 'andrewor14' has created a pull request for this issue:

[jira] [Commented] (SPARK-14730) Expose ColumnPruner as feature transformer

2016-04-20 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251115#comment-15251115 ] Yanbo Liang commented on SPARK-14730: - [~BenFradet] I'm not working on it. Please feel free to take

[jira] [Created] (SPARK-14788) Initial number of executors should honor min number if streaming dynamic allocation is enabled

2016-04-20 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-14788: --- Summary: Initial number of executors should honor min number if streaming dynamic allocation is enabled Key: SPARK-14788 URL: https://issues.apache.org/jira/browse/SPARK-14788

[jira] [Commented] (SPARK-14787) Upgrade Joda-Time library from 2.9 to 2.9.3

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251069#comment-15251069 ] Apache Spark commented on SPARK-14787: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-14787) Upgrade Joda-Time library from 2.9 to 2.9.3

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14787: Assignee: (was: Apache Spark) > Upgrade Joda-Time library from 2.9 to 2.9.3 >

[jira] [Assigned] (SPARK-14787) Upgrade Joda-Time library from 2.9 to 2.9.3

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14787: Assignee: Apache Spark > Upgrade Joda-Time library from 2.9 to 2.9.3 >

[jira] [Created] (SPARK-14787) Upgrade Joda-Time library from 2.9 to 2.9.3

2016-04-20 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-14787: Summary: Upgrade Joda-Time library from 2.9 to 2.9.3 Key: SPARK-14787 URL: https://issues.apache.org/jira/browse/SPARK-14787 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-14786) Remove hive-cli dependency from hive subproject

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14786: Assignee: Josh Rosen (was: Apache Spark) > Remove hive-cli dependency from hive

[jira] [Commented] (SPARK-14786) Remove hive-cli dependency from hive subproject

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251055#comment-15251055 ] Apache Spark commented on SPARK-14786: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14786) Remove hive-cli dependency from hive subproject

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14786: Assignee: Apache Spark (was: Josh Rosen) > Remove hive-cli dependency from hive

[jira] [Created] (SPARK-14786) Remove hive-cli dependency from hive subproject

2016-04-20 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14786: -- Summary: Remove hive-cli dependency from hive subproject Key: SPARK-14786 URL: https://issues.apache.org/jira/browse/SPARK-14786 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-14778) Remove HiveSessionState.substitutor

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251052#comment-15251052 ] Apache Spark commented on SPARK-14778: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14778) Remove HiveSessionState.substitutor

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14778: Assignee: Reynold Xin (was: Apache Spark) > Remove HiveSessionState.substitutor >

[jira] [Assigned] (SPARK-14778) Remove HiveSessionState.substitutor

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14778: Assignee: Apache Spark (was: Reynold Xin) > Remove HiveSessionState.substitutor >

[jira] [Commented] (SPARK-14782) Remove HiveConf dependency from HiveSqlAstBuilder

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251050#comment-15251050 ] Apache Spark commented on SPARK-14782: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14782) Remove HiveConf dependency from HiveSqlAstBuilder

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14782: Assignee: Reynold Xin (was: Apache Spark) > Remove HiveConf dependency from

[jira] [Assigned] (SPARK-14782) Remove HiveConf dependency from HiveSqlAstBuilder

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14782: Assignee: Apache Spark (was: Reynold Xin) > Remove HiveConf dependency from

[jira] [Updated] (SPARK-14782) Remove HiveConf dependency from HiveSqlAstBuilder

2016-04-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14782: Summary: Remove HiveConf dependency from HiveSqlAstBuilder (was: Remove HiveConf dependency from

[jira] [Resolved] (SPARK-14775) Remove TestHiveSparkSession.rewritePaths

2016-04-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14775. - Resolution: Fixed Fix Version/s: 2.0.0 > Remove TestHiveSparkSession.rewritePaths >

[jira] [Commented] (SPARK-14767) Codegen "no constructor found" errors with Maps inside case classes in Datasets

2016-04-20 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251010#comment-15251010 ] Wenchen Fan commented on SPARK-14767: - This is a known issue, the reason is that we can only create

[jira] [Commented] (SPARK-14765) Jenkins should run tests only based on the PR contents

2016-04-20 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251007#comment-15251007 ] Dongjoon Hyun commented on SPARK-14765: --- And, when I rebased my repository to the master and `push

[jira] [Commented] (SPARK-14765) Jenkins should run tests only based on the PR contents

2016-04-20 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250988#comment-15250988 ] Dongjoon Hyun commented on SPARK-14765: --- By the way, it happens again. I just leave a message to

[jira] [Updated] (SPARK-14785) Support correlated scalar subquery

2016-04-20 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-14785: --- Description: For example: SELECT a from t where b > (select c from t2 where t.id = t2.id) TPCDS

[jira] [Resolved] (SPARK-14602) [YARN+Windows] Setting SPARK_YARN_CACHE_FILES exceeds command line length limit on Windows

2016-04-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-14602. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.0.0 >

[jira] [Created] (SPARK-14785) Support correlated scalar subquery

2016-04-20 Thread Davies Liu (JIRA)
Davies Liu created SPARK-14785: -- Summary: Support correlated scalar subquery Key: SPARK-14785 URL: https://issues.apache.org/jira/browse/SPARK-14785 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-14784) Build SQL for EXISTS/IN subquery

2016-04-20 Thread Davies Liu (JIRA)
Davies Liu created SPARK-14784: -- Summary: Build SQL for EXISTS/IN subquery Key: SPARK-14784 URL: https://issues.apache.org/jira/browse/SPARK-14784 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-14780) Add `setLogLevel` to SparkR

2016-04-20 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-14780: -- Description: This issue aims to add `setLogLevel` functions to SparkR context. **Spark

[jira] [Commented] (SPARK-14783) Log full exception stacktrace in IsolatedClientLoader

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250962#comment-15250962 ] Apache Spark commented on SPARK-14783: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14783) Log full exception stacktrace in IsolatedClientLoader

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14783: Assignee: Apache Spark > Log full exception stacktrace in IsolatedClientLoader >

[jira] [Assigned] (SPARK-14783) Log full exception stacktrace in IsolatedClientLoader

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14783: Assignee: (was: Apache Spark) > Log full exception stacktrace in IsolatedClientLoader

[jira] [Updated] (SPARK-14783) Log full exception stacktrace in IsolatedClientLoader

2016-04-20 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14783: --- Summary: Log full exception stacktrace in IsolatedClientLoader (was: Log full stacktrace in

[jira] [Created] (SPARK-14783) Log full stacktrace in IsolatedClientLoader

2016-04-20 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14783: -- Summary: Log full stacktrace in IsolatedClientLoader Key: SPARK-14783 URL: https://issues.apache.org/jira/browse/SPARK-14783 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-14782) Remove HiveConf dependency from HiveSqlParser

2016-04-20 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14782: --- Summary: Remove HiveConf dependency from HiveSqlParser Key: SPARK-14782 URL: https://issues.apache.org/jira/browse/SPARK-14782 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-14769) Create built-in functionality for variable substitution

2016-04-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14769. - Resolution: Fixed Fix Version/s: 2.0.0 > Create built-in functionality for variable

[jira] [Commented] (SPARK-14780) Add `setLogLevel` and `version` to SparkR

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250943#comment-15250943 ] Apache Spark commented on SPARK-14780: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-14780) Add `setLogLevel` and `version` to SparkR

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14780: Assignee: (was: Apache Spark) > Add `setLogLevel` and `version` to SparkR >

[jira] [Assigned] (SPARK-14780) Add `setLogLevel` and `version` to SparkR

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14780: Assignee: Apache Spark > Add `setLogLevel` and `version` to SparkR >

[jira] [Resolved] (SPARK-14770) Remove unused queries in hive module test resources

2016-04-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14770. - Resolution: Fixed Fix Version/s: 2.0.0 > Remove unused queries in hive module test

[jira] [Created] (SPARK-14781) Support subquery in nested predicates

2016-04-20 Thread Davies Liu (JIRA)
Davies Liu created SPARK-14781: -- Summary: Support subquery in nested predicates Key: SPARK-14781 URL: https://issues.apache.org/jira/browse/SPARK-14781 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-14779) Incorrect log message in Worker while handling KillExecutor message

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14779: Assignee: Apache Spark > Incorrect log message in Worker while handling KillExecutor

[jira] [Commented] (SPARK-14779) Incorrect log message in Worker while handling KillExecutor message

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250926#comment-15250926 ] Apache Spark commented on SPARK-14779: -- User 'BryanCutler' has created a pull request for this

[jira] [Commented] (SPARK-12468) getParamMap in Pyspark ML API returns empty dictionary in example for Documentation

2016-04-20 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250925#comment-15250925 ] Joseph K. Bradley commented on SPARK-12468: --- Thinking about this more, I think this is a

[jira] [Created] (SPARK-14780) Add `setLogLevel` and `version` to SparkR

2016-04-20 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-14780: - Summary: Add `setLogLevel` and `version` to SparkR Key: SPARK-14780 URL: https://issues.apache.org/jira/browse/SPARK-14780 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-14779) Incorrect log message in Worker while handling KillExecutor message

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14779: Assignee: (was: Apache Spark) > Incorrect log message in Worker while handling

[jira] [Closed] (SPARK-12468) getParamMap in Pyspark ML API returns empty dictionary in example for Documentation

2016-04-20 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-12468. - Resolution: Duplicate > getParamMap in Pyspark ML API returns empty dictionary in

[jira] [Created] (SPARK-14779) Incorrect log message in Worker while handling KillExecutor message

2016-04-20 Thread Bryan Cutler (JIRA)
Bryan Cutler created SPARK-14779: Summary: Incorrect log message in Worker while handling KillExecutor message Key: SPARK-14779 URL: https://issues.apache.org/jira/browse/SPARK-14779 Project: Spark

[jira] [Commented] (SPARK-14744) Put examples packaging on a diet

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250894#comment-15250894 ] Apache Spark commented on SPARK-14744: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14744) Put examples packaging on a diet

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14744: Assignee: Apache Spark > Put examples packaging on a diet >

[jira] [Assigned] (SPARK-14744) Put examples packaging on a diet

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14744: Assignee: (was: Apache Spark) > Put examples packaging on a diet >

[jira] [Commented] (SPARK-14760) Feature transformers should always invoke transformSchema in transform or fit

2016-04-20 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250887#comment-15250887 ] Joseph K. Bradley commented on SPARK-14760: --- transformSchema is there for schema validation

[jira] [Created] (SPARK-14778) Remove HiveSessionState.substitutor

2016-04-20 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14778: --- Summary: Remove HiveSessionState.substitutor Key: SPARK-14778 URL: https://issues.apache.org/jira/browse/SPARK-14778 Project: Spark Issue Type: Sub-task

[jira] [Closed] (SPARK-14740) CrossValidatorModel.bestModel does not include hyper-parameters

2016-04-20 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-14740. - Resolution: Duplicate Thanks for reporting this. I'm linking an existing issue which

[jira] [Assigned] (SPARK-14775) Remove TestHiveSparkSession.rewritePaths

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14775: Assignee: Apache Spark (was: Reynold Xin) > Remove TestHiveSparkSession.rewritePaths >

[jira] [Commented] (SPARK-14775) Remove TestHiveSparkSession.rewritePaths

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250877#comment-15250877 ] Apache Spark commented on SPARK-14775: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14775) Remove TestHiveSparkSession.rewritePaths

2016-04-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14775: Assignee: Reynold Xin (was: Apache Spark) > Remove TestHiveSparkSession.rewritePaths >

[jira] [Created] (SPARK-14777) Finally, merge HiveSqlAstBuilder and SparkSqlAstBuilder

2016-04-20 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-14777: --- Summary: Finally, merge HiveSqlAstBuilder and SparkSqlAstBuilder Key: SPARK-14777 URL: https://issues.apache.org/jira/browse/SPARK-14777 Project: Spark Issue

[jira] [Commented] (SPARK-14739) Vectors.parse doesn't handle dense vectors of size 0 and sparse vectors with no indices

2016-04-20 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15250878#comment-15250878 ] Joseph K. Bradley commented on SPARK-14739: --- Note this may be lower priority as we move linear

[jira] [Updated] (SPARK-14775) Remove TestHiveSparkSession.rewritePaths

2016-04-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14775: Description: The path rewrite in TestHiveSparkSession is pretty hacky. I think we can remove those

[jira] [Updated] (SPARK-14769) Create built-in functionality for variable substitution

2016-04-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14769: Issue Type: Sub-task (was: Bug) Parent: SPARK-14776 > Create built-in functionality for

  1   2   3   4   >