[jira] [Created] (SPARK-19333) Files out of compliance with ASF policy

John D. Ament created SPARK-19333: - Summary: Files out of compliance with ASF policy Key: SPARK-19333 URL: https://issues.apache.org/jira/browse/SPARK-19333 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-19289) UnCache Dataset using Name

[ https://issues.apache.org/jira/browse/SPARK-19289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833983#comment-15833983 ] Kaushal Prajapati commented on SPARK-19289: --- [~srowen], yes you are right, names are not

[jira] [Commented] (SPARK-19282) RandomForestRegressionModel should expose getMaxDepth

[ https://issues.apache.org/jira/browse/SPARK-19282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833973#comment-15833973 ] Xin Ren commented on SPARK-19282: - sorry Nick, now I cannot make it for this fix. anyone else please

[jira] [Commented] (SPARK-2306) BoundedPriorityQueue is private and not registered with Kryo

[ https://issues.apache.org/jira/browse/SPARK-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833928#comment-15833928 ] Apache Spark commented on SPARK-2306: - User 'bhardwajank' has created a pull request for this issue:

[jira] [Resolved] (SPARK-19309) disable common subexpression elimination for conditional expressions

[ https://issues.apache.org/jira/browse/SPARK-19309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19309. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16659

[jira] [Comment Edited] (SPARK-19328) using spark thrift server gets memory leak problem in `ExecutorsListener`

[ https://issues.apache.org/jira/browse/SPARK-19328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833925#comment-15833925 ] cen yuhai edited comment on SPARK-19328 at 1/23/17 5:27 AM: I think this is

[jira] [Commented] (SPARK-19328) using spark thrift server gets memory leak problem in `ExecutorsListener`

[ https://issues.apache.org/jira/browse/SPARK-19328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833925#comment-15833925 ] cen yuhai commented on SPARK-19328: --- I think this is fixed by SPARK-17406 > using spark thrift server

[jira] [Resolved] (SPARK-19229) Disallow Creating Hive Source Tables when Hive Support is Not Enabled

[ https://issues.apache.org/jira/browse/SPARK-19229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-19229. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16587

[jira] [Commented] (SPARK-19109) ORC metadata section can sometimes exceed protobuf message size limit

[ https://issues.apache.org/jira/browse/SPARK-19109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833870#comment-15833870 ] Hyukjin Kwon commented on SPARK-19109: -- It seems this JIRA describes upgrading the version of Hive

[jira] [Commented] (SPARK-19155) MLlib GeneralizedLinearRegression family and link should case insensitive

[ https://issues.apache.org/jira/browse/SPARK-19155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833850#comment-15833850 ] Apache Spark commented on SPARK-19155: -- User 'actuaryzhang' has created a pull request for this

[jira] [Commented] (SPARK-19328) using spark thrift server gets memory leak problem in `ExecutorsListener`

[ https://issues.apache.org/jira/browse/SPARK-19328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833802#comment-15833802 ] roncenzhao commented on SPARK-19328: [~srowen] In the heap dump file, it shows that the

[jira] [Commented] (SPARK-19076) Upgrade Hive dependence to Hive 2.x

[ https://issues.apache.org/jira/browse/SPARK-19076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833801#comment-15833801 ] Dongjoon Hyun commented on SPARK-19076: --- Hi, [~dapengsun]. It seems to be a subset of SPARK-13446

[jira] [Updated] (SPARK-19328) using spark thrift server gets memory leak problem in `ExecutorsListener`

[ https://issues.apache.org/jira/browse/SPARK-19328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] roncenzhao updated SPARK-19328: --- Attachment: screenshot-1.png > using spark thrift server gets memory leak problem in

[jira] [Updated] (SPARK-19322) Allow customizable column name in ScalaReflection.schemaFor

[ https://issues.apache.org/jira/browse/SPARK-19322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Liu updated SPARK-19322: Remaining Estimate: 24h Original Estimate: 24h > Allow customizable column name in

[jira] [Updated] (SPARK-19322) Allow customizable column name in ScalaReflection.schemaFor

[ https://issues.apache.org/jira/browse/SPARK-19322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Liu updated SPARK-19322: Description: When creating StructType using ScalaRelfection.schemaFor, the column names are defined by

[jira] [Closed] (SPARK-19308) Unable to write to Hive table where column names contains period (.)

[ https://issues.apache.org/jira/browse/SPARK-19308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maria Rebelka closed SPARK-19308. - Resolution: Fixed Fix Version/s: 2.2.0 > Unable to write to Hive table where column names

[jira] [Commented] (SPARK-19308) Unable to write to Hive table where column names contains period (.)

[ https://issues.apache.org/jira/browse/SPARK-19308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833657#comment-15833657 ] Maria Rebelka commented on SPARK-19308: --- Hi [~dongjoon], Indeed, fixed in 2.2.0-SNAPSHOT. Many

[jira] [Updated] (SPARK-19218) Fix SET command to show a result correctly and in a sorted order

[ https://issues.apache.org/jira/browse/SPARK-19218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-19218: -- Description: This issue aims to fix the following two things. 1. `sql("SET -v").collect()` or

[jira] [Updated] (SPARK-19218) Fix SET command to show a result correctly and in a sorted order

[ https://issues.apache.org/jira/browse/SPARK-19218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-19218: -- Summary: Fix SET command to show a result correctly and in a sorted order (was: SET command

[jira] [Commented] (SPARK-19288) Failure (at test_sparkSQL.R#1300): date functions on a DataFrame in R/run-tests.sh

[ https://issues.apache.org/jira/browse/SPARK-19288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833608#comment-15833608 ] Nirman Narang commented on SPARK-19288: --- [~felixcheung] I am using R version 3.2.3. Tested on

[jira] [Updated] (SPARK-19313) GaussianMixture throws cryptic error when number of features is too high

[ https://issues.apache.org/jira/browse/SPARK-19313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-19313: Shepherd: Yanbo Liang > GaussianMixture throws cryptic error when number of features is too high >

[jira] [Commented] (SPARK-19332) table's location should check if a URI is legal

[ https://issues.apache.org/jira/browse/SPARK-19332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833532#comment-15833532 ] Sean Owen commented on SPARK-19332: --- I don't see how this is separate from SPARK-19257. These should be

[jira] [Assigned] (SPARK-19331) Improve the test coverage of SQLViewSuite

[ https://issues.apache.org/jira/browse/SPARK-19331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19331: Assignee: (was: Apache Spark) > Improve the test coverage of SQLViewSuite >

[jira] [Commented] (SPARK-19331) Improve the test coverage of SQLViewSuite

[ https://issues.apache.org/jira/browse/SPARK-19331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833481#comment-15833481 ] Apache Spark commented on SPARK-19331: -- User 'jiangxb1987' has created a pull request for this

[jira] [Assigned] (SPARK-19331) Improve the test coverage of SQLViewSuite

[ https://issues.apache.org/jira/browse/SPARK-19331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19331: Assignee: Apache Spark > Improve the test coverage of SQLViewSuite >

[jira] [Created] (SPARK-19332) table's location should check if a URI is legal

Song Jun created SPARK-19332: Summary: table's location should check if a URI is legal Key: SPARK-19332 URL: https://issues.apache.org/jira/browse/SPARK-19332 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-19332) table's location should check if a URI is legal

[ https://issues.apache.org/jira/browse/SPARK-19332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Song Jun updated SPARK-19332: - Description: SPARK-19257 ‘s work is to change the type of `CatalogStorageFormat` 's locationUri to

[jira] [Created] (SPARK-19331) Improve the test coverage of SQLViewSuite

Jiang Xingbo created SPARK-19331: Summary: Improve the test coverage of SQLViewSuite Key: SPARK-19331 URL: https://issues.apache.org/jira/browse/SPARK-19331 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-19257) The type of CatalogStorageFormat.locationUri should be java.net.URI instead of String

[ https://issues.apache.org/jira/browse/SPARK-19257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832935#comment-15832935 ] Song Jun edited comment on SPARK-19257 at 1/22/17 11:22 AM: I found it that

[jira] [Commented] (SPARK-19323) Upgrade breeze to 0.13

[ https://issues.apache.org/jira/browse/SPARK-19323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833455#comment-15833455 ] Sean Owen commented on SPARK-19323: --- OK, while waiting, you'd need to investigate if there are breaking

[jira] [Commented] (SPARK-19264) Work should start driver, the same to AM of yarn

[ https://issues.apache.org/jira/browse/SPARK-19264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833451#comment-15833451 ] Sean Owen commented on SPARK-19264: --- I don't think the driver should terminate immediately if the main

[jira] [Commented] (SPARK-19214) Inconsistencies between DataFrame and Dataset APIs

[ https://issues.apache.org/jira/browse/SPARK-19214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833447#comment-15833447 ] Sean Owen commented on SPARK-19214: --- I'm pretty sure we would not change the naming here, even if it

[jira] [Resolved] (SPARK-19015) SQL request with transformation cannot be eecuted if not run first a scan table

[ https://issues.apache.org/jira/browse/SPARK-19015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19015. --- Resolution: Invalid > SQL request with transformation cannot be eecuted if not run first a scan >

[jira] [Commented] (SPARK-19328) using spark thrift server gets memory leak problem in `ExecutorsListener`

[ https://issues.apache.org/jira/browse/SPARK-19328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833440#comment-15833440 ] Sean Owen commented on SPARK-19328: --- Questions should probably start on the mailing list. What is

[jira] [Updated] (SPARK-19330) Also show tooltip for successful batches

[ https://issues.apache.org/jira/browse/SPARK-19330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-19330: -- Priority: Trivial (was: Major) > Also show tooltip for successful batches >

[jira] [Comment Edited] (SPARK-18563) mapWithState: initialState should have a timeout setting per record

[ https://issues.apache.org/jira/browse/SPARK-18563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833416#comment-15833416 ] Genmao Yu edited comment on SPARK-18563 at 1/22/17 9:35 AM: I do not know is

[jira] [Commented] (SPARK-18563) mapWithState: initialState should have a timeout setting per record

[ https://issues.apache.org/jira/browse/SPARK-18563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833416#comment-15833416 ] Genmao Yu commented on SPARK-18563: --- I do not know is there any plan to add new feature to DStreams?

[jira] [Commented] (SPARK-19330) Also show tooltip for successful batches

[ https://issues.apache.org/jira/browse/SPARK-19330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833415#comment-15833415 ] Apache Spark commented on SPARK-19330: -- User 'lw-lin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19330) Also show tooltip for successful batches

[ https://issues.apache.org/jira/browse/SPARK-19330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19330: Assignee: Apache Spark > Also show tooltip for successful batches >

[jira] [Assigned] (SPARK-19330) Also show tooltip for successful batches

[ https://issues.apache.org/jira/browse/SPARK-19330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19330: Assignee: (was: Apache Spark) > Also show tooltip for successful batches >

[jira] [Created] (SPARK-19330) Also show tooltip for successful batches

Liwei Lin created SPARK-19330: - Summary: Also show tooltip for successful batches Key: SPARK-19330 URL: https://issues.apache.org/jira/browse/SPARK-19330 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-19329) after alter a datasource table's location to a not exist location and then insert data throw Exception

[ https://issues.apache.org/jira/browse/SPARK-19329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19329: Assignee: (was: Apache Spark) > after alter a datasource table's location to a not

[jira] [Commented] (SPARK-19329) after alter a datasource table's location to a not exist location and then insert data throw Exception

[ https://issues.apache.org/jira/browse/SPARK-19329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833413#comment-15833413 ] Apache Spark commented on SPARK-19329: -- User 'windpiger' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19329) after alter a datasource table's location to a not exist location and then insert data throw Exception

[ https://issues.apache.org/jira/browse/SPARK-19329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19329: Assignee: Apache Spark > after alter a datasource table's location to a not exist

[jira] [Commented] (SPARK-18839) Executor is active on web, but actually is dead

[ https://issues.apache.org/jira/browse/SPARK-18839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833409#comment-15833409 ] Genmao Yu commented on SPARK-18839: --- Sorry, I do not think this is a bug. > Executor is active on web,

[jira] [Created] (SPARK-19329) after alter a datasource table's location to a not exist location and then insert data throw Exception

Song Jun created SPARK-19329: Summary: after alter a datasource table's location to a not exist location and then insert data throw Exception Key: SPARK-19329 URL: https://issues.apache.org/jira/browse/SPARK-19329

[jira] [Commented] (SPARK-18750) spark should be able to control the number of executor and should not throw stack overslow

[ https://issues.apache.org/jira/browse/SPARK-18750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833386#comment-15833386 ] Jelmer Kuperus commented on SPARK-18750: I am seeing the exact same issue when using dynamic

[jira] [Commented] (SPARK-18805) InternalMapWithStateDStream make java.lang.StackOverflowError

[ https://issues.apache.org/jira/browse/SPARK-18805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833377#comment-15833377 ] Genmao Yu commented on SPARK-18805: --- + 1 to {{That should be not an infinite loop. The time is

[jira] [Updated] (SPARK-19260) Spaces or "%20" in path parameter are not correctly handled with HistoryServer

[ https://issues.apache.org/jira/browse/SPARK-19260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-19260: Summary: Spaces or "%20" in path parameter are not correctly handled with HistoryServer (was:

[jira] [Updated] (SPARK-19260) Spaces in path parameter are not correctly handled with HistoryServer

[ https://issues.apache.org/jira/browse/SPARK-19260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-19260: Description: case1: .sbin/start-history-server.sh "file:/a b" And you get the error ===> Caused

[jira] [Commented] (SPARK-17436) dataframe.write sometimes does not keep sorting

[ https://issues.apache.org/jira/browse/SPARK-17436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833367#comment-15833367 ] Ran Haim commented on SPARK-17436: -- Hi, I did not actually use 2.1 yet - so I cannot be 100% sure. I can

[jira] [Comment Edited] (SPARK-19208) MultivariateOnlineSummarizer perfermence optimization

[ https://issues.apache.org/jira/browse/SPARK-19208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833345#comment-15833345 ] zhengruifeng edited comment on SPARK-19208 at 1/22/17 8:25 AM: --- After

[jira] [Created] (SPARK-19328) using spark thrift server gets memory leak problem in `ExecutorsListener`

roncenzhao created SPARK-19328: -- Summary: using spark thrift server gets memory leak problem in `ExecutorsListener` Key: SPARK-19328 URL: https://issues.apache.org/jira/browse/SPARK-19328 Project: Spark

[jira] [Comment Edited] (SPARK-19208) MultivariateOnlineSummarizer perfermence optimization

[ https://issues.apache.org/jira/browse/SPARK-19208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833345#comment-15833345 ] zhengruifeng edited comment on SPARK-19208 at 1/22/17 8:00 AM: --- After

[jira] [Comment Edited] (SPARK-19208) MultivariateOnlineSummarizer perfermence optimization

[ https://issues.apache.org/jira/browse/SPARK-19208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833345#comment-15833345 ] zhengruifeng edited comment on SPARK-19208 at 1/22/17 8:01 AM: --- After