[jira] [Commented] (SPARK-21101) Error running Hive temporary UDTF on latest Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-21101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16050041#comment-16050041 ] Sean Owen commented on SPARK-21101: --- [~dyzhou] did you read the link he posted? This do

[jira] [Commented] (SPARK-21104) Support sort with index when parse LibSVM Record

[ https://issues.apache.org/jira/browse/SPARK-21104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16050172#comment-16050172 ] Sean Owen commented on SPARK-21104: --- Doesn't the format dictate that it's sorted alread

[jira] [Updated] (SPARK-21105) Useless empty files in hive table

[ https://issues.apache.org/jira/browse/SPARK-21105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21105: -- Priority: Minor (was: Major) I'm not sure, but isn't that required? Not sure you can not output those

[jira] [Resolved] (SPARK-21106) compile error

[ https://issues.apache.org/jira/browse/SPARK-21106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21106. --- Resolution: Cannot Reproduce Fix Version/s: (was: 2.1.1) Target Version/s: (was

[jira] [Commented] (SPARK-21101) Error running Hive temporary UDTF on latest Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-21101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16050774#comment-16050774 ] Sean Owen commented on SPARK-21101: --- [~dyzhou] I see your reply. The thrift server shou

[jira] [Commented] (SPARK-21104) Support sort with index when parse LibSVM Record

[ https://issues.apache.org/jira/browse/SPARK-21104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16050850#comment-16050850 ] Sean Owen commented on SPARK-21104: --- I'm not sure what this is about. If the input isn'

[jira] [Comment Edited] (SPARK-21081) Throw specific IllegalStateException subtype when asserting that SparkContext not stopped

[ https://issues.apache.org/jira/browse/SPARK-21081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16050927#comment-16050927 ] Sean Owen edited comment on SPARK-21081 at 6/15/17 6:39 PM: [

[jira] [Commented] (SPARK-21081) Throw specific IllegalStateException subtype when asserting that SparkContext not stopped

[ https://issues.apache.org/jira/browse/SPARK-21081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16050927#comment-16050927 ] Sean Owen commented on SPARK-21081: --- [~fzhinkin] when isn't it possible? you can {{ cat

[jira] [Commented] (SPARK-21116) Support MapKeyContains function

[ https://issues.apache.org/jira/browse/SPARK-21116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051546#comment-16051546 ] Sean Owen commented on SPARK-21116: --- There's no context, justification or detail here.

[jira] [Resolved] (SPARK-21104) Support sort with index when parse LibSVM Record

[ https://issues.apache.org/jira/browse/SPARK-21104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21104. --- Resolution: Invalid It's still not clear what you are suggesting here. If you can provide a specific

[jira] [Resolved] (SPARK-21118) OOM with 2 handred million vertex when mitrx multply

[ https://issues.apache.org/jira/browse/SPARK-21118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21118. --- Resolution: Invalid It's not clear what you're describing, but it sounds like something to try again

[jira] [Resolved] (SPARK-21077) Cannot access public files over S3 protocol

[ https://issues.apache.org/jira/browse/SPARK-21077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21077. --- Resolution: Not A Problem > Cannot access public files over S3 protocol > ---

[jira] [Closed] (SPARK-21118) OOM with 2 handred million vertex when mitrx multply

[ https://issues.apache.org/jira/browse/SPARK-21118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-21118. - > OOM with 2 handred million vertex when mitrx multply >

[jira] [Resolved] (SPARK-21118) OOM with 2 handred million vertex when mitrx multply

[ https://issues.apache.org/jira/browse/SPARK-21118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21118. --- Resolution: Invalid [~icesxrun] do not reopen this. This doesn't describe a problem with Spark, but

[jira] [Commented] (SPARK-21120) Increasing the master's metric is conducive to the spark cluster management system monitoring.

[ https://issues.apache.org/jira/browse/SPARK-21120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16051699#comment-16051699 ] Sean Owen commented on SPARK-21120: --- There's no detail about the motivation here. Pleas

[jira] [Resolved] (SPARK-12606) Scala/Java compatibility issue Re: how to extend java transformer from Scala UnaryTransformer ?

[ https://issues.apache.org/jira/browse/SPARK-12606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12606. --- Resolution: Invalid This wasn't really a well-formed JIRA to begin with. [~ihachani] I don't think th

[jira] [Updated] (SPARK-21054) Reset Command support reset specific property which is compatible with Hive

[ https://issues.apache.org/jira/browse/SPARK-21054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21054: -- Fix Version/s: (was: 2.1.1) > Reset Command support reset specific property which is compatible wit

[jira] [Updated] (SPARK-21054) Reset Command support reset specific property which is compatible with Hive

[ https://issues.apache.org/jira/browse/SPARK-21054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21054: -- Target Version/s: (was: 2.1.1) > Reset Command support reset specific property which is compatible wi

[jira] [Updated] (SPARK-11083) insert overwrite table failed when beeline reconnect

[ https://issues.apache.org/jira/browse/SPARK-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11083: -- Fix Version/s: (was: 1.6.0) > insert overwrite table failed when beeline reconnect > --

[jira] [Commented] (SPARK-21122) Address starvation issues when dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-21122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16052199#comment-16052199 ] Sean Owen commented on SPARK-21122: --- How is this different from https://issues.apache.o

[jira] [Updated] (SPARK-21126) The configuration which named "spark.core.connection.auth.wait.timeout" hasn't been used in spark

[ https://issues.apache.org/jira/browse/SPARK-21126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21126: -- Priority: Trivial (was: Major) Component/s: Documentation [~liuzhaokun] please fill out JIRAs m

[jira] [Resolved] (SPARK-21081) Throw specific IllegalStateException subtype when asserting that SparkContext not stopped

[ https://issues.apache.org/jira/browse/SPARK-21081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21081. --- Resolution: Won't Fix > Throw specific IllegalStateException subtype when asserting that SparkContext

[jira] [Resolved] (SPARK-21120) Increasing the master's metric is conducive to the spark cluster management system monitoring.

[ https://issues.apache.org/jira/browse/SPARK-21120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21120. --- Resolution: Invalid > Increasing the master's metric is conducive to the spark cluster management >

[jira] [Resolved] (SPARK-21058) potential SVD optimization

[ https://issues.apache.org/jira/browse/SPARK-21058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21058. --- Resolution: Not A Problem If there's a specific optimization for large, sparse matrices to discuss, I

[jira] [Commented] (SPARK-21122) Address starvation issues when dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-21122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16052729#comment-16052729 ] Sean Owen commented on SPARK-21122: --- Yes, resource managers don't know which resource y

[jira] [Resolved] (SPARK-21126) The configuration which named "spark.core.connection.auth.wait.timeout" hasn't been used in spark

[ https://issues.apache.org/jira/browse/SPARK-21126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21126. --- Resolution: Fixed Fix Version/s: 2.2.1 Issue resolved by pull request 18333 [https://github.co

[jira] [Assigned] (SPARK-21126) The configuration which named "spark.core.connection.auth.wait.timeout" hasn't been used in spark

[ https://issues.apache.org/jira/browse/SPARK-21126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-21126: - Assignee: liuzhaokun > The configuration which named "spark.core.connection.auth.wait.timeout"

[jira] [Updated] (SPARK-21125) PySpark context missing function to set Job Description.

[ https://issues.apache.org/jira/browse/SPARK-21125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21125: -- Target Version/s: (was: 2.2.0) Fix Version/s: (was: 2.2.0) Issue Type: Improvemen

[jira] [Commented] (SPARK-18267) Distribute PySpark via Python Package Index (pypi)

[ https://issues.apache.org/jira/browse/SPARK-18267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16053253#comment-16053253 ] Sean Owen commented on SPARK-18267: --- [~holdenk] is all of this basically done? for 2.2?

[jira] [Updated] (SPARK-20520) R streaming tests failed on Windows

[ https://issues.apache.org/jira/browse/SPARK-20520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20520: -- Affects Version/s: 2.1.1 Target Version/s: (was: 2.2.0) > R streaming tests failed on Windows >

[jira] [Updated] (SPARK-15799) Release SparkR on CRAN

[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15799: -- Target Version/s: (was: 2.2.0) > Release SparkR on CRAN > -- > >

[jira] [Resolved] (SPARK-20896) spark executor get java.lang.ClassCastException when trigger two job at same time

[ https://issues.apache.org/jira/browse/SPARK-20896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20896. --- Resolution: Not A Problem Fix Version/s: (was: 1.6.4) Target Version/s: (was: 1

[jira] [Reopened] (SPARK-20896) spark executor get java.lang.ClassCastException when trigger two job at same time

[ https://issues.apache.org/jira/browse/SPARK-20896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-20896: --- > spark executor get java.lang.ClassCastException when trigger two job at same > time >

[jira] [Resolved] (SPARK-21109) union two dataset[A] don't work as expected if one of the datasets is originated from a dataframe

[ https://issues.apache.org/jira/browse/SPARK-21109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21109. --- Resolution: Not A Problem > union two dataset[A] don't work as expected if one of the datasets is >

[jira] [Resolved] (SPARK-18934) Writing to dynamic partitions does not preserve sort order if spill occurs

[ https://issues.apache.org/jira/browse/SPARK-18934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18934. --- Resolution: Not A Problem > Writing to dynamic partitions does not preserve sort order if spill occur

[jira] [Resolved] (SPARK-8674) 2-sample, 2-sided Kolmogorov Smirnov Test

[ https://issues.apache.org/jira/browse/SPARK-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8674. -- Resolution: Won't Fix > 2-sample, 2-sided Kolmogorov Smirnov Test >

[jira] [Resolved] (SPARK-21137) Spark cannot read many small files (wholeTextFiles)

[ https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21137. --- Resolution: Invalid This is a question for the mailing list, not JIRA. It's not clear you're actually

[jira] [Resolved] (SPARK-21137) Spark cannot read many small files (wholeTextFiles)

[ https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21137. --- Resolution: Invalid Don't reopen this please. Someone will do that if it's appropriate. This still d

[jira] [Closed] (SPARK-21137) Spark cannot read many small files (wholeTextFiles)

[ https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-21137. - > Spark cannot read many small files (wholeTextFiles) > --- >

[jira] [Commented] (SPARK-21137) Spark cannot read many small files (wholeTextFiles)

[ https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16053820#comment-16053820 ] Sean Owen commented on SPARK-21137: --- Here's a hint, or example of what could be going w

[jira] [Commented] (SPARK-21139) java.util.concurrent.RejectedExecutionException: rejected from java.util.concurrent.ThreadPoolExecutor@46477dd0[Terminated, pool size = 0, active threads = 0, queued t

[ https://issues.apache.org/jira/browse/SPARK-21139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16053911#comment-16053911 ] Sean Owen commented on SPARK-21139: --- That looks like an issue from the HBase client, no

[jira] [Resolved] (SPARK-21140) Reduce collect high memory requrements

[ https://issues.apache.org/jira/browse/SPARK-21140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21140. --- Resolution: Invalid There's no real detail here. Executor memory doesn't directly matter to how much

[jira] [Resolved] (SPARK-21141) spark-update --version is hard to parse

[ https://issues.apache.org/jira/browse/SPARK-21141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21141. --- Resolution: Not A Problem There is no spark-update. It is not intended as an API to determine the ver

[jira] [Commented] (SPARK-21137) Spark cannot read many small files (wholeTextFiles)

[ https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16054004#comment-16054004 ] Sean Owen commented on SPARK-21137: --- As i say, you're not setting anything about the pa

[jira] [Commented] (SPARK-21137) Spark cannot read many small files (wholeTextFiles)

[ https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16054042#comment-16054042 ] Sean Owen commented on SPARK-21137: --- Are you sure it's not just appearing to be stuck r

[jira] [Comment Edited] (SPARK-21140) Reduce collect high memory requrements

[ https://issues.apache.org/jira/browse/SPARK-21140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16054043#comment-16054043 ] Sean Owen edited comment on SPARK-21140 at 6/19/17 2:02 PM: I

[jira] [Commented] (SPARK-21140) Reduce collect high memory requrements

[ https://issues.apache.org/jira/browse/SPARK-21140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16054055#comment-16054055 ] Sean Owen commented on SPARK-21140: --- Yes, it's possible the executor makes a copy of so

[jira] [Resolved] (SPARK-21141) spark-update --version is hard to parse

[ https://issues.apache.org/jira/browse/SPARK-21141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21141. --- Resolution: Not A Problem [~mprocop] please don't reopen JIRAs. We can reopen if needed. As I say, I

[jira] [Commented] (SPARK-21137) Spark cannot read many small files (wholeTextFiles)

[ https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16054115#comment-16054115 ] Sean Owen commented on SPARK-21137: --- Try a thread dump on the driver. Until there's som

[jira] [Resolved] (SPARK-17176) Task are sorted by "Index" in Stage Page.

[ https://issues.apache.org/jira/browse/SPARK-17176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17176. --- Resolution: Won't Fix > Task are sorted by "Index" in Stage Page. > -

[jira] [Commented] (SPARK-21143) Fail to fetch blocks >1MB in size in presence of conflicting Netty version

[ https://issues.apache.org/jira/browse/SPARK-21143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16054631#comment-16054631 ] Sean Owen commented on SPARK-21143: --- If this reduces to a 4.0 vs 4.1 conflict, then thi

[jira] [Resolved] (SPARK-21151) Maven release error - Spark 2.0.2 with scala 2.10 version

[ https://issues.apache.org/jira/browse/SPARK-21151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21151. --- Resolution: Not A Problem Fix Version/s: (was: 2.0.2) Please read http://spark.apache.org/

[jira] [Updated] (SPARK-21155) Add (? running tasks) into Spark UI progress

[ https://issues.apache.org/jira/browse/SPARK-21155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21155: -- Target Version/s: (was: 2.3.0) Fix Version/s: (was: 2.3.0) Don't set target / fix version.

[jira] [Updated] (SPARK-20466) HadoopRDD#addLocalConfiguration throws NPE

[ https://issues.apache.org/jira/browse/SPARK-20466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-20466: -- Priority: Minor (was: Major) Hm, I think the question is how the JobConf is ever null here. I think ad

[jira] [Commented] (SPARK-21161) SparkContext stopped when execute a query on Solr

[ https://issues.apache.org/jira/browse/SPARK-21161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057564#comment-16057564 ] Sean Owen commented on SPARK-21161: --- Yes, that's not a valid host/port. No, you can't j

[jira] [Commented] (SPARK-21137) Spark cannot read many small files (wholeTextFiles)

[ https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057565#comment-16057565 ] Sean Owen commented on SPARK-21137: --- [~leakimav] -- there still isn't detail here about

[jira] [Commented] (SPARK-21137) Spark cannot read many small files (wholeTextFiles)

[ https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16057605#comment-16057605 ] Sean Owen commented on SPARK-21137: --- (This is not a common use case) What change are y

[jira] [Resolved] (SPARK-21082) Consider Executor's memory usage when scheduling task

[ https://issues.apache.org/jira/browse/SPARK-21082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21082. --- Resolution: Won't Fix > Consider Executor's memory usage when scheduling task >

[jira] [Commented] (SPARK-21080) Workaround for HDFS delegation token expiry broken with some Hadoop versions

[ https://issues.apache.org/jira/browse/SPARK-21080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16058985#comment-16058985 ] Sean Owen commented on SPARK-21080: --- This really isn't my area; maybe [~vanzin]? > Wor

[jira] [Resolved] (SPARK-21173) There are several configuration about SSL displayed in configuration.md but never be used.

[ https://issues.apache.org/jira/browse/SPARK-21173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21173. --- Resolution: Not A Problem > There are several configuration about SSL displayed in configuration.md b

[jira] [Resolved] (SPARK-21161) SparkContext stopped when execute a query on Solr

[ https://issues.apache.org/jira/browse/SPARK-21161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21161. --- Resolution: Not A Problem > SparkContext stopped when execute a query on Solr > -

[jira] [Commented] (SPARK-21171) Speculate task scheduling block dirve handle normal task when a job task number more than one hundred thousand

[ https://issues.apache.org/jira/browse/SPARK-21171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16059018#comment-16059018 ] Sean Owen commented on SPARK-21171: --- There's no real detail here. I'd have to close thi

[jira] [Resolved] (SPARK-21080) Workaround for HDFS delegation token expiry broken with some Hadoop versions

[ https://issues.apache.org/jira/browse/SPARK-21080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21080. --- Resolution: Not A Problem > Workaround for HDFS delegation token expiry broken with some Hadoop versi

[jira] [Commented] (SPARK-14220) Build and test Spark against Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16060545#comment-16060545 ] Sean Owen commented on SPARK-14220: --- I have a branch locally for 2.12. That much isn't

[jira] [Resolved] (SPARK-21171) Speculate task scheduling block dirve handle normal task when a job task number more than one hundred thousand

[ https://issues.apache.org/jira/browse/SPARK-21171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21171. --- Resolution: Invalid > Speculate task scheduling block dirve handle normal task when a job task > num

[jira] [Commented] (SPARK-21183) Unable to return Google BigQuery INTEGER data type into Spark via google BigQuery JDBC driver: java.sql.SQLDataException: [Simba][JDBC](10140) Error converting value t

[ https://issues.apache.org/jira/browse/SPARK-21183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16060557#comment-16060557 ] Sean Owen commented on SPARK-21183: --- I'm not clear this is a Spark problem. What's the

[jira] [Commented] (SPARK-19726) Faild to insert null timestamp value to mysql using spark jdbc

[ https://issues.apache.org/jira/browse/SPARK-19726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16060562#comment-16060562 ] Sean Owen commented on SPARK-19726: --- I'm not sure this is a Spark problem. You're tryin

[jira] [Resolved] (SPARK-21185) Spurious errors in unidoc causing PRs to fail

[ https://issues.apache.org/jira/browse/SPARK-21185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21185. --- Resolution: Duplicate Yes, the underlying issue is that javadoc 8 is stricter. We have a few issues

[jira] [Commented] (SPARK-21191) DataFrame Row StructType check duplicate name

[ https://issues.apache.org/jira/browse/SPARK-21191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16060629#comment-16060629 ] Sean Owen commented on SPARK-21191: --- What is the issue? You have the cold duplicate nam

[jira] [Resolved] (SPARK-21191) DataFrame Row StructType check duplicate name

[ https://issues.apache.org/jira/browse/SPARK-21191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21191. --- Resolution: Duplicate > DataFrame Row StructType check duplicate name > -

[jira] [Commented] (SPARK-21184) QuantileSummaries implementation is wrong and QuantileSummariesSuite fails with larger n

[ https://issues.apache.org/jira/browse/SPARK-21184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16060741#comment-16060741 ] Sean Owen commented on SPARK-21184: --- [~timhunter] [~clockfly] do you have opinions on t

[jira] [Reopened] (SPARK-21137) Spark reads many small files slowly

[ https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-21137: --- > Spark reads many small files slowly > --- > > Key: SPAR

[jira] [Updated] (SPARK-21137) Spark reads many small files slowly

[ https://issues.apache.org/jira/browse/SPARK-21137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21137: -- Affects Version/s: (was: 2.2.1) 2.1.1 Priority: Minor (was: Maj

[jira] [Commented] (SPARK-21198) SparkSession catalog is terribly slow

[ https://issues.apache.org/jira/browse/SPARK-21198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061871#comment-16061871 ] Sean Owen commented on SPARK-21198: --- "This is slow" generally isn't an actionable JIRA.

[jira] [Resolved] (SPARK-21189) Handle unknown error codes in Jenkins rather then leaving incomplete comment in PRs

[ https://issues.apache.org/jira/browse/SPARK-21189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21189. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18399 [https://github.co

[jira] [Assigned] (SPARK-21189) Handle unknown error codes in Jenkins rather then leaving incomplete comment in PRs

[ https://issues.apache.org/jira/browse/SPARK-21189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-21189: - Assignee: Hyukjin Kwon Priority: Trivial (was: Major) > Handle unknown error codes in Jenki

[jira] [Resolved] (SPARK-21201) SparkSQL Load data inpath into table tableName, file is moved

[ https://issues.apache.org/jira/browse/SPARK-21201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21201. --- Resolution: Invalid You need a lot more detail here, but, this does not belong on JIRA either. The m

[jira] [Commented] (SPARK-21197) Tricky use case makes dead application struggle for a long duration

[ https://issues.apache.org/jira/browse/SPARK-21197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061873#comment-16061873 ] Sean Owen commented on SPARK-21197: --- Isn't that an application problem? it failed to st

[jira] [Resolved] (SPARK-21200) Spark REST API is not working or Spark documentation is wrong.

[ https://issues.apache.org/jira/browse/SPARK-21200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21200. --- Resolution: Invalid > Spark REST API is not working or Spark documentation is wrong. > --

[jira] [Resolved] (SPARK-20428) REST interface about 'v1/submissions/ kill/', currently only supports delete a single ‘driver’, now let spark support delete some ‘drivers’

[ https://issues.apache.org/jira/browse/SPARK-20428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20428. --- Resolution: Not A Problem > REST interface about 'v1/submissions/ kill/', currently only supports del

[jira] [Resolved] (SPARK-21202) Assignment operator ==== working, But equalTo is throw with error

[ https://issues.apache.org/jira/browse/SPARK-21202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21202. --- Resolution: Invalid This should be addressed on SO. Please don't copy here > Assignment operator ===

[jira] [Commented] (SPARK-21200) Spark REST API is not working or Spark documentation is wrong.

[ https://issues.apache.org/jira/browse/SPARK-21200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16061979#comment-16061979 ] Sean Owen commented on SPARK-21200: --- There isn't detail about actual vs expected here a

[jira] [Updated] (SPARK-21168) KafkaRDD should always set kafka clientId.

[ https://issues.apache.org/jira/browse/SPARK-21168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21168: -- Target Version/s: (was: 2.0.2) > KafkaRDD should always set kafka clientId. > ---

[jira] [Updated] (SPARK-18267) Distribute PySpark via Python Package Index (pypi)

[ https://issues.apache.org/jira/browse/SPARK-18267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18267: -- Target Version/s: (was: 2.2.0) > Distribute PySpark via Python Package Index (pypi) > ---

[jira] [Commented] (SPARK-21206) the window slice of Dstream is wrong

[ https://issues.apache.org/jira/browse/SPARK-21206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16062276#comment-16062276 ] Sean Owen commented on SPARK-21206: --- I'm not clear what you are reporting here. What's

[jira] [Resolved] (SPARK-21207) ML/MLLIB Save Word2Vec Yarn Cluster

[ https://issues.apache.org/jira/browse/SPARK-21207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21207. --- Resolution: Invalid Target Version/s: (was: 2.0.1) Questions go on the mailing list, like

[jira] [Resolved] (SPARK-11057) SQL: corr and cov for many columns

[ https://issues.apache.org/jira/browse/SPARK-11057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11057. --- Resolution: Won't Fix > SQL: corr and cov for many columns > -- > >

[jira] [Resolved] (SPARK-10796) The Stage taskSets may are all removed while stage still have pending partitions after having lost some executors

[ https://issues.apache.org/jira/browse/SPARK-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10796. --- Resolution: Won't Fix > The Stage taskSets may are all removed while stage still have pending > part

[jira] [Resolved] (SPARK-12948) Consider reducing size of broadcasts in OrcRelation

[ https://issues.apache.org/jira/browse/SPARK-12948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12948. --- Resolution: Won't Fix > Consider reducing size of broadcasts in OrcRelation > ---

[jira] [Resolved] (SPARK-15763) Add DELETE FILE command support in spark

[ https://issues.apache.org/jira/browse/SPARK-15763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15763. --- Resolution: Won't Fix > Add DELETE FILE command support in spark > --

[jira] [Resolved] (SPARK-19869) move table related ddl from ddl.scala to tables.scala

[ https://issues.apache.org/jira/browse/SPARK-19869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19869. --- Resolution: Won't Fix > move table related ddl from ddl.scala to tables.scala > -

[jira] [Resolved] (SPARK-20413) New Optimizer Hint to prevent collapsing of adjacent projections

[ https://issues.apache.org/jira/browse/SPARK-20413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20413. --- Resolution: Won't Fix > New Optimizer Hint to prevent collapsing of adjacent projections > --

[jira] [Resolved] (SPARK-20115) Fix DAGScheduler to recompute all the lost shuffle blocks when external shuffle service is unavailable

[ https://issues.apache.org/jira/browse/SPARK-20115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20115. --- Resolution: Won't Fix > Fix DAGScheduler to recompute all the lost shuffle blocks when external > sh

[jira] [Resolved] (SPARK-21169) Spark HA: Jobs state is in WAITING status after reconnecting to standby master

[ https://issues.apache.org/jira/browse/SPARK-21169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21169. --- Resolution: Duplicate > Spark HA: Jobs state is in WAITING status after reconnecting to standby maste

[jira] [Commented] (SPARK-21212) Can't use Count(*) with Order Clause

[ https://issues.apache.org/jira/browse/SPARK-21212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063376#comment-16063376 ] Sean Owen commented on SPARK-21212: --- You don't define 'value' anywhere, as it says. >

[jira] [Commented] (SPARK-21183) Unable to return Google BigQuery INTEGER data type into Spark via google BigQuery JDBC driver: java.sql.SQLDataException: [Simba][JDBC](10140) Error converting value t

[ https://issues.apache.org/jira/browse/SPARK-21183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063387#comment-16063387 ] Sean Owen commented on SPARK-21183: --- This looks like an error from simba, not Spark? >

[jira] [Commented] (SPARK-21183) Unable to return Google BigQuery INTEGER data type into Spark via google BigQuery JDBC driver: java.sql.SQLDataException: [Simba][JDBC](10140) Error converting value t

[ https://issues.apache.org/jira/browse/SPARK-21183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063428#comment-16063428 ] Sean Owen commented on SPARK-21183: --- I'm not sure that follows, but I don't know either

[jira] [Resolved] (SPARK-21214) Exception in thread "main" org.apache.spark.sql.AnalysisException: cannot resolve '

[ https://issues.apache.org/jira/browse/SPARK-21214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21214. --- Resolution: Invalid This should be a question on the mailing list. > Exception in thread "main" org

[jira] [Resolved] (SPARK-21215) Exception in thread "main" org.apache.spark.sql.AnalysisException: cannot resolve

[ https://issues.apache.org/jira/browse/SPARK-21215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21215. --- Resolution: Duplicate > Exception in thread "main" org.apache.spark.sql.AnalysisException: cannot >

[jira] [Commented] (SPARK-21212) Can't use Count(*) with Order Clause

[ https://issues.apache.org/jira/browse/SPARK-21212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16063915#comment-16063915 ] Sean Owen commented on SPARK-21212: --- Yes, but this doesn't work unless you say what 'va

  1   2   3   4   5   6   7   8   9   10   >