[
https://issues.apache.org/jira/browse/SPARK-22254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-22254.
-
Resolution: Fixed
Fix Version/s: 2.3.0
> clean up the implementation of `growToSize` in CompactBuf
[
https://issues.apache.org/jira/browse/SPARK-22254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reassigned SPARK-22254:
---
Assignee: Kazuaki Ishizaki
> clean up the implementation of `growToSize` in CompactBuffer
>
[
https://issues.apache.org/jira/browse/SPARK-22418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-22418.
-
Resolution: Fixed
Fix Version/s: 2.3.0
> Add test cases for NULL Handling
> --
[
https://issues.apache.org/jira/browse/SPARK-22418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li reassigned SPARK-22418:
---
Assignee: Marco Gaido
> Add test cases for NULL Handling
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-22436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238712#comment-16238712
]
Eric Maynard commented on SPARK-22436:
--
[~asmaier] Wouldn't the right way to impleme
[
https://issues.apache.org/jira/browse/SPARK-22446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Greg Bellchambers updated SPARK-22446:
--
Summary: Optimizer causing StringIndexerModel's indexer UDF to throw
"Unseen label" exc
[
https://issues.apache.org/jira/browse/SPARK-22446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Greg Bellchambers updated SPARK-22446:
--
Description:
In the following, the `indexer` UDF defined inside the
`org.apache.spark.
Greg Bellchambers created SPARK-22446:
-
Summary: Optimizer causing StringIndexer's indexer UDF to throw
"Unseen label" exception incorrectly for filtered data.
Key: SPARK-22446
URL: https://issues.apache.org/j
[
https://issues.apache.org/jira/browse/SPARK-22445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22445:
Assignee: Wenchen Fan (was: Apache Spark)
> move CodegenContext.copyResult to CodegenSupp
[
https://issues.apache.org/jira/browse/SPARK-22445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22445:
Assignee: Apache Spark (was: Wenchen Fan)
> move CodegenContext.copyResult to CodegenSupp
[
https://issues.apache.org/jira/browse/SPARK-22441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238628#comment-16238628
]
Tor Myklebust edited comment on SPARK-22441 at 11/4/17 12:28 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-22445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238635#comment-16238635
]
Apache Spark commented on SPARK-22445:
--
User 'cloud-fan' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-22441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238628#comment-16238628
]
Tor Myklebust commented on SPARK-22441:
---
I wrote this code a while ago, but I don't
Wenchen Fan created SPARK-22445:
---
Summary: move CodegenContext.copyResult to CodegenSupport
Key: SPARK-22445
URL: https://issues.apache.org/jira/browse/SPARK-22445
Project: Spark
Issue Type: Im
[
https://issues.apache.org/jira/browse/SPARK-22444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238615#comment-16238615
]
Apache Spark commented on SPARK-22444:
--
User 'ambud' has created a pull request for
[
https://issues.apache.org/jira/browse/SPARK-22444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-22444.
Resolution: Won't Fix
Fix Version/s: (was: 1.6.4)
Features like this are not gen
Ambud Sharma created SPARK-22444:
Summary: Spark History Server missing /environment endpoint/api
Key: SPARK-22444
URL: https://issues.apache.org/jira/browse/SPARK-22444
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-22443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238482#comment-16238482
]
Sean Owen commented on SPARK-22443:
---
Good catch. I suppose that this and getTableExists
[
https://issues.apache.org/jira/browse/SPARK-22443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hongbo updated SPARK-22443:
---
Summary: AggregatedDialect doesn't override quoteIdentifier and other
methods in JdbcDialects (was: Aggregat
Hongbo created SPARK-22443:
--
Summary: AggregatedDialect doesn't work for quoteIdentifier
Key: SPARK-22443
URL: https://issues.apache.org/jira/browse/SPARK-22443
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238409#comment-16238409
]
Harry Weppner commented on SPARK-14703:
---
[~happy15sheng] I've discovered that {{log
[
https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mikel San Vicente updated SPARK-22442:
--
Description:
Product encoder encodes special characters wrongly when field name contain
[
https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mikel San Vicente updated SPARK-22442:
--
Description:
Product encoder encodes special characters wrongly when field name contain
[
https://issues.apache.org/jira/browse/SPARK-22442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mikel San Vicente updated SPARK-22442:
--
Description:
Product encoder encodes special characters wrongly when field name contain
Mikel San Vicente created SPARK-22442:
-
Summary: Schema generated by Product Encoder doesn't match case
class field name when using non-standard characters
Key: SPARK-22442
URL: https://issues.apache.org/jira/
[
https://issues.apache.org/jira/browse/SPARK-22441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238313#comment-16238313
]
Sean Owen commented on SPARK-22441:
---
You have a point. In the same file, the reverse ma
Hongbo created SPARK-22441:
--
Summary: JDBC REAL type is mapped to Double instead of Float
Key: SPARK-22441
URL: https://issues.apache.org/jira/browse/SPARK-22441
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-22211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238281#comment-16238281
]
Henry Robinson commented on SPARK-22211:
Sounds good, thanks both.
> LimitPushDo
[
https://issues.apache.org/jira/browse/SPARK-22440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238241#comment-16238241
]
Marco Gaido commented on SPARK-22440:
-
Honestly I don't know what people are using fo
[
https://issues.apache.org/jira/browse/SPARK-22424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238202#comment-16238202
]
Sean Owen commented on SPARK-22424:
---
Yes, but how is that related to the tasks you are
[
https://issues.apache.org/jira/browse/SPARK-22440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238179#comment-16238179
]
Sean Owen commented on SPARK-22440:
---
I had honestly never heard of this. Is this widely
[
https://issues.apache.org/jira/browse/SPARK-22433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238150#comment-16238150
]
Sean Owen commented on SPARK-22433:
---
Yeah, R^2 _could_ be used as a metric but it belon
[
https://issues.apache.org/jira/browse/SPARK-22433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238137#comment-16238137
]
Seth Hendrickson commented on SPARK-22433:
--
The main problem I see is that we pu
[
https://issues.apache.org/jira/browse/SPARK-22440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238095#comment-16238095
]
Marco Gaido commented on SPARK-22440:
-
I am preparing an implementation for this. It
Marco Gaido created SPARK-22440:
---
Summary: Add Calinski-Harabasz index to ClusteringEvaluator
Key: SPARK-22440
URL: https://issues.apache.org/jira/browse/SPARK-22440
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-22433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237884#comment-16237884
]
Teng Peng commented on SPARK-22433:
---
Thanks for the quick response, Sean. I am glad thi
[
https://issues.apache.org/jira/browse/SPARK-22433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237830#comment-16237830
]
Sean Owen commented on SPARK-22433:
---
I think one misunderstanding here is that you need
[
https://issues.apache.org/jira/browse/SPARK-22211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237825#comment-16237825
]
Xiao Li commented on SPARK-22211:
-
We should merge it to the master and the previous rele
[
https://issues.apache.org/jira/browse/SPARK-22211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237822#comment-16237822
]
Sean Owen commented on SPARK-22211:
---
In the name of correctness, still worth disabling
[
https://issues.apache.org/jira/browse/SPARK-22211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237797#comment-16237797
]
Xiao Li commented on SPARK-22211:
-
The Join operator should be limit aware. Anyway, we ca
[
https://issues.apache.org/jira/browse/SPARK-22211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237778#comment-16237778
]
Henry Robinson commented on SPARK-22211:
[~smilegator] - sounds good! What will y
[
https://issues.apache.org/jira/browse/SPARK-22417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22417:
Assignee: (was: Apache Spark)
> createDataFrame from a pandas.DataFrame reads datetime
[
https://issues.apache.org/jira/browse/SPARK-22433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237774#comment-16237774
]
Teng Peng commented on SPARK-22433:
---
What I agree with you: be coherent, and we prefer
[
https://issues.apache.org/jira/browse/SPARK-22417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22417:
Assignee: Apache Spark
> createDataFrame from a pandas.DataFrame reads datetime64 values a
[
https://issues.apache.org/jira/browse/SPARK-22147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237775#comment-16237775
]
Bryan Cutler commented on SPARK-22147:
--
Sorry, I linked the above PR to this JIRA ac
[
https://issues.apache.org/jira/browse/SPARK-22417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237772#comment-16237772
]
Apache Spark commented on SPARK-22417:
--
User 'BryanCutler' has created a pull reques
[
https://issues.apache.org/jira/browse/SPARK-22426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237769#comment-16237769
]
Prabhu Joseph commented on SPARK-22426:
---
Thanks [~jerryshao], we can close this as
[
https://issues.apache.org/jira/browse/SPARK-22437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237733#comment-16237733
]
Adrian Bridgett commented on SPARK-22437:
-
good grief that was fast!
> jdbc writ
[
https://issues.apache.org/jira/browse/SPARK-21866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237731#comment-16237731
]
Timothy Hunter commented on SPARK-21866:
Adding {{spark.read.image}} is going to
[
https://issues.apache.org/jira/browse/SPARK-22430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237719#comment-16237719
]
Felix Cheung commented on SPARK-22430:
--
I am seeing it too. I think we can just remo
[
https://issues.apache.org/jira/browse/SPARK-22437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22437:
Assignee: (was: Apache Spark)
> jdbc write fails to set default mode
> ---
[
https://issues.apache.org/jira/browse/SPARK-22437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237716#comment-16237716
]
Apache Spark commented on SPARK-22437:
--
User 'mgaido91' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-22437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22437:
Assignee: Apache Spark
> jdbc write fails to set default mode
> --
[
https://issues.apache.org/jira/browse/SPARK-22433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237676#comment-16237676
]
Sean Owen commented on SPARK-22433:
---
Likewise, the goal here is not to adopt statistics
[
https://issues.apache.org/jira/browse/SPARK-22418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22418:
Assignee: (was: Apache Spark)
> Add test cases for NULL Handling
> ---
[
https://issues.apache.org/jira/browse/SPARK-22418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22418:
Assignee: Apache Spark
> Add test cases for NULL Handling
> --
[
https://issues.apache.org/jira/browse/SPARK-22418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237647#comment-16237647
]
Apache Spark commented on SPARK-22418:
--
User 'mgaido91' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-22439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237626#comment-16237626
]
Sean Owen commented on SPARK-22439:
---
Your code doesn't work as is, but I adapted it to
[
https://issues.apache.org/jira/browse/SPARK-22438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237553#comment-16237553
]
Morten Hornbech commented on SPARK-22438:
-
I honestly can't see whether those are
[
https://issues.apache.org/jira/browse/SPARK-22407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-22407:
-
Assignee: zhoukang
> Add rdd id column on storage page to speed up navigating
>
[
https://issues.apache.org/jira/browse/SPARK-22407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22407.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 19625
[https://github.co
[
https://issues.apache.org/jira/browse/SPARK-22436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237530#comment-16237530
]
Sean Owen commented on SPARK-22436:
---
Yes, but that's true of any Python UDF, and not ev
[
https://issues.apache.org/jira/browse/SPARK-22438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22438.
---
Resolution: Duplicate
Have a look through JIRA first. This looks like
https://issues.apache.org/jira
[
https://issues.apache.org/jira/browse/SPARK-22439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Navya Krishnappa updated SPARK-22439:
-
Summary: Not able to get numeric columns for the file having decimal values
(was: Not ab
[
https://issues.apache.org/jira/browse/SPARK-22439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Navya Krishnappa updated SPARK-22439:
-
Summary: Not able to get numeric columns for the attached file (was: Not
able to get num
Navya Krishnappa created SPARK-22439:
Summary: Not able to get numeric column for the attached file
Key: SPARK-22439
URL: https://issues.apache.org/jira/browse/SPARK-22439
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Morten Hornbech updated SPARK-22438:
Description:
We have a customer that uses Spark as an engine for running SQL on a collectio
Morten Hornbech created SPARK-22438:
---
Summary: OutOfMemoryError on very small data sets
Key: SPARK-22438
URL: https://issues.apache.org/jira/browse/SPARK-22438
Project: Spark
Issue Type: Bu
Adrian Bridgett created SPARK-22437:
---
Summary: jdbc write fails to set default mode
Key: SPARK-22437
URL: https://issues.apache.org/jira/browse/SPARK-22437
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-22436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237446#comment-16237446
]
Andreas Maier commented on SPARK-22436:
---
Python UDFs are very slow, aren't they? I
[
https://issues.apache.org/jira/browse/SPARK-22418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237442#comment-16237442
]
Marco Gaido commented on SPARK-22418:
-
can I work on this?
> Add test cases for NULL
[
https://issues.apache.org/jira/browse/SPARK-22436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237420#comment-16237420
]
Sean Owen commented on SPARK-22436:
---
Why does it need to be in Spark as opposed to a si
[
https://issues.apache.org/jira/browse/SPARK-22435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
jin xing updated SPARK-22435:
-
Priority: Major (was: Critical)
> Support processing array and map type using script
> -
Andreas Maier created SPARK-22436:
-
Summary: New function strip() to remove all whitespace from string
Key: SPARK-22436
URL: https://issues.apache.org/jira/browse/SPARK-22436
Project: Spark
I
[
https://issues.apache.org/jira/browse/SPARK-22435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22435:
Assignee: Apache Spark
> Support processing array and map type using script
>
[
https://issues.apache.org/jira/browse/SPARK-22435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237407#comment-16237407
]
Apache Spark commented on SPARK-22435:
--
User 'jinxing64' has created a pull request
[
https://issues.apache.org/jira/browse/SPARK-22435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22435:
Assignee: (was: Apache Spark)
> Support processing array and map type using script
> -
jin xing created SPARK-22435:
Summary: Support processing array and map type using script
Key: SPARK-22435
URL: https://issues.apache.org/jira/browse/SPARK-22435
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-22434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22434.
---
Resolution: Invalid
Fix Version/s: (was: 2.0.3)
Questions are for the mailing list
> Spar
Harendra Singh created SPARK-22434:
--
Summary: Spark structured streaming with HBase
Key: SPARK-22434
URL: https://issues.apache.org/jira/browse/SPARK-22434
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-22420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237368#comment-16237368
]
Marco Gaido commented on SPARK-22420:
-
I think this is related and will be resolved b
[
https://issues.apache.org/jira/browse/SPARK-21668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237329#comment-16237329
]
Apache Spark commented on SPARK-21668:
--
User 'tashoyan' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-22429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237282#comment-16237282
]
Sean Owen commented on SPARK-22429:
---
[~tmgstev] it will have to be vs. master. Master a
[
https://issues.apache.org/jira/browse/SPARK-22430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237268#comment-16237268
]
Sean Owen commented on SPARK-22430:
---
I see it too, because I have Roxygen 6.0.1 locally
[
https://issues.apache.org/jira/browse/SPARK-22427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-22427:
--
Description:
code part:
val path = jobConfig.getString("hdfspath")
val vectordata = sc.
85 matches
Mail list logo