zhengruifeng created SPARK-23805:
Summary: support vector-size validation and Inference
Key: SPARK-23805
URL: https://issues.apache.org/jira/browse/SPARK-23805
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-23565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417206#comment-16417206
]
Patrick McGloin commented on SPARK-23565:
-
I would like to work on this.
> Improved error
[
https://issues.apache.org/jira/browse/SPARK-23705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23705:
Assignee: Apache Spark
> dataframe.groupBy() may inadvertently receive sequence of
[
https://issues.apache.org/jira/browse/SPARK-23705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417064#comment-16417064
]
Apache Spark commented on SPARK-23705:
--
User 'vinodkc' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23705:
Assignee: (was: Apache Spark)
> dataframe.groupBy() may inadvertently receive
[
https://issues.apache.org/jira/browse/SPARK-23782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417149#comment-16417149
]
Marco Gaido commented on SPARK-23782:
-
[~vanzin] sorry but I cannot see any usability issue with
[
https://issues.apache.org/jira/browse/SPARK-19076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417291#comment-16417291
]
Maciej Bryński commented on SPARK-19076:
So it's not resolved but in progress
> Upgrade Hive
[
https://issues.apache.org/jira/browse/SPARK-23765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-23765.
-
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 20877
[
https://issues.apache.org/jira/browse/SPARK-19076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417284#comment-16417284
]
Darek commented on SPARK-19076:
---
[PR 20659|https://github.com/apache/spark/pull/20659] for this issue
[
https://issues.apache.org/jira/browse/SPARK-23765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-23765:
---
Assignee: Hyukjin Kwon
> Supports line separator for json datasource
>
[
https://issues.apache.org/jira/browse/SPARK-19076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417293#comment-16417293
]
Darek commented on SPARK-19076:
---
It's done, passed all the tests, just needs to be merged in, not sure who
[
https://issues.apache.org/jira/browse/SPARK-23806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23806:
Assignee: Apache Spark
> Broadcast. unpersist can cause fatal exception when used with
[
https://issues.apache.org/jira/browse/SPARK-23806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23806:
Assignee: (was: Apache Spark)
> Broadcast. unpersist can cause fatal exception when
[
https://issues.apache.org/jira/browse/SPARK-23806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417881#comment-16417881
]
Apache Spark commented on SPARK-23806:
--
User 'tgravescs' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417751#comment-16417751
]
Marcelo Vanzin commented on SPARK-23782:
All the information you're trying to protect can be
[
https://issues.apache.org/jira/browse/SPARK-23096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417787#comment-16417787
]
Apache Spark commented on SPARK-23096:
--
User 'jose-torres' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-23806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Graves updated SPARK-23806:
--
Description:
Very similar to https://issues.apache.org/jira/browse/SPARK-22618 . But this
[
https://issues.apache.org/jira/browse/SPARK-23096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417848#comment-16417848
]
Apache Spark commented on SPARK-23096:
--
User 'jose-torres' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-23807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417864#comment-16417864
]
Apache Spark commented on SPARK-23807:
--
User 'steveloughran' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-23807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23807:
Assignee: Apache Spark
> Add Hadoop 3 profile with relevant POM fix ups, cloud-storage
[
https://issues.apache.org/jira/browse/SPARK-23807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23807:
Assignee: (was: Apache Spark)
> Add Hadoop 3 profile with relevant POM fix ups,
[
https://issues.apache.org/jira/browse/SPARK-23811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23811:
Assignee: (was: Apache Spark)
> Same tasks' FetchFailed event comes before Success
[
https://issues.apache.org/jira/browse/SPARK-23811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418431#comment-16418431
]
Apache Spark commented on SPARK-23811:
--
User 'xuanyuanking' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-23811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23811:
Assignee: Apache Spark
> Same tasks' FetchFailed event comes before Success will cause
Fangshi Li created SPARK-23815:
--
Summary: Spark writer dynamic partition overwrite mode fails to
write output on multi level partition
Key: SPARK-23815
URL: https://issues.apache.org/jira/browse/SPARK-23815
[
https://issues.apache.org/jira/browse/SPARK-23812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418430#comment-16418430
]
Yuming Wang commented on SPARK-23812:
-
[~wangtao93] Would you like to work on this?
> DFS should be
[
https://issues.apache.org/jira/browse/SPARK-23815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418452#comment-16418452
]
Apache Spark commented on SPARK-23815:
--
User 'fangshil' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
bharath kumar avusherla updated SPARK-23814:
Description:
When the file name has colon and new line character in data,
[
https://issues.apache.org/jira/browse/SPARK-23814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
bharath kumar avusherla updated SPARK-23814:
Description:
When the file name has colon and new line character in data,
[
https://issues.apache.org/jira/browse/SPARK-23814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
bharath kumar avusherla updated SPARK-23814:
Description:
When the file name has colon and new line character in data,
bharath kumar avusherla created SPARK-23814:
---
Summary: Couldn't read file with colon in name and new line
character in one of the field.
Key: SPARK-23814
URL:
[
https://issues.apache.org/jira/browse/SPARK-23811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418434#comment-16418434
]
Li Yuanjian commented on SPARK-23811:
-
The scenario can be reproduced by below test case added in
[
https://issues.apache.org/jira/browse/SPARK-23815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23815:
Assignee: Apache Spark
> Spark writer dynamic partition overwrite mode fails to write
[
https://issues.apache.org/jira/browse/SPARK-23815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23815:
Assignee: (was: Apache Spark)
> Spark writer dynamic partition overwrite mode fails
[
https://issues.apache.org/jira/browse/SPARK-23772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418280#comment-16418280
]
Apache Spark commented on SPARK-23772:
--
User 'maropu' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23772:
Assignee: Apache Spark
> Provide an option to ignore column of all null values or empty
[
https://issues.apache.org/jira/browse/SPARK-23772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23772:
Assignee: (was: Apache Spark)
> Provide an option to ignore column of all null values
[
https://issues.apache.org/jira/browse/SPARK-23675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-23675.
---
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 20818
[
https://issues.apache.org/jira/browse/SPARK-23807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418298#comment-16418298
]
Saisai Shao commented on SPARK-23807:
-
Hi [~ste...@apache.org], this is dup of SPARK-23534, I think
wangtao93 created SPARK-23812:
-
Summary: DFS should be removed from unsupportedHiveNativeCommands
in SqlBase.g4
Key: SPARK-23812
URL: https://issues.apache.org/jira/browse/SPARK-23812
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-23811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Yuanjian updated SPARK-23811:
Attachment: 1.png
> Same tasks' FetchFailed event comes before Success will cause child stage
>
[
https://issues.apache.org/jira/browse/SPARK-23813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cui Xixin updated SPARK-23813:
--
Description:
i am working on replacing hivesql with sparksql now, i found parse_url perform
[
https://issues.apache.org/jira/browse/SPARK-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
yuliang updated SPARK-5928:
---
Attachment: image-2018-03-29-11-52-32-075.png
> Remote Shuffle Blocks cannot be more than 2 GB
>
[
https://issues.apache.org/jira/browse/SPARK-23810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418244#comment-16418244
]
dciborow commented on SPARK-23810:
--
test comment to see if i get an email...
> Matrix Multiplication is
Li Yuanjian created SPARK-23811:
---
Summary: Same tasks' FetchFailed event comes before Success will
cause child stage never succeed
Key: SPARK-23811
URL: https://issues.apache.org/jira/browse/SPARK-23811
[
https://issues.apache.org/jira/browse/SPARK-23811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Li Yuanjian updated SPARK-23811:
Attachment: 2.png
> Same tasks' FetchFailed event comes before Success will cause child stage
>
dciborow created SPARK-23810:
Summary: Matrix Multiplication is so bad, file I/O to local python
is better
Key: SPARK-23810
URL: https://issues.apache.org/jira/browse/SPARK-23810
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-20169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418282#comment-16418282
]
Maryann Xue commented on SPARK-20169:
-
This was related to the use of "withColumnRenamed", which will
[
https://issues.apache.org/jira/browse/SPARK-23810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dciborow updated SPARK-23810:
-
Priority: Minor (was: Major)
> Matrix Multiplication is so bad, file I/O to local python is better
>
[
https://issues.apache.org/jira/browse/SPARK-23810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
dciborow updated SPARK-23810:
-
Comment: was deleted
(was: test comment to see if i get an email...)
> Matrix Multiplication is so bad,
[
https://issues.apache.org/jira/browse/SPARK-23675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-23675:
-
Assignee: guoxiaolongzte
> Title add spark logo, use spark logo image
>
[
https://issues.apache.org/jira/browse/SPARK-23813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cui Xixin updated SPARK-23813:
--
Description:
i am working on replacing hivesql with sparksql now, i fount parse_url perform
Cui Xixin created SPARK-23813:
-
Summary: [SparkSQL] the result is different between hive and spark
when use PARSE_URL()
Key: SPARK-23813
URL: https://issues.apache.org/jira/browse/SPARK-23813
Project:
[
https://issues.apache.org/jira/browse/SPARK-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418410#comment-16418410
]
yuliang commented on SPARK-5928:
!image-2018-03-29-11-52-32-075.png|width=741,height=189!
>From the
Jose Torres created SPARK-23808:
---
Summary: Test spark sessions should set default session
Key: SPARK-23808
URL: https://issues.apache.org/jira/browse/SPARK-23808
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-23809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418211#comment-16418211
]
Apache Spark commented on SPARK-23809:
--
User 'ericl' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23809:
Assignee: Apache Spark
> Active SparkSession should be set by getOrCreate
>
[
https://issues.apache.org/jira/browse/SPARK-23809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23809:
Assignee: (was: Apache Spark)
> Active SparkSession should be set by getOrCreate
>
[
https://issues.apache.org/jira/browse/SPARK-22941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22941:
Assignee: (was: Apache Spark)
> Allow SparkSubmit to throw exceptions instead of
[
https://issues.apache.org/jira/browse/SPARK-22941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22941:
Assignee: Apache Spark
> Allow SparkSubmit to throw exceptions instead of exiting /
[
https://issues.apache.org/jira/browse/SPARK-22941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418087#comment-16418087
]
Apache Spark commented on SPARK-22941:
--
User 'vanzin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-23808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418142#comment-16418142
]
Apache Spark commented on SPARK-23808:
--
User 'jose-torres' has created a pull request for this
Eric Liang created SPARK-23809:
--
Summary: Active SparkSession should be set by getOrCreate
Key: SPARK-23809
URL: https://issues.apache.org/jira/browse/SPARK-23809
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-23808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23808:
Assignee: (was: Apache Spark)
> Test spark sessions should set default session
>
[
https://issues.apache.org/jira/browse/SPARK-23808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23808:
Assignee: Apache Spark
> Test spark sessions should set default session
>
[
https://issues.apache.org/jira/browse/SPARK-23682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417474#comment-16417474
]
Andrew Korzhuev commented on SPARK-23682:
-
I can confirm that _HDFSBackedStateStoreProvider_ is
[
https://issues.apache.org/jira/browse/SPARK-23682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417474#comment-16417474
]
Andrew Korzhuev edited comment on SPARK-23682 at 3/28/18 2:55 PM:
--
I can
[
https://issues.apache.org/jira/browse/SPARK-23682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417474#comment-16417474
]
Andrew Korzhuev edited comment on SPARK-23682 at 3/28/18 2:56 PM:
--
I can
[
https://issues.apache.org/jira/browse/SPARK-23040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417429#comment-16417429
]
Apache Spark commented on SPARK-23040:
--
User 'jiangxb1987' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-23682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Korzhuev updated SPARK-23682:
Attachment: Screen Shot 2018-03-28 at 16.44.20.png
> Memory issue with Spark structured
[
https://issues.apache.org/jira/browse/SPARK-22618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417466#comment-16417466
]
Thomas Graves commented on SPARK-22618:
---
I'll file a separate Jira for it and put up a pr
>
[
https://issues.apache.org/jira/browse/SPARK-23682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Korzhuev updated SPARK-23682:
Attachment: Screen Shot 2018-03-28 at 16.44.20.png
> Memory issue with Spark structured
[
https://issues.apache.org/jira/browse/SPARK-23682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Korzhuev updated SPARK-23682:
Attachment: Screen Shot 2018-03-28 at 16.44.20.png
> Memory issue with Spark structured
Steve Loughran created SPARK-23807:
--
Summary: Add Hadoop 3 profile with relevant POM fix ups,
cloud-storage artifacts and binding
Key: SPARK-23807
URL: https://issues.apache.org/jira/browse/SPARK-23807
[
https://issues.apache.org/jira/browse/SPARK-23805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417088#comment-16417088
]
Apache Spark commented on SPARK-23805:
--
User 'zhengruifeng' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-23805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23805:
Assignee: (was: Apache Spark)
> support vector-size validation and Inference
>
[
https://issues.apache.org/jira/browse/SPARK-23805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23805:
Assignee: Apache Spark
> support vector-size validation and Inference
>
[
https://issues.apache.org/jira/browse/SPARK-23682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417474#comment-16417474
]
Andrew Korzhuev edited comment on SPARK-23682 at 3/28/18 3:00 PM:
--
I can
[
https://issues.apache.org/jira/browse/SPARK-23682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Korzhuev updated SPARK-23682:
Attachment: screen_shot_2018-03-20_at_15.23.29.png
> Memory issue with Spark structured
[
https://issues.apache.org/jira/browse/SPARK-23801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417519#comment-16417519
]
Nathan Kleyn commented on SPARK-23801:
--
[~kiszk] We'll have our best go at trying to narrow down the
[
https://issues.apache.org/jira/browse/SPARK-23801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417519#comment-16417519
]
Nathan Kleyn edited comment on SPARK-23801 at 3/28/18 3:14 PM:
---
[~kiszk]
Thomas Graves created SPARK-23806:
-
Summary: Broadcast. unpersist can cause fatal exception when used
with dynamic allocation
Key: SPARK-23806
URL: https://issues.apache.org/jira/browse/SPARK-23806
82 matches
Mail list logo