[
https://issues.apache.org/jira/browse/SPARK-22035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-22035:
--
Summary: the value of statistical logicalPlan.stats.sizeInBytes which is
not expected (was: Improving
[
https://issues.apache.org/jira/browse/SPARK-22035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168880#comment-16168880
]
Apache Spark commented on SPARK-22035:
--
User 'heary-cao' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22035:
Assignee: Apache Spark
> Improving the value of statistical logicalPlan.stats.sizeInBytes
[
https://issues.apache.org/jira/browse/SPARK-22035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22035:
Assignee: (was: Apache Spark)
> Improving the value of statistical
[
https://issues.apache.org/jira/browse/SPARK-22019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-22019.
--
Resolution: Invalid
> JavaBean int type property
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-21967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-21967:
-
Assignee: Armin Braun
> org.apache.spark.unsafe.types.UTF8String#compareTo Should Compare 8
[
https://issues.apache.org/jira/browse/SPARK-21967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-21967.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 19180
[
https://issues.apache.org/jira/browse/SPARK-22027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22027.
---
Resolution: Not A Problem
> Explanation of default value of GBTRegressor's maxIter is missing in API
caoxuewen created SPARK-22035:
-
Summary: Improving the value of statistical
logicalPlan.stats.sizeInBytes which is not expected
Key: SPARK-22035
URL: https://issues.apache.org/jira/browse/SPARK-22035
[
https://issues.apache.org/jira/browse/SPARK-22035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-22035:
--
Description:
Currently, assume there will be the same number of rows as child has.
statistics
[
https://issues.apache.org/jira/browse/SPARK-22015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22015.
---
Resolution: Won't Fix
> Remove usage of non-used private field isAuthenticated from
>
[
https://issues.apache.org/jira/browse/SPARK-22021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22021.
---
Resolution: Won't Fix
Agree, just can't imagine supporting Javascript in just one corner of Spark
>
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Olivier Blanvillain updated SPARK-22036:
Description:
The multiplication of two BigDecimal numbers sometimes returns null.
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Olivier Blanvillain updated SPARK-22036:
Description:
The multiplication of two BigDecimal numbers sometimes returns null.
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Olivier Blanvillain updated SPARK-22036:
Description:
The multiplication of two BigDecimal numbers sometimes returns null.
Olivier Blanvillain created SPARK-22036:
---
Summary: BigDecimal multiplication sometimes returns null
Key: SPARK-22036
URL: https://issues.apache.org/jira/browse/SPARK-22036
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Olivier Blanvillain updated SPARK-22036:
Description:
The multiplication of two BigDecimal numbers sometimes returns null.
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Olivier Blanvillain updated SPARK-22036:
Description:
The multiplication of two BigDecimal numbers sometimes returns null.
[
https://issues.apache.org/jira/browse/SPARK-22022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168895#comment-16168895
]
Hyukjin Kwon commented on SPARK-22022:
--
I don't think we should expose this just for consistency
[
https://issues.apache.org/jira/browse/SPARK-21969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21969:
Assignee: Apache Spark
> CommandUtils.updateTableStats should call refreshTable
>
[
https://issues.apache.org/jira/browse/SPARK-21969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168901#comment-16168901
]
Apache Spark commented on SPARK-21969:
--
User 'aokolnychyi' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-22023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-22023.
--
Resolution: Invalid
This does not work in master / 2.1.0 with Python 2.7.x in my local.
I
[
https://issues.apache.org/jira/browse/SPARK-22023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168915#comment-16168915
]
Hyukjin Kwon commented on SPARK-22023:
--
The reproducer in the description does not work in master
[
https://issues.apache.org/jira/browse/SPARK-22023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-22023.
--
Resolution: Invalid
> Multi-column Spark SQL UDFs broken in Python 3
>
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Olivier Blanvillain updated SPARK-22036:
Component/s: (was: SQL)
Spark Core
> BigDecimal
[
https://issues.apache.org/jira/browse/SPARK-22023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Oli Hall reopened SPARK-22023:
--
If you'll note, in both the Issue title and description, as well as
Environment, I noted that this is
[
https://issues.apache.org/jira/browse/SPARK-22023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168918#comment-16168918
]
Oli Hall commented on SPARK-22023:
--
Unfortunately I don't have access to my development machine over the
[
https://issues.apache.org/jira/browse/SPARK-22023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168919#comment-16168919
]
Hyukjin Kwon commented on SPARK-22023:
--
Don't reopen this. In any event, this issue is invalid. I am
[
https://issues.apache.org/jira/browse/SPARK-22037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22037:
Assignee: Apache Spark
> Collapse Project if it is the child of Aggregate
>
[
https://issues.apache.org/jira/browse/SPARK-22037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168927#comment-16168927
]
Apache Spark commented on SPARK-22037:
--
User 'gengliangwang' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-22037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22037:
Assignee: (was: Apache Spark)
> Collapse Project if it is the child of Aggregate
>
wuhaibo created SPARK-22038:
---
Summary: spark 2.1.1 ml.LogisticRegression with large feature set
cause Kryo serialization failed: Buffer overflow
Key: SPARK-22038
URL: https://issues.apache.org/jira/browse/SPARK-22038
[
https://issues.apache.org/jira/browse/SPARK-22038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wuhaibo updated SPARK-22038:
Description:
I try to train a big model.
I have 40 millions instances and 50 millions feature set, and it
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168989#comment-16168989
]
Olivier Blanvillain edited comment on SPARK-22036 at 9/16/17 5:22 PM:
[
https://issues.apache.org/jira/browse/SPARK-22029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22029:
Assignee: (was: Apache Spark)
> Cache of _parse_datatype_json_string function
>
[
https://issues.apache.org/jira/browse/SPARK-22029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22029:
Assignee: Apache Spark
> Cache of _parse_datatype_json_string function
>
[
https://issues.apache.org/jira/browse/SPARK-22029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169020#comment-16169020
]
Apache Spark commented on SPARK-22029:
--
User 'maver1ck' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169023#comment-16169023
]
Marco Gaido commented on SPARK-22036:
-
Yes, it is only for multiplications. The reason is that for
[
https://issues.apache.org/jira/browse/SPARK-22023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168912#comment-16168912
]
Oli Hall edited comment on SPARK-22023 at 9/16/17 1:04 PM:
---
I think part of the
Gengliang Wang created SPARK-22037:
--
Summary: Collapse Project if it is the child of Aggregate
Key: SPARK-22037
URL: https://issues.apache.org/jira/browse/SPARK-22037
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-21969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21969:
Assignee: (was: Apache Spark)
> CommandUtils.updateTableStats should call
[
https://issues.apache.org/jira/browse/SPARK-22033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168928#comment-16168928
]
Wenchen Fan commented on SPARK-22033:
-
yea sounds good to me, though I can't think of other places
wuhaibo created SPARK-22039:
---
Summary: Spark 2.1.1 Driver OOM when use interaction for large
scale Sparse Vector
Key: SPARK-22039
URL: https://issues.apache.org/jira/browse/SPARK-22039
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168997#comment-16168997
]
Maciej Bryński commented on SPARK-22024:
[~davies]
Could you look at these PRs ?
Especially on
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168989#comment-16168989
]
Olivier Blanvillain commented on SPARK-22036:
-
It's surprising because in this case the
[
https://issues.apache.org/jira/browse/SPARK-22023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168912#comment-16168912
]
Oli Hall commented on SPARK-22023:
--
I think part of the confusion might be that previously, in Spark
[
https://issues.apache.org/jira/browse/SPARK-22038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-22038.
--
Resolution: Invalid
> spark 2.1.1 ml.LogisticRegression with large feature set cause Kryo
>
[
https://issues.apache.org/jira/browse/SPARK-22039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-22039.
--
Resolution: Invalid
Questions should go the mailing list. Let's start this on the mailing list
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168969#comment-16168969
]
Marco Gaido commented on SPARK-22036:
-
This happens because there is an overflow in the operation. I
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168989#comment-16168989
]
Olivier Blanvillain edited comment on SPARK-22036 at 9/16/17 5:24 PM:
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168994#comment-16168994
]
Olivier Blanvillain commented on SPARK-22036:
-
This seems to be a multiplication only thing,
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169074#comment-16169074
]
Marco Gaido commented on SPARK-22036:
-
Maybe the "bad" part is that by default spark creates the
[
https://issues.apache.org/jira/browse/SPARK-21338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21338:
Assignee: Apache Spark
> AggregatedDialect doesn't override isCascadingTruncateTable()
[
https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169148#comment-16169148
]
Tejas Patil edited comment on SPARK-22042 at 9/17/17 1:09 AM:
--
At the core,
[
https://issues.apache.org/jira/browse/SPARK-22040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169124#comment-16169124
]
Marco Gaido commented on SPARK-22040:
-
May I work on this?
> current_date function with timezone id
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169129#comment-16169129
]
Olivier Blanvillain edited comment on SPARK-22036 at 9/16/17 11:24 PM:
[
https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22042:
Assignee: Apache Spark
> ReorderJoinPredicates can break when child's partitioning is not
[
https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169153#comment-16169153
]
Apache Spark commented on SPARK-22042:
--
User 'tejasapatil' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22042:
Assignee: (was: Apache Spark)
> ReorderJoinPredicates can break when child's
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169050#comment-16169050
]
Olivier Blanvillain commented on SPARK-22036:
-
I understand. Is this working as intended /
Xiao Li created SPARK-22041:
---
Summary: Docker test case failure: `SPARK-16625: General data
types to be mapped to Oracle`
Key: SPARK-22041
URL: https://issues.apache.org/jira/browse/SPARK-22041
Project:
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168994#comment-16168994
]
Olivier Blanvillain edited comment on SPARK-22036 at 9/16/17 8:52 PM:
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169059#comment-16169059
]
Marco Gaido commented on SPARK-22036:
-
Honestly I don't know, that is why I said that I don't know
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169129#comment-16169129
]
Olivier Blanvillain commented on SPARK-22036:
-
Adding a cast indeeds prevents getting null
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169129#comment-16169129
]
Olivier Blanvillain edited comment on SPARK-22036 at 9/16/17 11:06 PM:
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169129#comment-16169129
]
Olivier Blanvillain edited comment on SPARK-22036 at 9/16/17 11:06 PM:
Tejas Patil created SPARK-22042:
---
Summary: ReorderJoinPredicates can break when child's partitioning
is not decided
Key: SPARK-22042
URL: https://issues.apache.org/jira/browse/SPARK-22042
Project:
[
https://issues.apache.org/jira/browse/SPARK-22022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169166#comment-16169166
]
Hyukjin Kwon commented on SPARK-22022:
--
I mean, I think we could do this (not tested):
{code}
sc =
Jacek Laskowski created SPARK-22040:
---
Summary: current_date function with timezone id
Key: SPARK-22040
URL: https://issues.apache.org/jira/browse/SPARK-22040
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169148#comment-16169148
]
Tejas Patil commented on SPARK-22042:
-
At the core, the problem is `ReorderJoinPredicates` expects
[
https://issues.apache.org/jira/browse/SPARK-22039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169169#comment-16169169
]
wuhaibo commented on SPARK-22039:
-
sorry,please tell me which mailing list is?
--
fun coding
>
[
https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168989#comment-16168989
]
Olivier Blanvillain edited comment on SPARK-22036 at 9/16/17 8:50 PM:
[
https://issues.apache.org/jira/browse/SPARK-21338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169143#comment-16169143
]
Apache Spark commented on SPARK-21338:
--
User 'huaxingao' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-21338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21338:
Assignee: (was: Apache Spark)
> AggregatedDialect doesn't override
74 matches
Mail list logo