[jira] [Updated] (SPARK-22035) the value of statistical logicalPlan.stats.sizeInBytes which is not expected

2017-09-16 Thread caoxuewen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caoxuewen updated SPARK-22035: -- Summary: the value of statistical logicalPlan.stats.sizeInBytes which is not expected (was: Improving

[jira] [Commented] (SPARK-22035) Improving the value of statistical logicalPlan.stats.sizeInBytes which is not expected

2017-09-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168880#comment-16168880 ] Apache Spark commented on SPARK-22035: -- User 'heary-cao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22035) Improving the value of statistical logicalPlan.stats.sizeInBytes which is not expected

2017-09-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22035: Assignee: Apache Spark > Improving the value of statistical logicalPlan.stats.sizeInBytes

[jira] [Assigned] (SPARK-22035) Improving the value of statistical logicalPlan.stats.sizeInBytes which is not expected

2017-09-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22035: Assignee: (was: Apache Spark) > Improving the value of statistical

[jira] [Resolved] (SPARK-22019) JavaBean int type property

2017-09-16 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22019. -- Resolution: Invalid > JavaBean int type property > --- > >

[jira] [Assigned] (SPARK-21967) org.apache.spark.unsafe.types.UTF8String#compareTo Should Compare 8 Bytes at a Time for Better Performance

2017-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-21967: - Assignee: Armin Braun > org.apache.spark.unsafe.types.UTF8String#compareTo Should Compare 8

[jira] [Resolved] (SPARK-21967) org.apache.spark.unsafe.types.UTF8String#compareTo Should Compare 8 Bytes at a Time for Better Performance

2017-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21967. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19180

[jira] [Resolved] (SPARK-22027) Explanation of default value of GBTRegressor's maxIter is missing in API doc

2017-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22027. --- Resolution: Not A Problem > Explanation of default value of GBTRegressor's maxIter is missing in API

[jira] [Created] (SPARK-22035) Improving the value of statistical logicalPlan.stats.sizeInBytes which is not expected

2017-09-16 Thread caoxuewen (JIRA)
caoxuewen created SPARK-22035: - Summary: Improving the value of statistical logicalPlan.stats.sizeInBytes which is not expected Key: SPARK-22035 URL: https://issues.apache.org/jira/browse/SPARK-22035

[jira] [Updated] (SPARK-22035) Improving the value of statistical logicalPlan.stats.sizeInBytes which is not expected

2017-09-16 Thread caoxuewen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caoxuewen updated SPARK-22035: -- Description: Currently, assume there will be the same number of rows as child has. statistics

[jira] [Resolved] (SPARK-22015) Remove usage of non-used private field isAuthenticated from org.apache.spark.network.sasl.SaslRpcHandler.java

2017-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22015. --- Resolution: Won't Fix > Remove usage of non-used private field isAuthenticated from >

[jira] [Resolved] (SPARK-22021) Add a feature transformation to accept a function and apply it on all rows of dataframe

2017-09-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22021. --- Resolution: Won't Fix Agree, just can't imagine supporting Javascript in just one corner of Spark >

[jira] [Updated] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Olivier Blanvillain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olivier Blanvillain updated SPARK-22036: Description: The multiplication of two BigDecimal numbers sometimes returns null.

[jira] [Updated] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Olivier Blanvillain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olivier Blanvillain updated SPARK-22036: Description: The multiplication of two BigDecimal numbers sometimes returns null.

[jira] [Updated] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Olivier Blanvillain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olivier Blanvillain updated SPARK-22036: Description: The multiplication of two BigDecimal numbers sometimes returns null.

[jira] [Created] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Olivier Blanvillain (JIRA)
Olivier Blanvillain created SPARK-22036: --- Summary: BigDecimal multiplication sometimes returns null Key: SPARK-22036 URL: https://issues.apache.org/jira/browse/SPARK-22036 Project: Spark

[jira] [Updated] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Olivier Blanvillain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olivier Blanvillain updated SPARK-22036: Description: The multiplication of two BigDecimal numbers sometimes returns null.

[jira] [Updated] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Olivier Blanvillain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olivier Blanvillain updated SPARK-22036: Description: The multiplication of two BigDecimal numbers sometimes returns null.

[jira] [Commented] (SPARK-22022) Unable to use Python Profiler with SparkSession

2017-09-16 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168895#comment-16168895 ] Hyukjin Kwon commented on SPARK-22022: -- I don't think we should expose this just for consistency

[jira] [Assigned] (SPARK-21969) CommandUtils.updateTableStats should call refreshTable

2017-09-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21969: Assignee: Apache Spark > CommandUtils.updateTableStats should call refreshTable >

[jira] [Commented] (SPARK-21969) CommandUtils.updateTableStats should call refreshTable

2017-09-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168901#comment-16168901 ] Apache Spark commented on SPARK-21969: -- User 'aokolnychyi' has created a pull request for this

[jira] [Resolved] (SPARK-22023) Multi-column Spark SQL UDFs broken in Python 3

2017-09-16 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22023. -- Resolution: Invalid This does not work in master / 2.1.0 with Python 2.7.x in my local. I

[jira] [Commented] (SPARK-22023) Multi-column Spark SQL UDFs broken in Python 3

2017-09-16 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168915#comment-16168915 ] Hyukjin Kwon commented on SPARK-22023: -- The reproducer in the description does not work in master

[jira] [Resolved] (SPARK-22023) Multi-column Spark SQL UDFs broken in Python 3

2017-09-16 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22023. -- Resolution: Invalid > Multi-column Spark SQL UDFs broken in Python 3 >

[jira] [Updated] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Olivier Blanvillain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olivier Blanvillain updated SPARK-22036: Component/s: (was: SQL) Spark Core > BigDecimal

[jira] [Reopened] (SPARK-22023) Multi-column Spark SQL UDFs broken in Python 3

2017-09-16 Thread Oli Hall (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oli Hall reopened SPARK-22023: -- If you'll note, in both the Issue title and description, as well as Environment, I noted that this is

[jira] [Commented] (SPARK-22023) Multi-column Spark SQL UDFs broken in Python 3

2017-09-16 Thread Oli Hall (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168918#comment-16168918 ] Oli Hall commented on SPARK-22023: -- Unfortunately I don't have access to my development machine over the

[jira] [Commented] (SPARK-22023) Multi-column Spark SQL UDFs broken in Python 3

2017-09-16 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168919#comment-16168919 ] Hyukjin Kwon commented on SPARK-22023: -- Don't reopen this. In any event, this issue is invalid. I am

[jira] [Assigned] (SPARK-22037) Collapse Project if it is the child of Aggregate

2017-09-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22037: Assignee: Apache Spark > Collapse Project if it is the child of Aggregate >

[jira] [Commented] (SPARK-22037) Collapse Project if it is the child of Aggregate

2017-09-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168927#comment-16168927 ] Apache Spark commented on SPARK-22037: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-22037) Collapse Project if it is the child of Aggregate

2017-09-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22037: Assignee: (was: Apache Spark) > Collapse Project if it is the child of Aggregate >

[jira] [Created] (SPARK-22038) spark 2.1.1 ml.LogisticRegression with large feature set cause Kryo serialization failed: Buffer overflow

2017-09-16 Thread wuhaibo (JIRA)
wuhaibo created SPARK-22038: --- Summary: spark 2.1.1 ml.LogisticRegression with large feature set cause Kryo serialization failed: Buffer overflow Key: SPARK-22038 URL: https://issues.apache.org/jira/browse/SPARK-22038

[jira] [Updated] (SPARK-22038) spark 2.1.1 ml.LogisticRegression with large feature set cause Kryo serialization failed: Buffer overflow

2017-09-16 Thread wuhaibo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuhaibo updated SPARK-22038: Description: I try to train a big model. I have 40 millions instances and 50 millions feature set, and it

[jira] [Comment Edited] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Olivier Blanvillain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168989#comment-16168989 ] Olivier Blanvillain edited comment on SPARK-22036 at 9/16/17 5:22 PM:

[jira] [Assigned] (SPARK-22029) Cache of _parse_datatype_json_string function

2017-09-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22029: Assignee: (was: Apache Spark) > Cache of _parse_datatype_json_string function >

[jira] [Assigned] (SPARK-22029) Cache of _parse_datatype_json_string function

2017-09-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22029: Assignee: Apache Spark > Cache of _parse_datatype_json_string function >

[jira] [Commented] (SPARK-22029) Cache of _parse_datatype_json_string function

2017-09-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169020#comment-16169020 ] Apache Spark commented on SPARK-22029: -- User 'maver1ck' has created a pull request for this issue:

[jira] [Commented] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169023#comment-16169023 ] Marco Gaido commented on SPARK-22036: - Yes, it is only for multiplications. The reason is that for

[jira] [Comment Edited] (SPARK-22023) Multi-column Spark SQL UDFs broken in Python 3

2017-09-16 Thread Oli Hall (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168912#comment-16168912 ] Oli Hall edited comment on SPARK-22023 at 9/16/17 1:04 PM: --- I think part of the

[jira] [Created] (SPARK-22037) Collapse Project if it is the child of Aggregate

2017-09-16 Thread Gengliang Wang (JIRA)
Gengliang Wang created SPARK-22037: -- Summary: Collapse Project if it is the child of Aggregate Key: SPARK-22037 URL: https://issues.apache.org/jira/browse/SPARK-22037 Project: Spark Issue

[jira] [Assigned] (SPARK-21969) CommandUtils.updateTableStats should call refreshTable

2017-09-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21969: Assignee: (was: Apache Spark) > CommandUtils.updateTableStats should call

[jira] [Commented] (SPARK-22033) BufferHolder size checks should account for the specific VM array size limitations

2017-09-16 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168928#comment-16168928 ] Wenchen Fan commented on SPARK-22033: - yea sounds good to me, though I can't think of other places

[jira] [Created] (SPARK-22039) Spark 2.1.1 Driver OOM when use interaction for large scale Sparse Vector

2017-09-16 Thread wuhaibo (JIRA)
wuhaibo created SPARK-22039: --- Summary: Spark 2.1.1 Driver OOM when use interaction for large scale Sparse Vector Key: SPARK-22039 URL: https://issues.apache.org/jira/browse/SPARK-22039 Project: Spark

[jira] [Commented] (SPARK-22024) [pySpark] Speeding up internal conversion for Spark SQL

2017-09-16 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-22024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168997#comment-16168997 ] Maciej Bryński commented on SPARK-22024: [~davies] Could you look at these PRs ? Especially on

[jira] [Commented] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Olivier Blanvillain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168989#comment-16168989 ] Olivier Blanvillain commented on SPARK-22036: - It's surprising because in this case the

[jira] [Commented] (SPARK-22023) Multi-column Spark SQL UDFs broken in Python 3

2017-09-16 Thread Oli Hall (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168912#comment-16168912 ] Oli Hall commented on SPARK-22023: -- I think part of the confusion might be that previously, in Spark

[jira] [Resolved] (SPARK-22038) spark 2.1.1 ml.LogisticRegression with large feature set cause Kryo serialization failed: Buffer overflow

2017-09-16 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22038. -- Resolution: Invalid > spark 2.1.1 ml.LogisticRegression with large feature set cause Kryo >

[jira] [Resolved] (SPARK-22039) Spark 2.1.1 Driver OOM when use interaction for large scale Sparse Vector

2017-09-16 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22039. -- Resolution: Invalid Questions should go the mailing list. Let's start this on the mailing list

[jira] [Commented] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168969#comment-16168969 ] Marco Gaido commented on SPARK-22036: - This happens because there is an overflow in the operation. I

[jira] [Comment Edited] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Olivier Blanvillain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168989#comment-16168989 ] Olivier Blanvillain edited comment on SPARK-22036 at 9/16/17 5:24 PM:

[jira] [Commented] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Olivier Blanvillain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168994#comment-16168994 ] Olivier Blanvillain commented on SPARK-22036: - This seems to be a multiplication only thing,

[jira] [Commented] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169074#comment-16169074 ] Marco Gaido commented on SPARK-22036: - Maybe the "bad" part is that by default spark creates the

[jira] [Assigned] (SPARK-21338) AggregatedDialect doesn't override isCascadingTruncateTable() method

2017-09-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21338: Assignee: Apache Spark > AggregatedDialect doesn't override isCascadingTruncateTable()

[jira] [Comment Edited] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-09-16 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169148#comment-16169148 ] Tejas Patil edited comment on SPARK-22042 at 9/17/17 1:09 AM: -- At the core,

[jira] [Commented] (SPARK-22040) current_date function with timezone id

2017-09-16 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169124#comment-16169124 ] Marco Gaido commented on SPARK-22040: - May I work on this? > current_date function with timezone id

[jira] [Comment Edited] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Olivier Blanvillain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169129#comment-16169129 ] Olivier Blanvillain edited comment on SPARK-22036 at 9/16/17 11:24 PM:

[jira] [Assigned] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-09-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22042: Assignee: Apache Spark > ReorderJoinPredicates can break when child's partitioning is not

[jira] [Commented] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-09-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169153#comment-16169153 ] Apache Spark commented on SPARK-22042: -- User 'tejasapatil' has created a pull request for this

[jira] [Assigned] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-09-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22042: Assignee: (was: Apache Spark) > ReorderJoinPredicates can break when child's

[jira] [Commented] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Olivier Blanvillain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169050#comment-16169050 ] Olivier Blanvillain commented on SPARK-22036: - I understand. Is this working as intended /

[jira] [Created] (SPARK-22041) Docker test case failure: `SPARK-16625: General data types to be mapped to Oracle`

2017-09-16 Thread Xiao Li (JIRA)
Xiao Li created SPARK-22041: --- Summary: Docker test case failure: `SPARK-16625: General data types to be mapped to Oracle` Key: SPARK-22041 URL: https://issues.apache.org/jira/browse/SPARK-22041 Project:

[jira] [Comment Edited] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Olivier Blanvillain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168994#comment-16168994 ] Olivier Blanvillain edited comment on SPARK-22036 at 9/16/17 8:52 PM:

[jira] [Commented] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169059#comment-16169059 ] Marco Gaido commented on SPARK-22036: - Honestly I don't know, that is why I said that I don't know

[jira] [Commented] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Olivier Blanvillain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169129#comment-16169129 ] Olivier Blanvillain commented on SPARK-22036: - Adding a cast indeeds prevents getting null

[jira] [Comment Edited] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Olivier Blanvillain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169129#comment-16169129 ] Olivier Blanvillain edited comment on SPARK-22036 at 9/16/17 11:06 PM:

[jira] [Comment Edited] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Olivier Blanvillain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169129#comment-16169129 ] Olivier Blanvillain edited comment on SPARK-22036 at 9/16/17 11:06 PM:

[jira] [Created] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-09-16 Thread Tejas Patil (JIRA)
Tejas Patil created SPARK-22042: --- Summary: ReorderJoinPredicates can break when child's partitioning is not decided Key: SPARK-22042 URL: https://issues.apache.org/jira/browse/SPARK-22042 Project:

[jira] [Commented] (SPARK-22022) Unable to use Python Profiler with SparkSession

2017-09-16 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169166#comment-16169166 ] Hyukjin Kwon commented on SPARK-22022: -- I mean, I think we could do this (not tested): {code} sc =

[jira] [Created] (SPARK-22040) current_date function with timezone id

2017-09-16 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-22040: --- Summary: current_date function with timezone id Key: SPARK-22040 URL: https://issues.apache.org/jira/browse/SPARK-22040 Project: Spark Issue Type:

[jira] [Commented] (SPARK-22042) ReorderJoinPredicates can break when child's partitioning is not decided

2017-09-16 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169148#comment-16169148 ] Tejas Patil commented on SPARK-22042: - At the core, the problem is `ReorderJoinPredicates` expects

[jira] [Commented] (SPARK-22039) Spark 2.1.1 Driver OOM when use interaction for large scale Sparse Vector

2017-09-16 Thread wuhaibo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169169#comment-16169169 ] wuhaibo commented on SPARK-22039: - sorry,please tell me which mailing list is? -- fun coding >

[jira] [Comment Edited] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-16 Thread Olivier Blanvillain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168989#comment-16168989 ] Olivier Blanvillain edited comment on SPARK-22036 at 9/16/17 8:50 PM:

[jira] [Commented] (SPARK-21338) AggregatedDialect doesn't override isCascadingTruncateTable() method

2017-09-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169143#comment-16169143 ] Apache Spark commented on SPARK-21338: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-21338) AggregatedDialect doesn't override isCascadingTruncateTable() method

2017-09-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21338: Assignee: (was: Apache Spark) > AggregatedDialect doesn't override