[jira] [Commented] (SPARK-31786) Exception on submitting Spark-Pi to Kubernetes 1.17.3

[ https://issues.apache.org/jira/browse/SPARK-31786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115144#comment-17115144 ] Maciej Bryński commented on SPARK-31786: I think this should be added at least to documentation.

[jira] [Commented] (SPARK-31794) Incorrect distribution with repartitionByRange and repartition column expression

[ https://issues.apache.org/jira/browse/SPARK-31794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115080#comment-17115080 ] Jungtaek Lim commented on SPARK-31794: -- Please read through the doc of these methods, which explain

[jira] [Updated] (SPARK-31793) Reduce the memory usage in file scan location metadata

[ https://issues.apache.org/jira/browse/SPARK-31793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-31793: - Fix Version/s: 3.1.0 > Reduce the memory usage in file scan location metadata >

[jira] [Created] (SPARK-31806) Check reading date/timestamp from Parquet: plain, dictionary enc, Spark version

Maxim Gekk created SPARK-31806: -- Summary: Check reading date/timestamp from Parquet: plain, dictionary enc, Spark version Key: SPARK-31806 URL: https://issues.apache.org/jira/browse/SPARK-31806 Project:

[jira] [Commented] (SPARK-3159) Check for reducible DecisionTree

[ https://issues.apache.org/jira/browse/SPARK-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115343#comment-17115343 ] xujiajin commented on SPARK-3159: - it is possible to control the prune parameter during training decision

[jira] [Commented] (SPARK-31806) Check reading date/timestamp from Parquet: plain, dictionary enc, Spark version

[ https://issues.apache.org/jira/browse/SPARK-31806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115336#comment-17115336 ] Apache Spark commented on SPARK-31806: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-31806) Check reading date/timestamp from Parquet: plain, dictionary enc, Spark version

[ https://issues.apache.org/jira/browse/SPARK-31806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115335#comment-17115335 ] Apache Spark commented on SPARK-31806: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31806) Check reading date/timestamp from Parquet: plain, dictionary enc, Spark version

[ https://issues.apache.org/jira/browse/SPARK-31806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31806: Assignee: Apache Spark > Check reading date/timestamp from Parquet: plain, dictionary

[jira] [Assigned] (SPARK-31806) Check reading date/timestamp from Parquet: plain, dictionary enc, Spark version

[ https://issues.apache.org/jira/browse/SPARK-31806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31806: Assignee: (was: Apache Spark) > Check reading date/timestamp from Parquet: plain,

[jira] [Assigned] (SPARK-31761) Sql Div operator can result in incorrect output for int_min

[ https://issues.apache.org/jira/browse/SPARK-31761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro reassigned SPARK-31761: Assignee: Sandeep Katta > Sql Div operator can result in incorrect output for

[jira] [Updated] (SPARK-31761) Sql Div operator can result in incorrect output for int_min

[ https://issues.apache.org/jira/browse/SPARK-31761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-31761: - Fix Version/s: (was: 3.1.0) 3.0.0 > Sql Div operator can result

[jira] [Resolved] (SPARK-31768) add getMetrics in Evaluators

[ https://issues.apache.org/jira/browse/SPARK-31768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31768. -- Fix Version/s: 3.1.0 Assignee: Huaxin Gao Resolution: Fixed Resolved by

[jira] [Updated] (SPARK-31768) add getMetrics in Evaluators

[ https://issues.apache.org/jira/browse/SPARK-31768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-31768: - Priority: Minor (was: Major) > add getMetrics in Evaluators > > >

[jira] [Updated] (SPARK-3159) Check for reducible DecisionTree

[ https://issues.apache.org/jira/browse/SPARK-3159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xujiajin updated SPARK-3159: Attachment: image-2020-05-24-23-00-38-419.png > Check for reducible DecisionTree >

[jira] [Assigned] (SPARK-31769) Add support of MDC in spark driver logs.

[ https://issues.apache.org/jira/browse/SPARK-31769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31769: Assignee: Apache Spark > Add support of MDC in spark driver logs. >

[jira] [Commented] (SPARK-31769) Add support of MDC in spark driver logs.

[ https://issues.apache.org/jira/browse/SPARK-31769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115040#comment-17115040 ] Apache Spark commented on SPARK-31769: -- User 'igreenfield' has created a pull request for this

[jira] [Assigned] (SPARK-31769) Add support of MDC in spark driver logs.

[ https://issues.apache.org/jira/browse/SPARK-31769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31769: Assignee: (was: Apache Spark) > Add support of MDC in spark driver logs. >

[jira] [Commented] (SPARK-31761) Sql Div operator can result in incorrect output for int_min

[ https://issues.apache.org/jira/browse/SPARK-31761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115037#comment-17115037 ] Apache Spark commented on SPARK-31761: -- User 'sandeep-katta' has created a pull request for this

[jira] [Commented] (SPARK-21172) EOFException reached end of stream in UnsafeRowSerializer

[ https://issues.apache.org/jira/browse/SPARK-21172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115613#comment-17115613 ] Yunbo Fan commented on SPARK-21172: --- [~lasanthafdo] Apply the patch SPARK-24809，but still hit the

[jira] [Comment Edited] (SPARK-21172) EOFException reached end of stream in UnsafeRowSerializer

[ https://issues.apache.org/jira/browse/SPARK-21172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115613#comment-17115613 ] Yunbo Fan edited comment on SPARK-21172 at 5/25/20, 1:14 AM: - [~lasanthafdo]

[jira] [Resolved] (SPARK-31788) Error when creating UnionRDD of PairRDDs

[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31788. -- Fix Version/s: 3.0.0 Assignee: Sanket Reddy Resolution: Fixed Fixed in

[jira] [Commented] (SPARK-21172) EOFException reached end of stream in UnsafeRowSerializer

[ https://issues.apache.org/jira/browse/SPARK-21172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115634#comment-17115634 ] liupengcheng commented on SPARK-21172: -- [~fanyunbojerry] I think you can check your remote disk or

[jira] [Updated] (SPARK-31808) Make struct function's output name and class name pretty

[ https://issues.apache.org/jira/browse/SPARK-31808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31808: - Attachment: Screen Shot 2020-05-25 at 12.54.41 PM.png > Make struct function's output name and

[jira] [Updated] (SPARK-31808) Make struct function's output name and class name pretty

[ https://issues.apache.org/jira/browse/SPARK-31808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31808: - Priority: Minor (was: Major) > Make struct function's output name and class name pretty >

[jira] [Created] (SPARK-31808) Make struct function's output name and class name pretty

Hyukjin Kwon created SPARK-31808: Summary: Make struct function's output name and class name pretty Key: SPARK-31808 URL: https://issues.apache.org/jira/browse/SPARK-31808 Project: Spark

[jira] [Updated] (SPARK-31808) Make struct function's output name and class name pretty

[ https://issues.apache.org/jira/browse/SPARK-31808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31808: - Issue Type: Bug (was: Improvement) > Make struct function's output name and class name pretty

[jira] [Updated] (SPARK-31788) Error when creating UnionRDD of PairRDDs

[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31788: - Component/s: PySpark > Error when creating UnionRDD of PairRDDs >

[jira] [Resolved] (SPARK-31807) Use python 3 style in release-build.sh

[ https://issues.apache.org/jira/browse/SPARK-31807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31807. -- Fix Version/s: 3.0.0 Resolution: Fixed Fixed at

[jira] [Updated] (SPARK-31788) Error when creating UnionRDD of PairRDDs

[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31788: - Priority: Major (was: Blocker) > Error when creating UnionRDD of PairRDDs >

[jira] [Commented] (SPARK-31794) Incorrect distribution with repartitionByRange and repartition column expression

[ https://issues.apache.org/jira/browse/SPARK-31794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115638#comment-17115638 ] Ramesha Bhatta commented on SPARK-31794: Understand partitionByRange is doing sampling to

[jira] [Comment Edited] (SPARK-31377) Add unit tests for "number of output rows" metric for joins in SQLMetricsSuite

[ https://issues.apache.org/jira/browse/SPARK-31377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115663#comment-17115663 ] Hyukjin Kwon edited comment on SPARK-31377 at 5/25/20, 3:45 AM: Fixed in

[jira] [Resolved] (SPARK-31377) Add unit tests for "number of output rows" metric for joins in SQLMetricsSuite

[ https://issues.apache.org/jira/browse/SPARK-31377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31377. -- Fix Version/s: 3.1.0 Assignee: Srinivas Rishindra Pothireddi Resolution: Fixed

[jira] [Assigned] (SPARK-31807) Use python 3 style in release-build.sh

[ https://issues.apache.org/jira/browse/SPARK-31807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31807: Assignee: William Hyun > Use python 3 style in release-build.sh >

[jira] [Commented] (SPARK-21172) EOFException reached end of stream in UnsafeRowSerializer

[ https://issues.apache.org/jira/browse/SPARK-21172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115643#comment-17115643 ] Yunbo Fan commented on SPARK-21172: --- [~liupengcheng] Not yet. I‘m on Spark2.2.3. I'll check the disks

[jira] [Resolved] (SPARK-31802) Format Java date-time types in Row.jsonValue directly

[ https://issues.apache.org/jira/browse/SPARK-31802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31802. -- Resolution: Fixed Issue resolved by pull request 28620

[jira] [Commented] (SPARK-31807) Use python 3 style in release-build.sh

[ https://issues.apache.org/jira/browse/SPARK-31807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115404#comment-17115404 ] Apache Spark commented on SPARK-31807: -- User 'williamhyun' has created a pull request for this

[jira] [Assigned] (SPARK-31807) Use python 3 style in release-build.sh

[ https://issues.apache.org/jira/browse/SPARK-31807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31807: Assignee: Apache Spark > Use python 3 style in release-build.sh >

[jira] [Assigned] (SPARK-31807) Use python 3 style in release-build.sh

[ https://issues.apache.org/jira/browse/SPARK-31807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31807: Assignee: (was: Apache Spark) > Use python 3 style in release-build.sh >

[jira] [Created] (SPARK-31807) Use python 3 style in release-build.sh

William Hyun created SPARK-31807: Summary: Use python 3 style in release-build.sh Key: SPARK-31807 URL: https://issues.apache.org/jira/browse/SPARK-31807 Project: Spark Issue Type:

[jira] [Commented] (SPARK-31786) Exception on submitting Spark-Pi to Kubernetes 1.17.3

[ https://issues.apache.org/jira/browse/SPARK-31786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115436#comment-17115436 ] Dongjoon Hyun commented on SPARK-31786: --- Could you make a PR, [~maver1ck]? > Exception on