[
https://issues.apache.org/jira/browse/SPARK-39457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17553901#comment-17553901
]
Ruslan Dautkhanov commented on SPARK-39457:
---
Is there a dependency on Hadoop to support IPv6
[
https://issues.apache.org/jira/browse/SPARK-26413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440731#comment-17440731
]
Ruslan Dautkhanov commented on SPARK-26413:
---
[https://github.com/apache/spark/pull/34505] is
[
https://issues.apache.org/jira/browse/SPARK-32399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214440#comment-17214440
]
Ruslan Dautkhanov commented on SPARK-32399:
---
Here's another view if that's helpful that shows
[
https://issues.apache.org/jira/browse/SPARK-32399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-32399:
--
Attachment: Screen Shot 2020-10-14 at 11.08.37 PM.png
> Support full outer join in
[
https://issues.apache.org/jira/browse/SPARK-32399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214426#comment-17214426
]
Ruslan Dautkhanov commented on SPARK-32399:
---
[~chengsu] thank you for all the Shuffled Hash
[
https://issues.apache.org/jira/browse/SPARK-32399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-32399:
--
Attachment: Screen Shot 2020-10-14 at 12.30.07 PM.png
> Support full outer join in
[
https://issues.apache.org/jira/browse/SPARK-32760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188612#comment-17188612
]
Ruslan Dautkhanov edited comment on SPARK-32760 at 9/1/20, 4:29 PM:
[
https://issues.apache.org/jira/browse/SPARK-32760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17188612#comment-17188612
]
Ruslan Dautkhanov commented on SPARK-32760:
---
[~smilegator] understood. Would be great to
[
https://issues.apache.org/jira/browse/SPARK-32759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov resolved SPARK-32759.
---
Resolution: Duplicate
> Support for INET data type
> --
>
>
Ruslan Dautkhanov created SPARK-32760:
-
Summary: Support for INET data type
Key: SPARK-32760
URL: https://issues.apache.org/jira/browse/SPARK-32760
Project: Spark
Issue Type: Sub-task
Ruslan Dautkhanov created SPARK-32759:
-
Summary: Support for INET data type
Key: SPARK-32759
URL: https://issues.apache.org/jira/browse/SPARK-32759
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-28367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17177202#comment-17177202
]
Ruslan Dautkhanov commented on SPARK-28367:
---
[~gsomogyi] thanks! yep would be great to learn
[
https://issues.apache.org/jira/browse/SPARK-32294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-32294:
--
Description:
`spark.sql.execution.arrow.maxRecordsPerBatch` is not respected for
Ruslan Dautkhanov created SPARK-32294:
-
Summary: GroupedData Pandas UDF 2Gb limit
Key: SPARK-32294
URL: https://issues.apache.org/jira/browse/SPARK-32294
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-28266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014467#comment-17014467
]
Ruslan Dautkhanov edited comment on SPARK-28266 at 1/13/20 4:46 PM:
[
https://issues.apache.org/jira/browse/SPARK-28266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014467#comment-17014467
]
Ruslan Dautkhanov commented on SPARK-28266:
---
Thank you for checking [~dongjoon]
That may have
[
https://issues.apache.org/jira/browse/SPARK-29224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002402#comment-17002402
]
Ruslan Dautkhanov commented on SPARK-29224:
---
E.g. would this work with 0.1m or 1m sparse
[
https://issues.apache.org/jira/browse/SPARK-29224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002398#comment-17002398
]
Ruslan Dautkhanov commented on SPARK-29224:
---
That's great.
Out of curiosity - what's largest
[
https://issues.apache.org/jira/browse/SPARK-21488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov reopened SPARK-21488:
---
> Make saveAsTable() and createOrReplaceTempView() return dataframe of created
>
[
https://issues.apache.org/jira/browse/SPARK-21488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988011#comment-16988011
]
Ruslan Dautkhanov commented on SPARK-21488:
---
[~zsxwing] any chance this can be added to Spark
[
https://issues.apache.org/jira/browse/SPARK-19842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987999#comment-16987999
]
Ruslan Dautkhanov commented on SPARK-19842:
---
>From the design document
"""
This alternative
[
https://issues.apache.org/jira/browse/SPARK-22340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971723#comment-16971723
]
Ruslan Dautkhanov commented on SPARK-22340:
---
Glad to see this is solved.
A nice side-effect
[
https://issues.apache.org/jira/browse/SPARK-29041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16953163#comment-16953163
]
Ruslan Dautkhanov commented on SPARK-29041:
---
[~hyukjin.kwon] thanks for getting back on this
[
https://issues.apache.org/jira/browse/SPARK-29041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16941289#comment-16941289
]
Ruslan Dautkhanov commented on SPARK-29041:
---
Thank you [~hyukjin.kwon]
Our users say this
[
https://issues.apache.org/jira/browse/SPARK-28266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-28266:
--
Summary: data duplication when `path` serde property is present (was: data
[
https://issues.apache.org/jira/browse/SPARK-28266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883222#comment-16883222
]
Ruslan Dautkhanov commented on SPARK-28266:
---
Another interesting side Spark bug found while
[
https://issues.apache.org/jira/browse/SPARK-28266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882381#comment-16882381
]
Ruslan Dautkhanov commented on SPARK-28266:
---
This issue happens `spark.sql.sources.provider`
[
https://issues.apache.org/jira/browse/SPARK-28266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16882200#comment-16882200
]
Ruslan Dautkhanov commented on SPARK-28266:
---
Suspecting change in SPARK-22158 causes this
>
[
https://issues.apache.org/jira/browse/SPARK-22158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881602#comment-16881602
]
Ruslan Dautkhanov commented on SPARK-22158:
---
[~dongjoon] I may have misreported it - sorry.
[
https://issues.apache.org/jira/browse/SPARK-22158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881437#comment-16881437
]
Ruslan Dautkhanov edited comment on SPARK-22158 at 7/9/19 6:57 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-22158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16881437#comment-16881437
]
Ruslan Dautkhanov commented on SPARK-22158:
---
[~dongjoon] can you please check if this causes
[
https://issues.apache.org/jira/browse/SPARK-28266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-28266:
--
Summary: data correctness issue: data duplication when `path` serde
property is
Ruslan Dautkhanov created SPARK-28266:
-
Summary: data correctness issue: data duplication when `path`
serde peroperty is present
Key: SPARK-28266
URL: https://issues.apache.org/jira/browse/SPARK-28266
[
https://issues.apache.org/jira/browse/SPARK-22151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-22151:
--
Comment: was deleted
(was: Is there is a workaround for this in Apache Livy?
We're
[
https://issues.apache.org/jira/browse/SPARK-22151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852381#comment-16852381
]
Ruslan Dautkhanov commented on SPARK-22151:
---
Is there is a workaround for this in Apache Livy?
[
https://issues.apache.org/jira/browse/SPARK-15463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840018#comment-16840018
]
Ruslan Dautkhanov edited comment on SPARK-15463 at 5/15/19 4:00 PM:
[
https://issues.apache.org/jira/browse/SPARK-15463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840018#comment-16840018
]
Ruslan Dautkhanov commented on SPARK-15463:
---
[~hyukjin.kwon] would it be possible to make
[
https://issues.apache.org/jira/browse/SPARK-15719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814061#comment-16814061
]
Ruslan Dautkhanov commented on SPARK-15719:
---
[~lian cheng] quick question on this part from
[
https://issues.apache.org/jira/browse/SPARK-21784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810124#comment-16810124
]
Ruslan Dautkhanov commented on SPARK-21784:
---
Any chance this can be part of Spark 3.0 release?
[
https://issues.apache.org/jira/browse/SPARK-26764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16777060#comment-16777060
]
Ruslan Dautkhanov commented on SPARK-26764:
---
That seems to be closely related to Hive
[
https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695427#comment-16695427
]
Ruslan Dautkhanov edited comment on SPARK-26019 at 11/22/18 12:42 AM:
[
https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16695427#comment-16695427
]
Ruslan Dautkhanov commented on SPARK-26019:
---
Thank you [~irashid]
I confirm that swapping
[
https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov reopened SPARK-26019:
---
> pyspark/accumulators.py: "TypeError: object of type 'NoneType' has no len()"
> in
[
https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov reopened SPARK-26019:
---
> pyspark/accumulators.py: "TypeError: object of type 'NoneType' has no len()"
> in
[
https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692716#comment-16692716
]
Ruslan Dautkhanov commented on SPARK-26019:
---
[~viirya] exception stack reads that error
[
https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692377#comment-16692377
]
Ruslan Dautkhanov commented on SPARK-26019:
---
[~irashid] thanks a lot for looking at this !
It
[
https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692237#comment-16692237
]
Ruslan Dautkhanov commented on SPARK-26019:
---
cc [~lucacanali]
> pyspark/accumulators.py:
[
https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692233#comment-16692233
]
Ruslan Dautkhanov commented on SPARK-26019:
---
Sorry, nope it was broken by this change -
[
https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692226#comment-16692226
]
Ruslan Dautkhanov commented on SPARK-26019:
---
Might be broken by
[
https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692219#comment-16692219
]
Ruslan Dautkhanov commented on SPARK-26019:
---
[~hyukjin.kwon] today I reproduced this first
[
https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov reopened SPARK-26019:
---
Reproduced myself
> pyspark/accumulators.py: "TypeError: object of type 'NoneType'
[
https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16690123#comment-16690123
]
Ruslan Dautkhanov commented on SPARK-26019:
---
That user said he has seen this error 4-5 times,
[
https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689056#comment-16689056
]
Ruslan Dautkhanov commented on SPARK-26041:
---
[~hyukjin.kwon] I didn't request investigation. I
[
https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689052#comment-16689052
]
Ruslan Dautkhanov commented on SPARK-26019:
---
No, it was the only instance I had for this
[
https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov resolved SPARK-26019.
---
Resolution: Cannot Reproduce
> pyspark/accumulators.py: "TypeError: object of type
[
https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-26041:
--
Environment:
Spark 2.3.2
Hadoop 2.6
When we materialize one of intermediate
[
https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686907#comment-16686907
]
Ruslan Dautkhanov edited comment on SPARK-26041 at 11/14/18 5:45 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686907#comment-16686907
]
Ruslan Dautkhanov edited comment on SPARK-26041 at 11/14/18 5:45 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686907#comment-16686907
]
Ruslan Dautkhanov commented on SPARK-26041:
---
thank for checking this [~mgaido]
just attached
[
https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-26041:
--
Attachment: SPARK-26041.txt
> catalyst cuts out some columns from dataframes:
>
[
https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686851#comment-16686851
]
Ruslan Dautkhanov commented on SPARK-26041:
---
Thanks for referencing that jira [~mgaido]
[
https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-26041:
--
Affects Version/s: 2.3.0
2.3.1
> catalyst cuts out some
[
https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685592#comment-16685592
]
Ruslan Dautkhanov commented on SPARK-26041:
---
There are a couple of related jiras that were
[
https://issues.apache.org/jira/browse/SPARK-26041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685589#comment-16685589
]
Ruslan Dautkhanov commented on SPARK-26041:
---
Issue might be introduced by SPARK-9830
Comment
Ruslan Dautkhanov created SPARK-26041:
-
Summary: catalyst cuts out some columns from dataframes:
org.apache.spark.sql.catalyst.errors.package$TreeNodeException: Binding
attribute
Key: SPARK-26041
URL:
Ruslan Dautkhanov created SPARK-26019:
-
Summary: pyspark/accumulators.py: "TypeError: object of type
'NoneType' has no len()" in authenticate_and_accum_updates()
Key: SPARK-26019
URL:
[
https://issues.apache.org/jira/browse/SPARK-25958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681892#comment-16681892
]
Ruslan Dautkhanov commented on SPARK-25958:
---
Yep, the pyspark job completes fine afetr we
[
https://issues.apache.org/jira/browse/SPARK-25958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov resolved SPARK-25958.
---
Resolution: Not A Problem
> error: [Errno 97] Address family not supported by
[
https://issues.apache.org/jira/browse/SPARK-24244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681735#comment-16681735
]
Ruslan Dautkhanov commented on SPARK-24244:
---
[~maxgekk] great improvement
is this new option
[
https://issues.apache.org/jira/browse/SPARK-25958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679261#comment-16679261
]
Ruslan Dautkhanov commented on SPARK-25958:
---
[~XuanYuan] interesting.. here's our /etc/hosts:
[
https://issues.apache.org/jira/browse/SPARK-25958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679263#comment-16679263
]
Ruslan Dautkhanov commented on SPARK-25958:
---
I just removed ipv6 reference ::1 in /etc/hosts
[
https://issues.apache.org/jira/browse/SPARK-25958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678894#comment-16678894
]
Ruslan Dautkhanov edited comment on SPARK-25958 at 11/7/18 10:35 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-25958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678894#comment-16678894
]
Ruslan Dautkhanov commented on SPARK-25958:
---
We do have ipv6 disabled on our hadoop servers,
[
https://issues.apache.org/jira/browse/SPARK-25958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-25958:
--
Issue Type: Bug (was: New Feature)
> error: [Errno 97] Address family not supported
[
https://issues.apache.org/jira/browse/SPARK-25958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-25958:
--
Description:
Following error happens on a heavy Spark job after 4 hours of runtime..
Ruslan Dautkhanov created SPARK-25958:
-
Summary: error: [Errno 97] Address family not supported by
protocol in dataframe.take()
Key: SPARK-25958
URL: https://issues.apache.org/jira/browse/SPARK-25958
[
https://issues.apache.org/jira/browse/SPARK-25863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667721#comment-16667721
]
Ruslan Dautkhanov edited comment on SPARK-25863 at 10/29/18 8:37 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-25863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667721#comment-16667721
]
Ruslan Dautkhanov commented on SPARK-25863:
---
[~mgaido], I will try to get a reproducer, but it
[
https://issues.apache.org/jira/browse/SPARK-22505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667478#comment-16667478
]
Ruslan Dautkhanov commented on SPARK-22505:
---
Thank you! That worked
> toDF() /
[
https://issues.apache.org/jira/browse/SPARK-25863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1736#comment-1736
]
Ruslan Dautkhanov commented on SPARK-25863:
---
It seems error happens here
[
https://issues.apache.org/jira/browse/SPARK-25863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-25863:
--
Affects Version/s: 2.3.1
> java.lang.UnsupportedOperationException: empty.max at
>
[
https://issues.apache.org/jira/browse/SPARK-25863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1726#comment-1726
]
Ruslan Dautkhanov commented on SPARK-25863:
---
This happens only on one of our heaviest Spark
Ruslan Dautkhanov created SPARK-25863:
-
Summary: java.lang.UnsupportedOperationException: empty.max at
org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$.updateAndGetCompilationStats(CodeGenerator.scala:1475)
[
https://issues.apache.org/jira/browse/SPARK-25814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661282#comment-16661282
]
Ruslan Dautkhanov commented on SPARK-25814:
---
thank you [~vanzin] ! I will try to tune those
[
https://issues.apache.org/jira/browse/SPARK-25814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-25814:
--
Priority: Major (was: Critical)
> spark driver runs out of memory on
[
https://issues.apache.org/jira/browse/SPARK-25814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-25814:
--
Description:
We're looking into issue when even huge spark driver memory gets
[
https://issues.apache.org/jira/browse/SPARK-25814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-25814:
--
Description:
We're looking into issue when even huge spark driver memory gets
[
https://issues.apache.org/jira/browse/SPARK-25814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-25814:
--
Description:
We're looking into issue when even huge spark driver memory gets
[
https://issues.apache.org/jira/browse/SPARK-25814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-25814:
--
Attachment: image-2018-10-23-14-06-53-722.png
> spark driver runs out of memory on
Ruslan Dautkhanov created SPARK-25814:
-
Summary: spark driver runs out of memory on
org.apache.spark.util.kvstore.InMemoryStore
Key: SPARK-25814
URL: https://issues.apache.org/jira/browse/SPARK-25814
[
https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659374#comment-16659374
]
Ruslan Dautkhanov commented on SPARK-13587:
---
We're using conda environments shared across
[
https://issues.apache.org/jira/browse/SPARK-22947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16658401#comment-16658401
]
Ruslan Dautkhanov commented on SPARK-22947:
---
Perhaps at least part of implementation can be
[
https://issues.apache.org/jira/browse/SPARK-25643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652039#comment-16652039
]
Ruslan Dautkhanov commented on SPARK-25643:
---
[~viirya] we confirm this problem on our
[
https://issues.apache.org/jira/browse/SPARK-22505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263733#comment-16263733
]
Ruslan Dautkhanov edited comment on SPARK-22505 at 10/5/18 8:26 PM:
[
https://issues.apache.org/jira/browse/SPARK-25164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640045#comment-16640045
]
Ruslan Dautkhanov commented on SPARK-25164:
---
Thank you [~bersprockets] - SPARK-25643 would be
[
https://issues.apache.org/jira/browse/SPARK-25164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614020#comment-16614020
]
Ruslan Dautkhanov commented on SPARK-25164:
---
Hi [~bersprockets]
Thanks a lot for the
[
https://issues.apache.org/jira/browse/SPARK-25164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614020#comment-16614020
]
Ruslan Dautkhanov edited comment on SPARK-25164 at 9/13/18 8:19 PM:
[
https://issues.apache.org/jira/browse/SPARK-25164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16611089#comment-16611089
]
Ruslan Dautkhanov edited comment on SPARK-25164 at 9/11/18 7:00 PM:
[
https://issues.apache.org/jira/browse/SPARK-25164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16611089#comment-16611089
]
Ruslan Dautkhanov commented on SPARK-25164:
---
Thanks [~bersprockets]
Very good find ! Thanks.
[
https://issues.apache.org/jira/browse/SPARK-24316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603590#comment-16603590
]
Ruslan Dautkhanov commented on SPARK-24316:
---
Thanks [~bersprockets]
Is cloudera
1 - 100 of 235 matches
Mail list logo
