[jira] [Commented] (SPARK-3736) Workers should reconnect to Master if disconnected

2014-10-17 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14174753#comment-14174753 ] Andrew Ash commented on SPARK-3736: --- The configuration for Hadoop's retry policy was

[jira] [Updated] (SPARK-3940) Print the error code three times

2014-10-17 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Ash updated SPARK-3940: -- Description: if an error of SQL,the console print Error three times。 eg: {noformat} spark-sql show

[jira] [Updated] (SPARK-3940) Print the error code three times

2014-10-17 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Ash updated SPARK-3940: -- Fix Version/s: (was: 1.3.0) (was: 1.0.3) Print the error code three times

[jira] [Updated] (SPARK-3940) Print the error code three times

2014-10-17 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Ash updated SPARK-3940: -- Target Version/s: 1.1.1, 1.2.0 (was: 1.1.0) Print the error code three times

[jira] [Created] (SPARK-3988) Public API for DateType support

2014-10-17 Thread Adrian Wang (JIRA)
Adrian Wang created SPARK-3988: -- Summary: Public API for DateType support Key: SPARK-3988 URL: https://issues.apache.org/jira/browse/SPARK-3988 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-3541) Improve ALS internal storage

2014-10-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3541: - Shepherd: (was: Xiangrui Meng) Improve ALS internal storage

[jira] [Commented] (SPARK-2426) Quadratic Minimization for MLlib ALS

2014-10-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14174824#comment-14174824 ] Xiangrui Meng commented on SPARK-2426: -- [~debasish83] Thanks for working on this

[jira] [Closed] (SPARK-3606) Spark-on-Yarn AmIpFilter does not work with Yarn HA.

2014-10-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3606. Resolution: Fixed Fix Version/s: 1.1.1 Spark-on-Yarn AmIpFilter does not work with Yarn HA.

[jira] [Commented] (SPARK-3900) ApplicationMaster's shutdown hook fails and IllegalStateException is thrown.

2014-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14174857#comment-14174857 ] Apache Spark commented on SPARK-3900: - User 'sarutak' has created a pull request for

[jira] [Created] (SPARK-3989) Added the possibility to install Python packages via pip for pyspark directly from the ./spark_ec2 command

2014-10-17 Thread JIRA
Jan Zikeš created SPARK-3989: Summary: Added the possibility to install Python packages via pip for pyspark directly from the ./spark_ec2 command Key: SPARK-3989 URL: https://issues.apache.org/jira/browse/SPARK-3989

[jira] [Commented] (SPARK-3989) Added the possibility to install Python packages via pip for pyspark directly from the ./spark_ec2 command

2014-10-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14174876#comment-14174876 ] Jan Zikeš commented on SPARK-3989: -- Implemented and sent pull request here:

[jira] [Commented] (SPARK-3989) Added the possibility to install Python packages via pip for pyspark directly from the ./spark_ec2 command

2014-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14174879#comment-14174879 ] Apache Spark commented on SPARK-3989: - User 'ziky90' has created a pull request for

[jira] [Commented] (SPARK-3694) Allow printing object graph of tasks/RDD's with a debug flag

2014-10-17 Thread Ilya Ganelin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14174981#comment-14174981 ] Ilya Ganelin commented on SPARK-3694: - Hello. I would like to work on this. Can you

[jira] [Commented] (SPARK-3877) The exit code of spark-submit is still 0 when an yarn application fails

2014-10-17 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14174999#comment-14174999 ] Thomas Graves commented on SPARK-3877: -- [~vanzin] I agree. The user code should be

[jira] [Commented] (SPARK-576) Design and develop a more precise progress estimator

2014-10-17 Thread Dev Lakhani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175023#comment-14175023 ] Dev Lakhani commented on SPARK-576: --- I've created a PR for this:

[jira] [Commented] (SPARK-2649) EC2: Ganglia-httpd broken on hvm based machines like r3.4xlarge

2014-10-17 Thread Fred Cons (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175079#comment-14175079 ] Fred Cons commented on SPARK-2649: -- [~npanj] [~rxin] I ran into this issue, and the

[jira] [Created] (SPARK-3990) kryo.KryoException caused by ALS.trainImplicit in pyspark

2014-10-17 Thread Gen TANG (JIRA)
Gen TANG created SPARK-3990: --- Summary: kryo.KryoException caused by ALS.trainImplicit in pyspark Key: SPARK-3990 URL: https://issues.apache.org/jira/browse/SPARK-3990 Project: Spark Issue Type:

[jira] [Updated] (SPARK-3990) kryo.KryoException caused by ALS.trainImplicit in pyspark

2014-10-17 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gen TANG updated SPARK-3990: Description: When we tried ALS.trainImplicit() in pyspark environment, it only works for iterations = 1.

[jira] [Updated] (SPARK-3990) kryo.KryoException caused by ALS.trainImplicit in pyspark

2014-10-17 Thread Gen TANG (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gen TANG updated SPARK-3990: I think this problem is related to https://issues.apache.org/jira/browse/SPARK-1977 kryo.KryoException

[jira] [Created] (SPARK-3991) Not Serializable , Nullpinter Exceptions in SQL server mode

2014-10-17 Thread eblaas (JIRA)
eblaas created SPARK-3991: - Summary: Not Serializable , Nullpinter Exceptions in SQL server mode Key: SPARK-3991 URL: https://issues.apache.org/jira/browse/SPARK-3991 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-3991) Not Serializable , Nullpinter Exceptions in SQL server mode

2014-10-17 Thread eblaas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] eblaas updated SPARK-3991: -- Attachment: not_serializable_exception.patch Not Serializable , Nullpinter Exceptions in SQL server mode

[jira] [Commented] (SPARK-2426) Quadratic Minimization for MLlib ALS

2014-10-17 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175167#comment-14175167 ] Debasish Das commented on SPARK-2426: - 1. [~mengxr] Our legal was clear that Stanford

[jira] [Commented] (SPARK-3817) BlockManagerMasterActor: Got two different block manager registrations with Mesos

2014-10-17 Thread Brenden Matthews (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175279#comment-14175279 ] Brenden Matthews commented on SPARK-3817: - Appears to be a duplicate of SPARK-2445

[jira] [Closed] (SPARK-3935) Unused variable in PairRDDFunctions.scala

2014-10-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3935. Resolution: Fixed Fix Version/s: 1.2.0 Unused variable in PairRDDFunctions.scala

[jira] [Updated] (SPARK-3992) Spark 1.1.0 python binding cannot use any collections but list as Accumulators

2014-10-17 Thread Walter Bogorad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Bogorad updated SPARK-3992: -- Description: A dictionary accumulator defined as a global variable is not visible inside a

[jira] [Resolved] (SPARK-3979) Yarn backend's default file replication should match HDFS's default one

2014-10-17 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-3979. -- Resolution: Fixed Fix Version/s: 1.2.0 Yarn backend's default file replication should

[jira] [Commented] (SPARK-2426) Quadratic Minimization for MLlib ALS

2014-10-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175377#comment-14175377 ] Sean Owen commented on SPARK-2426: -- Regarding licensing, if the code is BSD licensed then

[jira] [Commented] (SPARK-3993) python worker may hang after reused from take()

2014-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175536#comment-14175536 ] Apache Spark commented on SPARK-3993: - User 'davies' has created a pull request for

[jira] [Created] (SPARK-3993) python worker may hang after reused from take()

2014-10-17 Thread Davies Liu (JIRA)
Davies Liu created SPARK-3993: - Summary: python worker may hang after reused from take() Key: SPARK-3993 URL: https://issues.apache.org/jira/browse/SPARK-3993 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-3855) Binding Exception when running PythonUDFs

2014-10-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3855. Resolution: Fixed Fix Version/s: 1.2.0 Binding Exception when running PythonUDFs

[jira] [Commented] (SPARK-3434) Distributed block matrix

2014-10-17 Thread Reza Zadeh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175557#comment-14175557 ] Reza Zadeh commented on SPARK-3434: --- Thanks Shivaram! As discussed over the phone, we

[jira] [Assigned] (SPARK-3994) countByKey / countByValue do not go through Aggregator

2014-10-17 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson reassigned SPARK-3994: - Assignee: Aaron Davidson countByKey / countByValue do not go through Aggregator

[jira] [Resolved] (SPARK-3985) json file path is not right

2014-10-17 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3985. --- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2834

[jira] [Created] (SPARK-3994) countByKey / countByValue do not go through Aggregator

2014-10-17 Thread Aaron Davidson (JIRA)
Aaron Davidson created SPARK-3994: - Summary: countByKey / countByValue do not go through Aggregator Key: SPARK-3994 URL: https://issues.apache.org/jira/browse/SPARK-3994 Project: Spark Issue

[jira] [Created] (SPARK-3995) pyspark's sample methods do not work with NumPy 1.9

2014-10-17 Thread Jeremy Freeman (JIRA)
Jeremy Freeman created SPARK-3995: - Summary: pyspark's sample methods do not work with NumPy 1.9 Key: SPARK-3995 URL: https://issues.apache.org/jira/browse/SPARK-3995 Project: Spark Issue

[jira] [Resolved] (SPARK-3934) RandomForest bug in sanity check in DTStatsAggregator

2014-10-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-3934. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2785

[jira] [Updated] (SPARK-3995) pyspark's sample methods do not work with NumPy 1.9

2014-10-17 Thread Jeremy Freeman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9.

[jira] [Updated] (SPARK-3995) pyspark's sample methods do not work with NumPy 1.9

2014-10-17 Thread Jeremy Freeman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9.

[jira] [Updated] (SPARK-3995) [PYSPARK] PySpark's sample methods do not work with NumPy 1.9

2014-10-17 Thread Jeremy Freeman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9.

[jira] [Updated] (SPARK-3995) [PYSPARK] PySpark's sample methods do not work with NumPy 1.9

2014-10-17 Thread Jeremy Freeman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9.

[jira] [Updated] (SPARK-3995) [PYSPARK] PySpark's sample methods do not work with NumPy 1.9

2014-10-17 Thread Jeremy Freeman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9.

[jira] [Updated] (SPARK-3995) [PYSPARK] PySpark's sample methods do not work with NumPy 1.9

2014-10-17 Thread Jeremy Freeman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9.

[jira] [Commented] (SPARK-3994) countByKey / countByValue do not go through Aggregator

2014-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175635#comment-14175635 ] Apache Spark commented on SPARK-3994: - User 'aarondav' has created a pull request for

[jira] [Commented] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

2014-10-17 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175647#comment-14175647 ] Ryan Williams commented on SPARK-3967: -- I've been debugging this issue as well and I

[jira] [Updated] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

2014-10-17 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Williams updated SPARK-3967: - Attachment: spark-1.1.0-utils-fetch.patch Don't redundantly copy executor dependency files in

[jira] [Updated] (SPARK-3995) [PYSPARK] PySpark's sample methods do not work with NumPy 1.9

2014-10-17 Thread Jeremy Freeman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeremy Freeman updated SPARK-3995: -- Description: There is a breaking bug in PySpark's sampling methods when run with NumPy v1.9.

[jira] [Commented] (SPARK-3990) kryo.KryoException caused by ALS.trainImplicit in pyspark

2014-10-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175671#comment-14175671 ] Xiangrui Meng commented on SPARK-3990: -- In PySpark 1.1, we switched to Kryo

[jira] [Updated] (SPARK-3164) Store DecisionTree Split.categories as Set

2014-10-17 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-3164: - Description: Improvement: computation For categorical features with many categories, it

[jira] [Updated] (SPARK-534) Make SparkContext thread-safe

2014-10-17 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Ash updated SPARK-534: - Description: SparkEnv (used by SparkContext) is not thread-safe and it causes issues with scala's Futures

[jira] [Created] (SPARK-3996) Shade Jetty in Spark deliverables

2014-10-17 Thread Mingyu Kim (JIRA)
Mingyu Kim created SPARK-3996: - Summary: Shade Jetty in Spark deliverables Key: SPARK-3996 URL: https://issues.apache.org/jira/browse/SPARK-3996 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

2014-10-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175748#comment-14175748 ] Sean Owen commented on SPARK-3967: -- You guys should make PRs for these. I am also not

[jira] [Updated] (SPARK-3161) Cache example-node map for DecisionTree training

2014-10-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3161: - Assignee: Sung Chung Cache example-node map for DecisionTree training

[jira] [Closed] (SPARK-3935) Unused variable in PairRDDFunctions.scala

2014-10-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3935. Resolution: Fixed Unused variable in PairRDDFunctions.scala -

[jira] [Reopened] (SPARK-3935) Unused variable in PairRDDFunctions.scala

2014-10-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-3935: -- Assignee: wangfei Unused variable in PairRDDFunctions.scala

[jira] [Updated] (SPARK-3888) Limit the memory used by python worker

2014-10-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3888: - Affects Version/s: 1.1.0 Limit the memory used by python worker --

[jira] [Updated] (SPARK-3822) Expose a mechanism for SparkContext to ask for / remove Yarn containers

2014-10-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3822: - Affects Version/s: 1.1.0 Expose a mechanism for SparkContext to ask for / remove Yarn containers

[jira] [Commented] (SPARK-3822) Expose a mechanism for SparkContext to ask for / remove Yarn containers

2014-10-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175811#comment-14175811 ] Apache Spark commented on SPARK-3822: - User 'andrewor14' has created a pull request

[jira] [Commented] (SPARK-3135) Avoid memory copy in TorrentBroadcast serialization

2014-10-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175838#comment-14175838 ] Reynold Xin commented on SPARK-3135: Is the memory usage lower on the master branch vs