user
Thread
Date
Earlier messages
Later messages
Messages by Thread
Final reminder: ApacheCon North America call for presentations closing soon
Rich Bowen
[SQL] Why does a small two-source JDBC query take ~150-200ms with all optimizations (AQE, CBO, pushdown, Kryo, unsafe) enabled? (v3.4.0-SNAPSHOT)
Gavin Ray
Spark 3 migration question
Jason Xu
What does Apache Spark do?
Turritopsis Dohrnii Teo En Ming
Re: What does Apache Spark do?
Pasha Finkelshtein
Stopping streaming after the write commit and before the read commit?
kineret M
A scene with unstable Spark performance
Bowen Song
Re: A scene with unstable Spark performance
Qian SUN
Re: A scene with unstable Spark performance
Bowen Song
Re: A scene with unstable Spark performance
Sungwoo Park
Re: A scene with unstable Spark performance
Chang Chen
Reverse proxy for Spark UI on Kubernetes
bo yang
Re: Reverse proxy for Spark UI on Kubernetes
Holden Karau
Re: Reverse proxy for Spark UI on Kubernetes
bo yang
Re: Reverse proxy for Spark UI on Kubernetes
wilson
Re: Reverse proxy for Spark UI on Kubernetes
bo yang
Re: Reverse proxy for Spark UI on Kubernetes
Holden Karau
Re: Reverse proxy for Spark UI on Kubernetes
bo yang
[Spark SQL]: Configuring/Using Spark + Catalyst optimally for read-heavy transactional workloads in JDBC sources?
Gavin Ray
Re: [Spark SQL]: Configuring/Using Spark + Catalyst optimally for read-heavy transactional workloads in JDBC sources?
Gavin Ray
[Spark SQL]: Does Spark SQL support WAITFOR?
K. N. Ramachandran
Re: [Spark SQL]: Does Spark SQL support WAITFOR?
K. N. Ramachandran
Re: [Spark SQL]: Does Spark SQL support WAITFOR?
Sean Owen
Re: [Spark SQL]: Does Spark SQL support WAITFOR?
K. N. Ramachandran
Re: [Spark SQL]: Does Spark SQL support WAITFOR?
Artemis User
Re: [Spark SQL]: Does Spark SQL support WAITFOR?
Someshwar Kale
Structured streaming help on releasing memory
Xavi Gervilla
Spark on K8s - repeating annoying exception
Shay Elbaz
Re: Spark on K8s - repeating annoying exception
Martin Grigorov
RE: [EXTERNAL] Re: Spark on K8s - repeating annoying exception
Shay Elbaz
How do I read parquet with python object
ben
Re: How do I read parquet with python object
Sean Owen
Need help on migrating Spark on Hortonworks to Kubernetes Cluster
Chetan Khatri
Count() action leading to errors | Pyspark
Sid
Re: Count() action leading to errors | Pyspark
Bjørn Jørgensen
groupby question
Irene Markelic
Re: groupby question
wilson
Something about Spark which has bothered me for a very long time, which I've never understood
Denarian Kislata
Re: Something about Spark which has bothered me for a very long time, which I've never understood
Lalwani, Jayesh
Kafka Spark Structure Streaming Error
nayan sharma
Disable/Remove datasources in Spark
Aditya
Re: Disable/Remove datasources in Spark
wilson
Re: Disable/Remove datasources in Spark
Aditya
Re: Disable/Remove datasources in Spark
wilson
Re: Disable/Remove datasources in Spark
wilson
trouble using spark in kubernetes
Andreas Klos
Re: Spark error with jupyter
Bjørn Jørgensen
Re: Spark error with jupyter
Gourav Sengupta
REMINDER - Travel Assistance available for ApacheCon NA New Orleans 2022
Gavin McDonald
Parse Execution Plan from PySpark
Pablo Alcain
RE: [EXTERNAL] Parse Execution Plan from PySpark
Shay Elbaz
Re: [EXTERNAL] Parse Execution Plan from PySpark
Walaa Eldin Moustafa
Re: [EXTERNAL] Parse Execution Plan from PySpark
Pablo Alcain
Idea for improving performance when reading from hive-like partition folders and specifying a filter [Spark 3.2]
Martin
how spark handle the abnormal values
wilson
Re: how spark handle the abnormal values
wilson
Re: how spark handle the abnormal values
Artemis User
Re: how spark handle the abnormal values
Mich Talebzadeh
Re: how spark handle the abnormal values
wilson
spark null values calculation
wilson
Re: spark null values calculation
wilson
structured streaming- checkpoint metadata growing indefinetely
Wojciech Indyk
Re: structured streaming- checkpoint metadata growing indefinetely
Wojciech Indyk
Re: structured streaming- checkpoint metadata growing indefinetely
Gourav Sengupta
Re: structured streaming- checkpoint metadata growing indefinetely
Wojciech Indyk
Re: structured streaming- checkpoint metadata growing indefinetely
Wojciech Indyk
Reg: CVE-2020-9480
Sundar Sabapathi Meenakshi
Re: Reg: CVE-2020-9480
Sean Owen
[window aggregate][debug] Rows not dropping with watermark and window
Xavier Gervilla
Dealing with large number of small files
Sid
Re: Dealing with large number of small files
Bjørn Jørgensen
Re: Dealing with large number of small files
Artemis User
Re: Dealing with large number of small files
Gourav Sengupta
Re: Dealing with large number of small files
Bjørn Jørgensen
Re: Dealing with large number of small files
Sid
Re: Dealing with large number of small files
Bjørn Jørgensen
Re: Dealing with large number of small files
Sid
Re: Dealing with large number of small files
Gourav Sengupta
Re: Dealing with large number of small files
Sid
Vulnerabilities in htrace-core4-4.1.0-incubating.jar jar used in spark.
HARSH TAKKAR
Re: Vulnerabilities in htrace-core4-4.1.0-incubating.jar jar used in spark.
Bjørn Jørgensen
Re: Vulnerabilities in htrace-core4-4.1.0-incubating.jar jar used in spark.
Bjørn Jørgensen
Re: Vulnerabilities in htrace-core4-4.1.0-incubating.jar jar used in spark.
HARSH TAKKAR
Re: Vulnerabilities in htrace-core4-4.1.0-incubating.jar jar used in spark.
Artemis User
Log4j vulnerability fix | CVE-2021-44228
Shankar, Prakash
RE: Log4j vulnerability fix | CVE-2021-44228
Shankar, Prakash
Spark job failing and not giving error to do diagnosis
rajat kumar
Streaming write to orc problem
hsy...@gmail.com
Re: Streaming write to orc problem
Mich Talebzadeh
Re: Streaming write to orc problem
Gourav Sengupta
Spark3.2 on K8s with proxy-user
Pralabh Kumar
Re: Spark3.2 on K8s with proxy-user
Pralabh Kumar
[ANNOUNCE] Apache Kyuubi (Incubating) released 1.5.1-incubating
Fu Chen
Why is spark running multiple stages with the same code line?
Joe
Re: Why is spark running multiple stages with the same code line?
Sean Owen
Re: Why is spark running multiple stages with the same code line?
Joe
Re: Why is spark running multiple stages with the same code line?
Sean Owen
Re: Why is spark running multiple stages with the same code line?
Russell Spitzer
[Spark Core]: Unexpectedly exiting executor while gracefully decommissioning
Yeachan Park
[Spark Core]: Unexpectedly exiting executor while gracefully decommissioning
Yeachan Park
[Spark Core]: Unexpectedly exiting executor while gracefully decommissioning
Saurabh Gulati
When should we cache / persist ? After or Before Actions?
Sid
Re: When should we cache / persist ? After or Before Actions?
Sean Owen
Re: When should we cache / persist ? After or Before Actions?
Yuri Oleynikov (יורי אולייניקוב)
Re: When should we cache / persist ? After or Before Actions?
Koert Kuipers
Re: When should we cache / persist ? After or Before Actions?
Sean Owen
Re: RDD memory use question
Sean Owen
Grouping and counting occurences of specific column rows
marc nicole
Re: Grouping and counting occurences of specific column rows
Sean Owen
Re: Grouping and counting occurences of specific column rows
marc nicole
Grouping and counting occurences of specific column rows
marc nicole
How is union() implemented? Need to implement column bind
Andrew Davidson
Re: How is union() implemented? Need to implement column bind
Sean Owen
Re: How is union() implemented? Need to implement column bind
Andrew Davidson
Re: How is union() implemented? Need to implement column bind
Sean Owen
Re: How is union() implemented? Need to implement column bind
Bjørn Jørgensen
Re: How is union() implemented? Need to implement column bind
Sean Owen
Re: How is union() implemented? Need to implement column bind
Andrew Melo
Re: How is union() implemented? Need to implement column bind
Sean Owen
Re: How is union() implemented? Need to implement column bind
Andrew Davidson
Re: How is union() implemented? Need to implement column bind
Sean Owen
Re: How is union() implemented? Need to implement column bind
Andrew Davidson
Re: How is union() implemented? Need to implement column bind
Sean Owen
Re: How is union() implemented? Need to implement column bind
Sonal Goyal
Re: How is union() implemented? Need to implement column bind
Sean Owen
[Spark Streaming] [Debug] Memory error when using NER model in Python
Xavier Gervilla
Re: [Spark Streaming] [Debug] Memory error when using NER model in Python
Sean Owen
Re: [Spark Streaming] [Debug] Memory error when using NER model in Python
Bjørn Jørgensen
Re: [Spark Streaming] [Debug] Memory error when using NER model in Python
Jungtaek Lim
Re: [Spark Streaming] [Debug] Memory error when using NER model in Python
Bjørn Jørgensen
Re: [Spark Streaming] [Debug] Memory error when using NER model in Python
Bjørn Jørgensen
Re: [Spark Streaming] [Debug] Memory error when using NER model in Python
Bjørn Jørgensen
Re: [Spark Streaming] [Debug] Memory error when using NER model in Python
Xavier Gervilla
[Spark Web UI] Integrating Keycloak SSO
Solomon, Brad
Please Review My Code
marc nicole
Custom metrics in py-spark 3
Harut Martirosyan
Monitoring with elastic search in spark job
Xinyu Luan
Re: Monitoring with elastic search in spark job
wilson
Spark sql slowness in Spark 3.0.1
Anil Dasari
Re: Spark sql slowness in Spark 3.0.1
Sergey B.
Re: Spark sql slowness in Spark 3.0.1
wilson
Re: {EXT} Re: Spark sql slowness in Spark 3.0.1
Anil Dasari
Problems with DataFrameReader in Structured Streaming
Artemis User
[Spark Streaming]: Why planInputPartitions is called multiple times for each micro-batch in Spark 3?
Hussain, Saghir
Streaming partition-by data locality for state lookupon executor
Sandip Khanzode
How to overwrite PySpark DataFrame schema without data scan?
Rafał Wojdyła
cannot access class sun.nio.ch.DirectBuffer
Arunachalam Sibisakkaravarthi
Re: cannot access class sun.nio.ch.DirectBuffer
Sean Owen
Re: cannot access class sun.nio.ch.DirectBuffer
Andrew Melo
Re: cannot access class sun.nio.ch.DirectBuffer
Sean Owen
Re: cannot access class sun.nio.ch.DirectBuffer
Andrew Melo
Re: cannot access class sun.nio.ch.DirectBuffer
Sean Owen
Re: cannot access class sun.nio.ch.DirectBuffer
Arunachalam Sibisakkaravarthi
Re: cannot access class sun.nio.ch.DirectBuffer
Sean Owen
Re: cannot access class sun.nio.ch.DirectBuffer
Arunachalam Sibisakkaravarthi
Question about bucketing and custom partitioners
David Diebold
Re: Question about bucketing and custom partitioners
ayan guha
Re: Question about bucketing and custom partitioners
Lalwani, Jayesh
Re: Question about bucketing and custom partitioners
Gourav Sengupta
Re: A simple comparison for three SQL engines
Wes Peng
binaryFile write
Philipp Kraus
Grabbing the current MemoryManager in a plugin
Andrew Melo
Re: Grabbing the current MemoryManager in a plugin
Andrew Melo
Spark Write BinaryType Column as continues file to S3
Philipp Kraus
Re: Spark Write BinaryType Column as continues file to S3
Sean Owen
Re: Spark Write BinaryType Column as continues file to S3
Bjørn Jørgensen
Re: Spark Write BinaryType Column as continues file to S3
Sean Owen
Re: Spark Write BinaryType Column as continues file to S3
Lalwani, Jayesh
Fwd: Spark Write BinaryType Column as continues file to S3
Philipp Kraus
Fwd: Spark Write BinaryType Column as continues file to S3
Philipp Kraus
Re: Spark Write BinaryType Column as continues file to S3
Bjørn Jørgensen
Aggregate over a column: the proper way to do
sam smith
Re: Aggregate over a column: the proper way to do
Sean Owen
Re: Aggregate over a column: the proper way to do
sam smith
Re: Aggregate over a column: the proper way to do
sam smith
Re: Aggregate over a column: the proper way to do
Sean Owen
Re: Aggregate over a column: the proper way to do
sam smith
Re: Aggregate over a column: the proper way to do
sam smith
negative time duration in event log accumulables
wangcheng (AK)
Executorlost failure
rajat kumar
Re: Executorlost failure
rajat kumar
Re: Executorlost failure
Wes Peng
Re: Executorlost failure
Wes Peng
Re: Executorlost failure
rajat kumar
Re: Executorlost failure
Wes Peng
Spark 3.0.1 and spark 3.2 compatibility
Pralabh Kumar
Re: Spark 3.0.1 and spark 3.2 compatibility
Sean Owen
Re: Spark 3.0.1 and spark 3.2 compatibility
Gourav Sengupta
Re: Spark 3.0.1 and spark 3.2 compatibility
Darcy Shen
query time comparison to several SQL engines
Wes Peng
Re: query time comparison to several SQL engines
Jacek Laskowski
Re: query time comparison to several SQL engines
James Turton
[Spark] spark client for Hadoop 2.x
Amin Borjian
Re: [Spark] spark client for Hadoop 2.x
Morven Huang
Writing Custom Spark Readers and Writers
Dyanesh Varun
Re: Writing Custom Spark Readers and Writers
daniel queiroz
Re: Writing Custom Spark Readers and Writers
Dyanesh Varun
Re: Writing Custom Spark Readers and Writers
Cheng Pan
Re: Writing Custom Spark Readers and Writers
Enrico Minack
protobuf data as input to spark streaming
Kiran Biswal
Earlier messages
Later messages