[Bug 2006675] [NEW] Memory leak when hdmi switcher is not sending data/not outputting

2023-02-08 Thread Lowell R Holden
Public bug reported: Main problem: Gnome-shell has a memory leak when my hdmi switcher is on a channel that is currently not inputting hdmi (i.e. desktop on hdmi 2 but hdmi 3 is selected with nothing inserted). This memory leak does not happen if signal is being sent through the hdmi switcher e

[Desktop-packages] [Bug 2006675] [NEW] Memory leak when hdmi switcher is not sending data/not outputting

2023-02-08 Thread Lowell R Holden
Public bug reported: Main problem: Gnome-shell has a memory leak when my hdmi switcher is on a channel that is currently not inputting hdmi (i.e. desktop on hdmi 2 but hdmi 3 is selected with nothing inserted). This memory leak does not happen if signal is being sent through the hdmi switcher e

Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-08 Thread Holden Karau
ngh : >>>>>>>> >>>>>>>>> Greetings everyone! >>>>>>>>> I am super new to this group and currently leading some work to >>>>>>>>> deploy spark on k8 for my company o9 Solutions. >>>>>

Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-08 Thread Holden Karau
ll make another doodle for the following week with more european friendly times. Let me know what folks think :) On Tue, Feb 7, 2023 at 3:23 PM Holden Karau wrote: > Hi Folks, > > It seems like we could maybe use some additional shared context around > Spark on Kube so I’d like to try an

Re: Spark on Kube (virtua) coffee/tea/pop times

2023-02-07 Thread Holden Karau
Awesome, I guess I should have asked folks for timezones that they’re in. On Tue, Feb 7, 2023 at 3:30 PM Andrew Melo wrote: > Hello Holden, > > We are interested in Spark on k8s and would like the opportunity to > speak with devs about what we're looking for slash better wa

Spark on Kube (virtua) coffee/tea/pop times

2023-02-07 Thread Holden Karau
with coffee and Spark devs does not sound like your thing, just trying to make something informal so we can have a better understanding of everyone’s goals here. Cheers, Holden :) -- Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https://amzn.to

[jira] [Created] (SPARK-42361) Add an option to use external storage to distribute JAR set in cluster mode on Kube

2023-02-06 Thread Holden Karau (Jira)
Holden Karau created SPARK-42361: Summary: Add an option to use external storage to distribute JAR set in cluster mode on Kube Key: SPARK-42361 URL: https://issues.apache.org/jira/browse/SPARK-42361

[jira] [Created] (SPARK-42261) K8s will not allocate more execs if there are any pending execs until next snapshot

2023-01-31 Thread Holden Karau (Jira)
Holden Karau created SPARK-42261: Summary: K8s will not allocate more execs if there are any pending execs until next snapshot Key: SPARK-42261 URL: https://issues.apache.org/jira/browse/SPARK-42261

[jira] [Created] (SPARK-42260) Log when the K8s Exec Pods Allocator Stalls

2023-01-31 Thread Holden Karau (Jira)
Holden Karau created SPARK-42260: Summary: Log when the K8s Exec Pods Allocator Stalls Key: SPARK-42260 URL: https://issues.apache.org/jira/browse/SPARK-42260 Project: Spark Issue Type

[jira] [Created] (SPARK-42173) IPv6 address mapping can fail with sparse addresses

2023-01-24 Thread Holden Karau (Jira)
Holden Karau created SPARK-42173: Summary: IPv6 address mapping can fail with sparse addresses Key: SPARK-42173 URL: https://issues.apache.org/jira/browse/SPARK-42173 Project: Spark Issue

[jira] [Created] (SPARK-42035) Add a config flag to force exit on JDK major version mismatch

2023-01-12 Thread Holden Karau (Jira)
Holden Karau created SPARK-42035: Summary: Add a config flag to force exit on JDK major version mismatch Key: SPARK-42035 URL: https://issues.apache.org/jira/browse/SPARK-42035 Project: Spark

[LincolnTalk] Town Moderator Asks for your VOTE

2023-01-10 Thread sarah cannon holden
perspectives - and I am ever hopeful that they will step forth to serve on a board or committee.I look forward to seeing you at Town Meeting on Saturday, March 25th and I ask for your vote on Monday, March 27, 2023. Sarah Cannon Holden Weston Road -- The LincolnTalk mailing list. To post, send

Re: [LincolnTalk] Any Ice Skating Stories?

2022-12-22 Thread Sarah Cannon Holden
of? June -Original Message- From: Lincoln <lincoln-boun...@lincolntalk.org> On Behalf Of Sarah Cannon Holden Sent: Thursday, December 22, 2022 5:52 PM To: Susan Taylor <svhtay...@comcast.net> Cc: LincolnTalk <lincoln@lincolntalk.org> Subject: Re: [LincolnTalk] Any Ice Ska

Re: [LincolnTalk] Any Ice Skating Stories?

2022-12-22 Thread Sarah Cannon Holden
I remember skating on Long Pond in the 1950s. Anyone know where it is? Sarah Cannon Holden > On Dec 22, 2022, at 2:15 PM, Susan Taylor wrote: > > Just for fun, share your favorite stories/memories of ice skating in Lincoln! > I remember thick black ice on Beaver Pond in the 1

[Python-Dev] Re: Feature Request: Adding Way to Annotate Class Variables Distinct from Instance Variables

2022-12-21 Thread Steve Holden
Well, the first comment is that this isn't really the best list to ask such questions on, since it was created for the Python developers to discuss the development of the language and its implementation. Further, such discussions nowadays take place on discuss.python.org, and you can find more info

[jira] [Resolved] (SPARK-33782) Place spark.files, spark.jars and spark.files under the current working directory on the driver in K8S cluster mode

2022-12-12 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-33782. -- Fix Version/s: 3.4.0 Assignee: Pralabh Kumar Resolution: Fixed > Pl

[spark] branch master updated: [SPARK-33782][K8S][CORE] Place spark.files, spark.jars and spark.files under the current working directory on the driver in K8S cluster mode

2022-12-12 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new af8dd411aa9 [SPARK-33782][K8S][CORE] Place

Re: [PySpark] Reader/Writer for bgzipped data

2022-12-06 Thread Holden Karau
Take a look at https://github.com/nielsbasjes/splittablegzip :D On Tue, Dec 6, 2022 at 7:46 AM Oliver Ruebenacker < oliv...@broadinstitute.org> wrote: > > Hello Holden, > > Thank you for the response, but what is "splittable gzip"? > > Best, Oliver

Re: [PySpark] Reader/Writer for bgzipped data

2022-12-06 Thread Holden Karau
There is the splittable gzip Hadoop input format, maybe someone could extend that to use support bgzip? On Tue, Dec 6, 2022 at 1:43 PM Oliver Ruebenacker < oliv...@broadinstitute.org> wrote: > > Hello Chris, > > Yes, you can use gunzip/gzip to uncompress a file created by bgzip, but > to s

In Remembrance of Kyle

2022-12-05 Thread Holden Karau
o hear them and I'll collect them and pass them on to his family. Take care of each other. Hugs & Love, Holden

Re: [VOTE] New Provider: Cloudera

2022-12-03 Thread Holden Karau
non-binding +1 On Sat, Dec 3, 2022 at 3:55 AM Jarek Potiuk wrote: > I think cloudera is important player in our ecosystem and as long as > it passes all the bars (i.e. 2.3.0+ compatibility and good > non-conflicting dependencies, passing all the tests, I am +1. > > On Sat, Dec 3, 2022 at 12:51 P

Re: Syndicate Apache Spark Twitter to Mastodon?

2022-12-01 Thread Holden Karau
s are in Twitter) > For Federated features, I think Slack would be a better platform, a lot > of Apache Big data projects have slack for federated features > > чт, 1 дек. 2022 г., 02:33 Holden Karau : > >> I agree that there is probably a majority still on twitter, but it would &

Re: Syndicate Apache Spark Twitter to Mastodon?

2022-11-30 Thread Holden Karau
? > > I believe the most devs are still using Twitter. > > > чт, 1 дек. 2022 г., 01:35 Holden Karau : > >> Do we want to start syndicating Apache Spark Twitter to a Mastodon >> instance. It seems like a lot of software dev folks are moving over there >> and it would

Syndicate Apache Spark Twitter to Mastodon?

2022-11-30 Thread Holden Karau
Do we want to start syndicating Apache Spark Twitter to a Mastodon instance. It seems like a lot of software dev folks are moving over there and it would be good to reach our users where they are. Any objections / concerns? Any thoughts on which server we should pick if we do this? -- Twitter: ht

[LincolnTalk] A momentary change of focus.

2022-11-28 Thread sarah cannon holden
f one part of that history would be interesting to others in Lincoln. Sarah Cannon Holden In 1943 my father, Bradford Cannon, led the team of surgeons who cared for the survivors of the Cocoanut Grove fire. Fifty years later, my brother Laurie was a senior captain with United Airlines. The

Re: Dataproc serverless for Spark

2022-11-28 Thread Holden Karau
This sounds like a great question for the Google DataProc folks (I know there was some interesting work being done around it but I left before it was finished so I don't want to provide a possibly incorrect answer). If your a GCP customer try reaching out to their support for details. On Mon, Nov

[jira] [Resolved] (SPARK-39799) DataSourceV2: View catalog interface

2022-11-16 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-39799. -- Fix Version/s: 3.4.0 Resolution: Fixed > DataSourceV2: View catalog interf

[jira] [Assigned] (SPARK-39799) DataSourceV2: View catalog interface

2022-11-16 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau reassigned SPARK-39799: Assignee: John Zhuge > DataSourceV2: View catalog interf

[spark] branch master updated: [SPARK-39799][SQL] DataSourceV2: View catalog interface

2022-11-16 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d12abff7e83 [SPARK-39799][SQL] DataSourceV2

Re: [BVARC] noise eliminating headset/microphone for HT

2022-10-31 Thread David Holden via BVARC
Sheree, Your Anytone has Bluetooth. I have the same HT and connected a Bluetooth headset to it. - David WJ9O > On Oct 31, 2022, at 5:58 PM, Sheree Horton via BVARC wrote: > >  > I need a headset with an attached microphone to use with my Yaesu FT60R > and/or my Anytone 878UCII Plus for m

Re: Dynamic Scaling without Kubernetes

2022-10-26 Thread Holden Karau
So Spark can dynamically scale on YARN, but standalone mode becomes a bit complicated — where do you envision Spark gets the extra resources from? On Wed, Oct 26, 2022 at 12:18 PM Artemis User wrote: > Has anyone tried to make a Spark cluster dynamically scalable, i.e., > adding a new worker nod

[Python-Dev] Re: problem with Distributed File System Replication and Namespacing and different versions of Python 3

2022-10-26 Thread Steve Holden
I don't remember it being mentioned, but much of the traffic recently migrated from this list to https://discuss.python.org/c/core-dev/23, which you may wish to keep in touch with. Kind regards, Steve On Tue, Oct 25, 2022 at 7:53 AM Juan Cristóbal Quesada < rainonthescarecrowhumanwhe...@gmail.co

[jira] [Created] (SPARK-40850) Tests for Spark SQL Intrepetered Queries may execute Codegen

2022-10-19 Thread Holden Karau (Jira)
Holden Karau created SPARK-40850: Summary: Tests for Spark SQL Intrepetered Queries may execute Codegen Key: SPARK-40850 URL: https://issues.apache.org/jira/browse/SPARK-40850 Project: Spark

[LincolnTalk] Reminder: Crafters, Art Teachers, Quilters

2022-10-08 Thread sarah cannon holden
Good Beautiful Morning! REMINDER. 9-2 Today - BIG SALE and GIVEAWAY of all sorts of fun fabrics, threads, yarn, beads... at 60 Weston Road. Hope to see you today. Sarah Cannon Holden -- The LincolnTalk mailing list. To post, send mail to Lincoln@lincolntalk.org. Search the archives at http

[jira] [Resolved] (SPARK-40428) Add a shutdownhook to CoarseGrained scheduler to avoid dangling resources during abnormal shutdown

2022-10-04 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-40428. -- Fix Version/s: 3.4.0 Assignee: Holden Karau Resolution: Fixed > Ad

[spark] branch master updated: [SPARK-40428][CORE] Fix shutdown hook in the CoarseGrainedSchedulerBackend

2022-10-04 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 505a8a04ad6 [SPARK-40428][CORE] Fix shutdown

[LincolnTalk] Lace

2022-09-21 Thread Sarah Cannon Holden
Does anyone have suggestions on what to do with old lace? Black and white. Also some old fur muffs. Sarah Cannon Holden -- The LincolnTalk mailing list. To post, send mail to Lincoln@lincolntalk.org. Search the archives at http://lincoln.2330058.n4.nabble.com/. Browse the archives at https

[jira] [Created] (SPARK-40428) Add a shutdownhook to CoarseGrained scheduler to avoid dangling resources during abnormal shutdown

2022-09-14 Thread Holden Karau (Jira)
Holden Karau created SPARK-40428: Summary: Add a shutdownhook to CoarseGrained scheduler to avoid dangling resources during abnormal shutdown Key: SPARK-40428 URL: https://issues.apache.org/jira/browse/SPARK

Re: [LincolnTalk] Love Letter to Lincoln

2022-09-11 Thread sarah cannon holden
Thank you Kathleen. A beautiful tribute. It truly captures the reminder your mother provided me each time I saw her walking north or south along Lincoln Road - just keep moving, have a goal each day and don't let my age tell me what I can and cannot do. She was an inspiration to all who saw her.

[LincolnTalk] Yard work Help

2022-09-10 Thread Sarah Cannon Holden
We are looking for some hardworking young people/person to help with hauling brush and other outside work. $15-$20/hour depending on experience! Please respond directly to me. Sarah Cannon Holden -- The LincolnTalk mailing list. To post, send mail to Lincoln@lincolntalk.org. Search the

[jira] [Created] (SPARK-40379) Propagate decommission executor loss reason during onDisconnect in K8s

2022-09-07 Thread Holden Karau (Jira)
Holden Karau created SPARK-40379: Summary: Propagate decommission executor loss reason during onDisconnect in K8s Key: SPARK-40379 URL: https://issues.apache.org/jira/browse/SPARK-40379 Project

Re: Jupyter notebook on Dataproc versus GKE

2022-09-06 Thread Holden Karau
rise from relying on this email's technical content is explicitly >>> disclaimed. The author will in no case be liable for any monetary damages >>> arising from such loss, damage or destruction. >>> >>> >>> >>> >>> On Mon, 5 Sept 2022 at 20

Re: Jupyter notebook on Dataproc versus GKE

2022-09-06 Thread Holden Karau
rise from relying on this email's technical content is explicitly >>> disclaimed. The author will in no case be liable for any monetary damages >>> arising from such loss, damage or destruction. >>> >>> >>> >>> >>> On Mon, 5 Sept 2022 at 20

Re: Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Holden Karau
ion of data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Mon, 5 Sept 2022 at 1

Re: Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Holden Karau
ion of data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Mon, 5 Sept 2022 at 1

Re: Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Holden Karau
I’ve run Jupyter w/Spark on K8s, haven’t tried it with Dataproc personally. The Spark K8s pod scheduler is now more pluggable for Yunikorn and Volcano can be used with less effort. On Mon, Sep 5, 2022 at 7:44 AM Mich Talebzadeh wrote: > > Hi, > > > Has anyone got experience of running Jupyter o

Re: Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Holden Karau
I’ve run Jupyter w/Spark on K8s, haven’t tried it with Dataproc personally. The Spark K8s pod scheduler is now more pluggable for Yunikorn and Volcano can be used with less effort. On Mon, Sep 5, 2022 at 7:44 AM Mich Talebzadeh wrote: > > Hi, > > > Has anyone got experience of running Jupyter o

Re: Welcome Fokko Driesprong as a committer!

2022-08-21 Thread Holden Karau
Congratulations 🍾 On Sun, Aug 21, 2022 at 1:57 PM wrote: > Congratulations! > > Sent from my iPhone > > On Aug 21, 2022, at 3:00 PM, Kyle Bendickson wrote: > >  > > Congratulations Fokko! This is indeed very well deserved! 🥳 > > It’s a pleasure to work with you! > > On Sun, Aug 21, 2022 at 12:

[jira] [Resolved] (SPARK-38969) Graceful decomissionning on Kubernetes fails / decom script error

2022-08-12 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-38969. -- Fix Version/s: 3.4.0 Assignee: Holden Karau Resolution: Fixed Updated

[spark] branch master updated: [SPARK-38969][K8S] Fix Decom reporting

2022-08-12 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 451ac4c4d96 [SPARK-38969][K8S] Fix Decom

[LincolnTalk] Queen Mattress

2022-07-22 Thread Sarah Cannon Holden
The flower delivery has been solved so I thought I would try my luck further!! Does anyone have a queen mattress looking for a new home? Please let me know Sarah Cannon Holden -- The LincolnTalk mailing list. To post, send mail to Lincoln@lincolntalk.org. Search the archives at http://lincoln

[LincolnTalk] Flower delivery mistake

2022-07-22 Thread Sarah Cannon Holden
A lovely jar of flowers arrived at my house today. Something about Yard Hang from Emilie, Dan and Coleman. I have no idea who/what this is and no way to correct a wrong delivery. Any ideas?? Sarah Cannon Holden -- The LincolnTalk mailing list. To post, send mail to Lincoln@lincolntalk.org

[LincolnTalk] 1776 tickets - beware scam.

2022-06-30 Thread sarah cannon holden
Below in the link to buy your tickets. There is a SCAM offering tickets at an outrageous price - and I am not even sure you will even have a ticket. Be sure to go to https://americanrepertorytheater.org/shows-events/1776-revival/ for your tickets. Sarah -- The LincolnTalk mailing list. To post

Re: [LincolnTalk] Don't miss it!

2022-06-30 Thread Sarah Cannon Holden
I second this recommendation. I saw it last night with my 15 year old granddaughter. An inspiring performance. Sarah Sarah Cannon Holden > On Jun 30, 2022, at 9:41 AM, Sara Mattes wrote: > > Just saw Diane Paulus’ “1776” at the A.R.T. in Cambridge…fantastic! > Yes, when it h

Re: [LincolnTalk] Free Upright Piano

2022-06-22 Thread Sarah Cannon Holden
I also have one. If you can move it it’s yours. Also would need tuning. Sarah Cannon Holden > On Jun 22, 2022, at 4:00 PM, Diana Abrashkin wrote: > >  > > Diana Abrashkin, Registered Architect > www.CuracaoWithDiana.com > www.ADCarchitecture.com > US telephone (781)

Re: [SPARK-39515] Improve scheduled jobs in GitHub Actions

2022-06-20 Thread Holden Karau
How about a hallway meet up at Data AI summit to talk about build CI if folks are Interested? On Sun, Jun 19, 2022 at 7:50 PM Hyukjin Kwon wrote: > Increased the priority to a blocker - I don't think we can release with > these build failures and poor CI > > On Mon, 20 Jun 2022 at 10:39, Hyukjin

[jira] [Created] (SPARK-39512) Document the Spark Docker container release process

2022-06-18 Thread Holden Karau (Jira)
Holden Karau created SPARK-39512: Summary: Document the Spark Docker container release process Key: SPARK-39512 URL: https://issues.apache.org/jira/browse/SPARK-39512 Project: Spark Issue

Re: [VOTE][SPIP] Spark Connect

2022-06-16 Thread Holden Karau
+1 On Thu, Jun 16, 2022 at 7:17 AM Thomas Graves wrote: > +1 for the concept. > Correct me if I'm wrong, but at a high level this is proposing adding > a new user API (which is language agnostic) and the proposal is to > start with something like the Logical Plan, with the addition of being > ab

[PSF-Community] Re: End Of life: Christoph Gohlke, Unofficcial Windows Binaries for Python Extension Packages

2022-06-15 Thread Steve Holden
Would it also be appropriate to nominate Cristoph for a Fellowship and/or community service award? Kind regards, Steve On Wed, Jun 15, 2022 at 11:22 AM Massa, Harald Armin wrote: > Hi dear PSF coMembers, > > Christoph Gohlkes Windows Binaries are nearing end of Life > > https://www.lfd.uci.edu

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread Holden Karau
+1 On Mon, Jun 13, 2022 at 4:51 PM Yuming Wang wrote: > +1 (non-binding) > > On Tue, Jun 14, 2022 at 7:41 AM Dongjoon Hyun > wrote: > >> +1 >> >> Thanks, >> Dongjoon. >> >> On Mon, Jun 13, 2022 at 3:54 PM Chris Nauroth >> wrote: >> >>> +1 (non-binding) >>> >>> I repeated all checks I described

[LincolnTalk] Fwd: Babysitting Job

2022-06-08 Thread Sarah Cannon Holden
Lincoln Neighbors. I am forwarding this message on behalf of my granddaughter who will be living with us this summer. She’ll arrive on Sunday! Sarah > >> Hello, >> My name is Cannon Martin, and I am 15 years old. I will be living with my >> grandparents for the summer and am looking for s

Re: Request for buying Apache Spark SWAG

2022-06-01 Thread Holden Karau
+1 On Wed, Jun 1, 2022 at 10:28 AM Takuya UESHIN wrote: > +1 > > On Wed, Jun 1, 2022 at 6:07 AM Wenchen Fan wrote: > >> +1 >> >> On Wed, Jun 1, 2022 at 3:36 PM Hyukjin Kwon wrote: >> >>> +1! >>> >>> On Wed, 1 Jun 2022 at 16:29, Mark Thomas wrote: >>> Xiao, A rough outline of th

[LincolnTalk] Original Intent

2022-05-24 Thread sarah cannon holden
Good Evening, I just have to speak out having just heard the latest news from Texas. The guns in this country have to go. The framers of the Constitution would be horrified if they saw what is happening in this country with gun violence. When the Constitution was written men had muskets that tak

Re: Reverse proxy for Spark UI on Kubernetes

2022-05-17 Thread Holden Karau
Could we make it do the same sort of history server fallback approach? On Tue, May 17, 2022 at 10:41 PM bo yang wrote: > It is like Web Application Proxy in YARN ( > https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/WebApplicationProxy.html), > to provide easy access for Spark U

Re: Reverse proxy for Spark UI on Kubernetes

2022-05-17 Thread Holden Karau
Could we make it do the same sort of history server fallback approach? On Tue, May 17, 2022 at 10:41 PM bo yang wrote: > It is like Web Application Proxy in YARN ( > https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/WebApplicationProxy.html), > to provide easy access for Spark U

Re: Reverse proxy for Spark UI on Kubernetes

2022-05-16 Thread Holden Karau
Oh that’s rad 😊 On Tue, May 17, 2022 at 7:47 AM bo yang wrote: > Hi Spark Folks, > > I built a web reverse proxy to access Spark UI on Kubernetes (working > together with https://github.com/GoogleCloudPlatform/spark-on-k8s-operator). > Want to share here in case other people have similar need. >

Re: Reverse proxy for Spark UI on Kubernetes

2022-05-16 Thread Holden Karau
Oh that’s rad 😊 On Tue, May 17, 2022 at 7:47 AM bo yang wrote: > Hi Spark Folks, > > I built a web reverse proxy to access Spark UI on Kubernetes (working > together with https://github.com/GoogleCloudPlatform/spark-on-k8s-operator). > Want to share here in case other people have similar need. >

Re: [VOTE] Release Spark 3.3.0 (RC1)

2022-05-11 Thread Holden Karau
> On Wed, May 11, 2022 at 4:23 AM Hyukjin Kwon wrote: > >> I expect to see RC2 too. I guess he just sticks to the standard, leaving >> the vote open till the end. >> It hasn't got enough +1s anyway :-). >> >> On Wed, 11 May 2022 at 10:17, Holden Karau wrote: >

Re: [VOTE] Release Spark 3.3.0 (RC1)

2022-05-10 Thread Holden Karau
Technically release don't follow vetos (see https://www.apache.org/foundation/voting.html ) it's up to the RM if they get the minimum number of binding +1s (although they are encouraged to cancel the release if any serious issues are raised). That being said I'll add my -1 based on the issues repo

[jira] [Created] (SPARK-39088) Add support for forwarding Spark History requests to live running driver when present

2022-05-02 Thread Holden Karau (Jira)
Holden Karau created SPARK-39088: Summary: Add support for forwarding Spark History requests to live running driver when present Key: SPARK-39088 URL: https://issues.apache.org/jira/browse/SPARK-39088

[jira] [Commented] (SPARK-38969) Graceful decomissionning on Kubernetes fails / decom script error

2022-05-02 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530922#comment-17530922 ] Holden Karau commented on SPARK-38969: -- Most likely it's from the `timeo

[jira] [Commented] (SPARK-38158) Rdd and shuffle blocks not migrated to new executors when decommission feature is enabled

2022-05-02 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530916#comment-17530916 ] Holden Karau commented on SPARK-38158: -- Do you have executor logs? >

[jira] [Commented] (SPARK-38408) Add option for partial nested field writes with nullable fields.

2022-05-02 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530915#comment-17530915 ] Holden Karau commented on SPARK-38408: -- More general > Add option for

[jira] [Resolved] (SPARK-33178) Dynamic Scaling In/Scaling out of executors - Kubernetes

2022-05-02 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-33178. -- Resolution: Incomplete Resolved since there is not enough info for what the request is for

[jira] [Resolved] (SPARK-34104) Allow users to specify a maximum decommissioning time

2022-05-02 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-34104. -- Fix Version/s: 3.2.0 Resolution: Fixed > Allow users to specify a maxi

[jira] [Resolved] (SPARK-34105) In addition to killing exlcuded/flakey executors which should support decommissioning

2022-05-02 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-34105. -- Fix Version/s: 3.2.0 Resolution: Fixed > In addition to killing exlcuded/fla

[jira] [Resolved] (SPARK-34530) logError for interrupting block migrations is too high

2022-05-02 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-34530. -- Resolution: Incomplete > logError for interrupting block migrations is too h

[jira] [Resolved] (SPARK-36664) Log time spent waiting for cluster resources

2022-05-02 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-36664. -- Fix Version/s: 3.4.0 Assignee: Holden Karau Resolution: Fixed > Log t

[Libreoffice-commits] core.git: icon-themes/breeze icon-themes/breeze_dark icon-themes/colibre icon-themes/colibre_dark icon-themes/elementary icon-themes/karasa_jaga icon-themes/sifr icon-themes/sifr

2022-04-28 Thread Dhiraj Holden (via logerrit)
b5e838334b57fee1e38febd95f944698059dfe4a Author: Dhiraj Holden AuthorDate: Sun Apr 10 21:17:17 2022 -0400 Commit: Heiko Tietze CommitDate: Thu Apr 28 10:48:38 2022 +0200 tdf#144788 Split up footnotes and endnotes in Navigator This patch splits the footnotes and endnotes section in Navigator

[spark] branch master updated: [SPARK-36664][CORE] Log time waiting for cluster resources

2022-04-25 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 148918b5469 [SPARK-36664][CORE] Log time waiting

Re: [LincolnTalk] Great new car service for Lincolnites

2022-04-24 Thread Sarah Cannon Holden
Can you let us know the fee from Lincoln to Logan? And Logan to Lincoln? Sarah Cannon Holden > On Apr 24, 2022, at 2:59 PM, V Saleme wrote: > >  > Also, > > Don’t forget about (Lincoln) resident Alan Giles either folks, arguably the > best in the business! > > V

bug#55059: bug in `guix pull`

2022-04-23 Thread Holden Green
guest@gnu ~/tmp/1$ guix pull Updating channel 'guix' from Git repository at ' https://git.savannah.gnu.org/git/guix.git'... Authenticating channel 'guix', commits 9edb3f6 to eb34ff1 (17,927 new commits)... Building from this channel: guix https://git.savannah.gnu.org/git/guix.git eb34ff1 sub

[Python-Dev] Re: Descriptions in unittest and avoiding confusion

2022-04-06 Thread Steve Holden
On Mon, Apr 4, 2022 at 4:13 PM Coyot Linden (Glenn Glazer) < co...@lindenlab.com> wrote: > I would like to point out another use case of triple quotes outside of > docstrings. We do a lot of SQL here and so doing a parameterized query > like: > > """SELECT foo > FROM bar > WHERE baz = %s""" > > is

[Python-Dev] Re: Enhancing generic type documentation in the standard library

2022-03-30 Thread Steve Holden
Not defining the semantics of annotations was a brave move, but inevitably led to the situation where different use cases, all quite reasonable, would spring into being. Now they have, the development team has to decide a) which ones to sanction and b) which will be left out in the cold. I wish th

[Python-Dev] Re: Are "Batteries Included" still a Good Thing? [was: It's now time to deprecate the stdlib urllib module]

2022-03-27 Thread Steve Holden
Time for a __legacy__ package? Kind regards, Steve On Sun, Mar 27, 2022 at 7:06 PM Paul Moore wrote: > On Sun, 27 Mar 2022 at 17:11, Christopher Barker > wrote: > > > > With the json package included, all they need to do is `import json`. If > that wasn't there, they's look in PyPi for a JSON

Re: [arin-ppml] Revised and Retitled - Draft Policy ARIN-2021-6: Permit IPv4 Leased Addresses for Purposes of Determining Utilization for Future Allocations

2022-03-17 Thread Holden Karau
Wait so some company could come to ARIN and ask for a block of IP addresses using leasing as the justification and then turn around and lease them. What value is the leasing company providing? It seems like a solid way to get a bunch of LLCs formed to acquire IP addresses from the waiting list and

Re: Apache Spark 3.3 Release

2022-03-16 Thread Holden Karau
avoid backporting the feature work that are not being well > discussed. > > > > > > > > On Tue, Mar 15, 2022 at 12:12 PM Xiao Li wrote: > > > > Cutting the branch is simple, but we need to avoid backporting the > feature work that are not being well discu

[jira] [Resolved] (SPARK-38561) Add doc for "Customized Kubernetes Schedulers"

2022-03-16 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-38561. -- Fix Version/s: 3.3.0 Assignee: Yikun Jiang Resolution: Fixed > Add doc

[jira] [Updated] (SPARK-38503) Add warn for getAdditionalPreKubernetesResources in executor side

2022-03-16 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-38503: - Target Version/s: 3.4.0 > Add warn for getAdditionalPreKubernetesResources in executor s

[spark] branch master updated: [SPARK-38561][K8S][DOCS] Add doc for `Customized Kubernetes Schedulers`

2022-03-16 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4ff40c1 [SPARK-38561][K8S][DOCS] Add doc for

Re: Apache Spark 3.3 Release

2022-03-15 Thread Holden Karau
May I suggest we push out one week (22nd) just to give everyone a bit of breathing space? Rushed software development more often results in bugs. On Tue, Mar 15, 2022 at 6:23 AM Yikun Jiang wrote: > > To make our release time more predictable, let us collect the PRs and > wait three more days be

Re: Apache Spark 3.3 Release

2022-03-14 Thread Holden Karau
On Mon, Mar 14, 2022 at 11:53 PM Xiao Li wrote: > Could you please list which features we want to finish before the branch > cut? How long will they take? > > Xiao > > Chao Sun 于2022年3月14日周一 13:30写道: > >> Hi Max, >> >> As there are still some ongoing work for the above listed SPIPs, can we >> st

Re: CVE-2021-38296: Apache Spark Key Negotiation Vulnerability

2022-03-09 Thread Holden Karau
CVEs are generally not mentioned in the release notes or JIRA instead we track them at https://spark.apache.org/security.html once they are resolved (prior to the resolution the reports goes to secur...@spark.apache.org) to allow the project time to fix the issue before public disclosure so there i

[jira] [Created] (SPARK-38408) Add option for partial nested field writes with nullable fields.

2022-03-03 Thread Holden Karau (Jira)
Holden Karau created SPARK-38408: Summary: Add option for partial nested field writes with nullable fields. Key: SPARK-38408 URL: https://issues.apache.org/jira/browse/SPARK-38408 Project: Spark

[python-uk] Fwd: It Will Never Work in Theory: live!

2022-03-03 Thread Steve Holden
: It Will Never Work in Theory: live! To: Steve Holden Hi Steve, On April 27, It Will Never Work in Theory is running two sets of online lightning talks from leading software engineering researchers in which they’ll summarize actionable findings from their work for practitioners. Tickets are now

Re: [ANNOUNCE] Apache Spark 3.1.3 released + Docker images

2022-02-25 Thread Holden Karau
> > ps. Any plans to make this images official docker images at some point > (for the extra security/validation) [1] > [1] https://docs.docker.com/docker-hub/official_images/ > > On Mon, Feb 21, 2022 at 10:09 PM Holden Karau > wrote: > > > > We are happy to ann

Re: [ANNOUNCE] Apache Spark 3.1.3 released + Docker images

2022-02-22 Thread Holden Karau
. On Tue, Feb 22, 2022 at 10:51 AM Denis Bolshakov wrote: > Hello Holden, > > Could you please provide more details and plan for docker images support? > > So far I see that there are only two tags, I get from them spark version, > but there is no information about java, hado

Re: [ANNOUNCE] Apache Spark 3.1.3 released + Docker images

2022-02-21 Thread Holden Karau
.everybodywiki.com/Mich_Talebzadeh > > > > *Disclaimer:* Use it at your own risk. Any and all responsibility for any > loss, damage or destruction of data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author

[spark-website] branch asf-site updated: Fix dockerhub link

2022-02-21 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new d0d3def Fix dockerhub link d0d3def

Re: [ANNOUNCE] Apache Spark 3.1.3 released + Docker images

2022-02-21 Thread Holden Karau
g on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Mon, 21 Feb 2022 at 21:09, Holden Karau wrote: > >> We are happy to

<    1   2   3   4   5   6   7   8   9   10   >