ps://github.com/apache/spark/blob/88e7e87bd5c052e10f52d4bb97a9d78f5b524128/core/src/main/scala/org/apache/spark/api/python/PythonUtils.scala#L31
>> >
>> > The code shows Spark will try to find the path if SPARK_HOME is specified.
>> > And on my worker node, SPARK_HOME is s
[
https://issues.apache.org/jira/browse/SPARK-25645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639147#comment-16639147
]
Marcelo Vanzin commented on SPARK-25645:
I think I might have suggested thi
Marcelo Vanzin created SPARK-25646:
--
Summary: docker-image-tool.sh doesn't work on developer build
Key: SPARK-25646
URL: https://issues.apache.org/jira/browse/SPARK-25646
Project:
[
https://issues.apache.org/jira/browse/SPARK-25645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639024#comment-16639024
]
Marcelo Vanzin commented on SPARK-25645:
This seems similar to SPARK-2
[
https://issues.apache.org/jira/browse/CRYPTO-142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638996#comment-16638996
]
Marcelo Vanzin commented on CRYPTO-142:
---
It seems that things are alr
Marcelo Vanzin created CRYPTO-142:
-
Summary: Native library does not load if ENGINE_load_rdrand is not
available
Key: CRYPTO-142
URL: https://issues.apache.org/jira/browse/CRYPTO-142
Project: Commons
.bashrc , for the
> pre-installed 2.2.1 path.
>
> I don't want to make any changes to worker node configuration, so any way to
> override the order?
>
> Jianshi
>
> On Fri, Oct 5, 2018 at 12:11 AM Marcelo Vanzin wrote:
>>
>> Normally the version of Spark in
[
https://issues.apache.org/jira/browse/CRYPTO-60?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin updated CRYPTO-60:
-
Fix Version/s: 1.1.0
> opensslCipher support GCM m
[
https://issues.apache.org/jira/browse/CRYPTO-135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved CRYPTO-135.
---
Resolution: Won't Fix
See discussion in the PR for this:
https://github.com/apache/co
Normally the version of Spark installed on the cluster does not
matter, since Spark is uploaded from your gateway machine to YARN by
default.
You probably have some configuration (in spark-defaults.conf) that
tells YARN to use a cached copy. Get rid of that configuration, and
you can use whatever
[
https://issues.apache.org/jira/browse/SPARK-25586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin updated SPARK-25586:
---
Issue Type: Bug (was: Improvement)
> toString method
[
https://issues.apache.org/jira/browse/SPARK-25586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16637605#comment-16637605
]
Marcelo Vanzin commented on SPARK-25586:
bq. This is not a bug
Actually it
[
https://issues.apache.org/jira/browse/SPARK-25586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-25586.
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 22616
[https
[
https://issues.apache.org/jira/browse/SPARK-25586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-25586:
--
Assignee: Ankur Gupta
> toString method
Alex, could you take care of that small update? Thanks!
On Tue, Oct 2, 2018 at 4:19 PM Justin Mclean wrote:
>
> Hi,
>
> > I guess we just haven't been asking anything from the mentors, so we>
> > should just mention that in the report?
>
> That sounds good to me. For what it's worth I can see that
Hi Justin,
Sorry, it wasn't intentional, it was probably just not in the original
report I based my update on.
I guess we just haven't been asking anything from the mentors, so we
should just mention that in the report?
On Tue, Oct 2, 2018 at 3:40 PM Justin Mclean wrote:
>
> HI,
>
> I notice yo
I'm pretty sure I don't have access to the wiki; but I took the last report
and added a small blurb about what's been going on. Feel free to update the
wiki on my behalf.
===
Livy is web service that exposes a REST interface for managing long running
Apache Spark c
Marcelo Vanzin created SPARK-25598:
--
Summary: Remove flume connector in Spark 3
Key: SPARK-25598
URL: https://issues.apache.org/jira/browse/SPARK-25598
Project: Spark
Issue Type: Task
Marcelo Vanzin created LIVY-521:
---
Summary: Shade netty in RSC
Key: LIVY-521
URL: https://issues.apache.org/jira/browse/LIVY-521
Project: Livy
Issue Type: Task
Components: RSC
[
https://issues.apache.org/jira/browse/SPARK-22275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-22275.
Resolution: Won't Fix
Let's leave it like that until it becomes a bigg
[
https://issues.apache.org/jira/browse/SPARK-25590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin updated SPARK-25590:
---
Description:
That jar file, which is packaged when the k8s profile is enabled, has a log4j
Marcelo Vanzin created SPARK-25590:
--
Summary: kubernetes-model-2.0.0.jar masks default Spark logging
config
Key: SPARK-25590
URL: https://issues.apache.org/jira/browse/SPARK-25590
Project: Spark
[
https://issues.apache.org/jira/browse/LIVY-520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned LIVY-520:
---
Assignee: Marco Gaido
> Log when a session is deleted because of time
[
https://issues.apache.org/jira/browse/LIVY-520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved LIVY-520.
-
Resolution: Fixed
Fix Version/s: 0.6.0
Issue resolved by pull request 116
[https
[
https://issues.apache.org/jira/browse/SPARK-25380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16633145#comment-16633145
]
Marcelo Vanzin commented on SPARK-25380:
We can provide ways to diminish
gt; However it fails when trying to execute 'make'.
>
> I don't know if make is available on those boxes.
> Needs further investigation.
>
> On Fri, 28 Sep 2018 at 11:27, sebb wrote:
> >
> > On Fri, 28 Sep 2018 at 02:24, Marcelo Vanzin
> > wrote:
> &
[
https://issues.apache.org/jira/browse/SPARK-25380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631236#comment-16631236
]
Marcelo Vanzin commented on SPARK-25380:
If all you want is see this live,
for those - but I don't
think I'll have time to play with that at the moment.)
On Thu, Sep 27, 2018 at 10:25 AM Gary Gregory wrote:
>
> +1 to update to Java 8.
>
> Gary
>
> On Thu, Sep 27, 2018 at 11:02 AM Marcelo Vanzin
> wrote:
>
> > Any concerns with
[
https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-25533.
Resolution: Fixed
Fix Version/s: 2.4.0
2.3.3
> Inconsist
[
https://issues.apache.org/jira/browse/LIVY-512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved LIVY-512.
-
Resolution: Fixed
Assignee: Marcelo Vanzin
Fix Version/s: 0.6.0
> Remove supp
[
https://issues.apache.org/jira/browse/LIVY-511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved LIVY-511.
-
Resolution: Fixed
Assignee: Marcelo Vanzin
Fix Version/s: 0.6.0
> Bump mini
Any concerns with dropping support for Java 7 in the next release of
commons-crypto? Are there any rules about not doing that kind of thing
in a "minor" release?
I was trying to fix up the Travis builds to work on JDK7 but it seems
that Travis's support for JDK7 is kinda broken at the moment... an
[
https://issues.apache.org/jira/browse/SPARK-25372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-25372:
--
Assignee: Ilan Filonenko
> Deprecate Yarn-specific configs in regards to key
[
https://issues.apache.org/jira/browse/SPARK-25372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-25372.
Resolution: Fixed
Fix Version/s: 2.5.0
Issue resolved by pull request 22362
[https
[
https://issues.apache.org/jira/browse/CRYPTO-141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16629523#comment-16629523
]
Marcelo Vanzin commented on CRYPTO-141:
---
I opened a PR for this:
h
[
https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16629243#comment-16629243
]
Marcelo Vanzin commented on SPARK-25533:
This is merged to master.
[
https://issues.apache.org/jira/browse/SPARK-25533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-25533:
--
Assignee: shahid
> Inconsistent message for Completed Jobs in the JobUI, when th
[
https://issues.apache.org/jira/browse/SPARK-25546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin updated SPARK-25546:
---
Comment: was deleted
(was: User 'vanzin' has created a pull request for this is
Marcelo Vanzin created LIVY-519:
---
Summary: Flaky test: SparkYarnApp "should kill yarn app "
Key: LIVY-519
URL: https://issues.apache.org/jira/browse/LIVY-519
Project: Livy
Issue
Marcelo Vanzin created SPARK-25546:
--
Summary: RDDInfo uses SparkEnv before it may have been initialized
Key: SPARK-25546
URL: https://issues.apache.org/jira/browse/SPARK-25546
Project: Spark
Marcelo Vanzin created LIVY-518:
---
Summary: Add support for Spark 2.4
Key: LIVY-518
URL: https://issues.apache.org/jira/browse/LIVY-518
Project: Livy
Issue Type: Task
Affects Versions
[
https://issues.apache.org/jira/browse/SPARK-25318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-25318.
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 22325
[https
[
https://issues.apache.org/jira/browse/SPARK-25318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-25318:
--
Assignee: Reza Safi
> Add exception handling when wrapping the input stream dur
[
https://issues.apache.org/jira/browse/SPARK-25535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16628078#comment-16628078
]
Marcelo Vanzin commented on SPARK-25535:
I filed CRYPTO-141 for the com
[
https://issues.apache.org/jira/browse/CRYPTO-141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16628077#comment-16628077
]
Marcelo Vanzin commented on CRYPTO-141:
---
It might be a better idea to make
Marcelo Vanzin created CRYPTO-141:
-
Summary: Errors in native code can leave Java wrappers in bad state
Key: CRYPTO-141
URL: https://issues.apache.org/jira/browse/CRYPTO-141
Project: Commons Crypto
Marcelo Vanzin created SPARK-25535:
--
Summary: Work around bad error checking in commons-crypto
Key: SPARK-25535
URL: https://issues.apache.org/jira/browse/SPARK-25535
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-25502:
--
Assignee: shahid (was: ABHISHEK KUMAR GUPTA)
> [Spark Job History] Empty Page w
[
https://issues.apache.org/jira/browse/LIVY-494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved LIVY-494.
-
Resolution: Fixed
Assignee: Marco Gaido
Fix Version/s: 0.6.0
> Add thriftserver
[
https://issues.apache.org/jira/browse/SPARK-25518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-25518.
Resolution: Duplicate
> Spark kafka delegation token suppor
[
https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-25502:
--
Assignee: ABHISHEK KUMAR GUPTA
> [Spark Job History] Empty Page when page num
[
https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-25502.
Resolution: Fixed
Fix Version/s: 2.4.0
2.3.3
Issue resolved by
Marcelo Vanzin created LIVY-517:
---
Summary: NPE in session manager cleanup thread
Key: LIVY-517
URL: https://issues.apache.org/jira/browse/LIVY-517
Project: Livy
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-24918:
--
Assignee: Nihar Sheth
> Executor Plugin
[
https://issues.apache.org/jira/browse/SPARK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-24918.
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 22192
[https
[
https://issues.apache.org/jira/browse/LIVY-514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16619476#comment-16619476
]
Marcelo Vanzin commented on LIVY-514:
-
Do you have {{livy-client-http}} in
You can log in to https://repository.apache.org and see what's wrong.
Just find that staging repo and look at the messages. In your case it
seems related to your signature.
failureMessageNo public key: Key with id: () was not able to be
located on http://gpg-keyserver.de/. Upload your public k
Marcelo Vanzin created LIVY-513:
---
Summary: Flaky test: SessionHeartbeatWatchdog
Key: LIVY-513
URL: https://issues.apache.org/jira/browse/LIVY-513
Project: Livy
Issue Type: Bug
[
https://issues.apache.org/jira/browse/LIVY-511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin updated LIVY-511:
Labels: release-notes (was: )
> Bump minimum Spark version to
[
https://issues.apache.org/jira/browse/LIVY-512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin updated LIVY-512:
Labels: release-notes (was: )
> Remove support for Scala 2
[
https://issues.apache.org/jira/browse/LIVY-510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin updated LIVY-510:
Labels: release-notes (was: )
> Remove support for j
Marcelo Vanzin created LIVY-512:
---
Summary: Remove support for Scala 2.10
Key: LIVY-512
URL: https://issues.apache.org/jira/browse/LIVY-512
Project: Livy
Issue Type: Task
Reporter
Marcelo Vanzin created LIVY-511:
---
Summary: Bump minimum Spark version to 2.2
Key: LIVY-511
URL: https://issues.apache.org/jira/browse/LIVY-511
Project: Livy
Issue Type: Task
Marcelo Vanzin created LIVY-510:
---
Summary: Remove support for jdk7
Key: LIVY-510
URL: https://issues.apache.org/jira/browse/LIVY-510
Project: Livy
Issue Type: Task
Reporter
sco, CA 94105
> > > <
> > https://maps.google.com/?q=505+Howard+Street+San+Francisco,+CA+94105+United+States&entry=gmail&source=g
> > >
> > > United States
> > > <
> > https://maps.google.com/?q=505+Howard+Street+San+Francisco,+CA+94105+Un
Hey all,
I'd like to gauge people's reaction to some proposals regarding what
is supported in Livy.
#1: Java versions
I propose dropping support for Java 7. Even J8 is already EOL,
although it's pretty obvious nobody is getting rid of it anytime soon.
But I don't see a good reason to support J7.
That requires a Livy fix that's currently only in the master branch.
Another option is to use the previous version of the Cloudera parcel
(which does not have the fix for CVE-2018-1334, which introduced this
incompatibility in Livy).
On Thu, Sep 13, 2018 at 12:29 AM Rabe, Jens
wrote:
>
> Hello fo
[
https://issues.apache.org/jira/browse/LIVY-503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin updated LIVY-503:
Summary: Move RPC classes used in thrifserver in a separate module (was:
More RPC classes used in
[
https://issues.apache.org/jira/browse/SPARK-25380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612433#comment-16612433
]
Marcelo Vanzin commented on SPARK-25380:
Yep. That's a 200MB plan de
[
https://issues.apache.org/jira/browse/SPARK-25410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-25410.
Resolution: Not A Bug
bq. This means that the amount of memoryOverhead will not be used
[
https://issues.apache.org/jira/browse/SPARK-25380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16611012#comment-16611012
]
Marcelo Vanzin commented on SPARK-25380:
Another bit of information that w
[
https://issues.apache.org/jira/browse/SPARK-24889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-24889.
Resolution: Fixed
Fix Version/s: 2.3.2
2.4.0
Issue resolved by
[
https://issues.apache.org/jira/browse/SPARK-24889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-24889:
--
Assignee: Liang-Chi Hsieh
> dataset.unpersist() doesn't update storage memo
[
https://issues.apache.org/jira/browse/SPARK-25221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-25221:
--
Assignee: Gera Shegalov
> [DEPLOY] Consistent trailing whitespace treatment of c
[
https://issues.apache.org/jira/browse/SPARK-25221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-25221.
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 22213
[https
If your "orchestrator engine" is receiving pre-built apps from others
and needs to execute them in the cluster, you could just use Livy's
batch API. I don't think there are Java bindings for that, you'd need
to talk to the REST endpoints directly.
The code you're referring to is for "interactive"
[
https://issues.apache.org/jira/browse/SPARK-25395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-25395.
Resolution: Duplicate
> Remove Spark Optional Java
[
https://issues.apache.org/jira/browse/SPARK-25091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-25091.
Resolution: Duplicate
> UNCACHE TABLE, CLEAR CACHE, rdd.unpersist() does not clean
[
https://issues.apache.org/jira/browse/SPARK-23670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606355#comment-16606355
]
Marcelo Vanzin commented on SPARK-23670:
Yep, looks like just huge plans
[
https://issues.apache.org/jira/browse/SPARK-23670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606343#comment-16606343
]
Marcelo Vanzin commented on SPARK-23670:
Do you mind listing
[
https://issues.apache.org/jira/browse/SPARK-23670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606151#comment-16606151
]
Marcelo Vanzin commented on SPARK-23670:
How many instances of the follo
[
https://issues.apache.org/jira/browse/SPARK-24771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16604877#comment-16604877
]
Marcelo Vanzin commented on SPARK-24771:
I ran a couple of our tests
[
https://issues.apache.org/jira/browse/SPARK-24415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-24415:
--
Assignee: Ankur Gupta
> Stage page aggregated executor metrics wrong when failu
[
https://issues.apache.org/jira/browse/SPARK-24415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-24415.
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 22209
[https
See SPARK-4160. Long story short: you need to upload the files and
jars to some shared storage (like HDFS) manually.
On Wed, Sep 5, 2018 at 2:17 AM Guillermo Ortiz Fernández
wrote:
>
> I'm using standalone cluster and the final command I'm trying is:
> spark-submit --verbose --deploy-mode cluster
Same here, I don't see anything from Wenchen... just replies to him.
On Sat, Sep 1, 2018 at 9:31 PM Mridul Muralidharan wrote:
>
>
> Is it only me or are all others getting Wenchen’s mails ? (Obviously Ryan did
> :-) )
> I did not see it in the mail thread I received or in archives ... [1]
> Won
[
https://issues.apache.org/jira/browse/SPARK-23781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin updated SPARK-23781:
---
Description:
With the fix for SPARK-23361, the code that handles delegation tokens in Mesos
I think there still might be an active job publishing stuff. Here's a
pretty recent build from master:
https://dist.apache.org/repos/dist/dev/spark/2.4.0-SNAPSHOT-2018_08_31_12_02-32da87d-docs/_site/index.html
But it seems only docs are being published, which makes me think it's
those builds that
I like the questions (aside maybe from the cost one which perhaps does
not matter much here), especially since they encourage explaining
things in a more plain language than generally used by specs.
But I don't think we can ignore design aspects; it's been my
observation that a good portion of SPI
[
https://issues.apache.org/jira/browse/SPARK-25294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16598975#comment-16598975
]
Marcelo Vanzin commented on SPARK-25294:
It might be hard to cover all c
[
https://issues.apache.org/jira/browse/SPARK-24909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-24909.
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 21976
[https
[
https://issues.apache.org/jira/browse/SPARK-24909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-24909:
--
Assignee: Thomas Graves
> Spark scheduler can hang when fetch failures, execu
[
https://issues.apache.org/jira/browse/SPARK-25004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-25004.
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 21977
[https
[
https://issues.apache.org/jira/browse/SPARK-25004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-25004:
--
Assignee: Ryan Blue
> Add spark.executor.pyspark.memory config to
[
https://issues.apache.org/jira/browse/SPARK-24704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin updated SPARK-24704:
---
Fix Version/s: 2.3.2
> The order of stages in the DAG graph is incorr
[
https://issues.apache.org/jira/browse/SPARK-25119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-25119.
Resolution: Duplicate
> stages in wrong order within job page DAG ch
[
https://issues.apache.org/jira/browse/SPARK-23679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reassigned SPARK-23679:
--
Assignee: Saisai Shao
> uiWebUrl show inproper URL when running on Y
[
https://issues.apache.org/jira/browse/SPARK-23679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-23679.
Resolution: Fixed
Fix Version/s: 2.4.0
Issue resolved by pull request 22164
[https
just about all your code
> needs this init; I had understood the use cases to be more like "establish
> some local config and init for this particular thing I'm doing for this
> legacy system".
>
> On Tue, Aug 28, 2018 at 11:35 AM Marcelo Vanzin wrote:
>>
>> +1
+1
Class init is not enough because there is nowhere for you to force a
random class to be initialized. This is basically adding that
mechanism, instead of forcing people to add hacks using e.g.
mapPartitions which don't even cover all scenarios.
On Tue, Aug 28, 2018 at 7:09 AM, Sean Owen wrote:
901 - 1000 of 4596 matches
Mail list logo
