Hi all,
I am trying to write up the main page of PySpark documentation at
https://github.com/apache/spark/pull/29320.
While I think the current proposal might be good enough, I would like
to collect more feedback about the contents, structure and image since
this is the entrance page of PySpark
You can use SparkFiles.get(path)
Example here
https://github.com/datastax/spark-cassandra-connector/blob/master/connector/src/main/scala/com/datastax/spark/connector/cql/CassandraConnectionFactory.scala#L152
Also this is probably a better question for the user list than the dev one
On Sat, Aug
Hi all,
I am trying to pass some configuration files via spark-submit command in
cluster mode.
>From logs I can see the files are transferred to each executors.
But how to build the absolute path of the file in the code?
Can anyone plz guide on it with some references.
Appreciate your help on
Thank you!
On Sat, 1 Aug 2020, 19:31 Takeshi Yamamuro, wrote:
> Great work and thanks for your JIRA maintenance and this heads-up (sorry
> for my late reply...)
> Yea, I noticed that I didn't take much time recently on the JIRA side.
> So, I will take more care about it from now on for the
Great work and thanks for your JIRA maintenance and this heads-up (sorry
for my late reply...)
Yea, I noticed that I didn't take much time recently on the JIRA side.
So, I will take more care about it from now on for the community's help.
On Wed, Jul 29, 2020 at 10:52 AM Hyukjin Kwon wrote:
>
