Hi:
I’m sorry that I’m still confused about Livy's shared object mechanism.
As for our product design. the shared object is a DataFrame or table which is
created from some parquet files in AWS S3. When I use Python programmatic API
to submit a job like this:
(1) I don’t cache df and tm
Hi Wandong,
Livy's shared object mechanism mainly used to share objects between
different Livy jobs, this is mainly used for Job API. For example job A
create a object Foo which wants to be accessed by Job B, then user could
store this object Foo into JobContext with a provided name, after that Jo
