[
https://issues.apache.org/jira/browse/TOREE-535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ricardo Gaspar updated TOREE-535:
---------------------------------
Description:
*Currently* there's no way to configure spark properties, especially adding
jars to spark driver and executors and then import the functions. `%Addjar`
doesn't do that Whereas with spylon one can invoke `%init_spark` to load the
jars and it works fine when importing in other cells. e.g.
{code:java}
%%init_spark
launcher.jars = ["/home/rgaspar/myjar-1.5.1.jar"]{code}
was:
Would it be possible to render as table (HTML like) as the dataframe magic
(%%dataframe) shows the results?
Based on the documentation examples:
[https://github.com/apache/incubator-toree/blob/5b19aac2e56a56d35c888acc4ed5e549b1f4ed7c/etc/examples/notebooks/magic-tutorial.ipynb]
Instead of rendering as plaintext when using %%sql , it would be better to be
able to render it as a table.
Currently the only way to achieve this is with a 2 step process (2 cells):
# creating a dataframe with the SQL query
# and then render it using the %%dataframe to render it.
Zeppelin does this by default when using the %sql annotation. But Zeppelin is
not as good as Jupyter.
Additionally, %%SQL magic doesn't allow to control the limit of rows to show,
always defaults to 10.
> Spark init configurations (jars to driver and executors)
> --------------------------------------------------------
>
> Key: TOREE-535
> URL: https://issues.apache.org/jira/browse/TOREE-535
> Project: TOREE
> Issue Type: Improvement
> Reporter: Ricardo Gaspar
> Priority: Trivial
> Fix For: 0.4.0
>
>
>
> *Currently* there's no way to configure spark properties, especially adding
> jars to spark driver and executors and then import the functions. `%Addjar`
> doesn't do that Whereas with spylon one can invoke `%init_spark` to load the
> jars and it works fine when importing in other cells. e.g.
> {code:java}
> %%init_spark
> launcher.jars = ["/home/rgaspar/myjar-1.5.1.jar"]{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
