Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2404
@zjffdu yes, but the fix implemented in #2769 only addresses scheduler
isolation per interpreter groups which is a good thing, but not enough to cover
the case we are talking in this PR
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2404
@jongyoul I understand the difference about restarting an interpreter from
a note vs. restarting from the interpeter page. My point is about the session
id which should be different in case
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2404
I have just worked on this issue and found a bug in the
`InterpreterSetting` class. The `getInterpreterSessionId` uses
`option.perNoteScoped` in its tests, but it should
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2404
@wary I am facing the same issue (all paragraphs aborted on interpreter
restart in isolate per user configuration). I see you have deleted your branch
and that the proposed patch does not apply
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2730
GTM
---
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2730
Agree, but the default will always find case where it will not work. For
this image size / resolution, there may be more failure than success I am
afraid. To be tested with various plots, screen
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2730
`fig.retina` sounds like a good property to play with. However, fixing
`out.width` to an arbitrary value may give good result for the example you
give, but did you try with other plots
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2637
thx @matyix I had taken logs but don't have them anymore... but I can
confirm that in both cases (deps via %spark.dep or via the ui) the command
generated by the interpreter.sh is the same
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2637
Feedback/Question on latest commit:
+ For `cluster` mode, I sometimes receive a null pointer at first run,
running a second time directly after is fine.
+ Are you enforcing
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2637
I still have issues with deps in cluster mode. @matyix Can you confirm it
is working on your env? I will retest with your latest push in the coming days.
But yes, absolutely
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2637
@matyix I've given a try on you last commit and can not get the additional
deps (in settings page) working.
I don't see the `spark.jars` property in the generate command
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2637
@matyix sure, we can to address the dep in separate PR, especially if it is
beneficial for all deploy modes. The downside of it is that we will have
everybody happy with any change on deps
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2637
@matyix There is a long history in Zeppelin on `spark.dep` vs `external
dependency in interpreter settings`. I am fan of the later (interpreter
settings), so if the --packages flag can make
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2637
Thx @matyix. I will test and give feedback.
Did you adding external dependencies (via the interpreter page). It works
on my setup in `client` mode but fails (ClassNotFound) in `cluster
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2637
@matyix I made a few more tests, and now `spark.app.name` and
`spark.kubernetes.driver.pod.name` can be set without problem... (to be further
confirmed).
---
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2637
I am playing in cluster mode setting/removing via the interpreter page the
`spark.app.name` and `spark.kubernetes.driver.pod.name` and so far the only to
make it work (= remote executor finding
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2637
@matyix If my tests are correct, for now, we can not set `spark.app.name`
and `spark.kubernetes.driver.pod.name` (if you set them, the driver will not be
found by zeppelin).
Upon
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2637
Tested latest commit on AWS K8S cluster and works great as well in `client`
as `cluster` modes - Kudos @matyix
---
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2637
PS1: I have pushed my fixes in
zeppelin-k8s/tree/spark-interpreter-k8s-fixes branch (which has merge conflict
with master due to latest commit 3b1a03f that touch the launchers and remote
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2637
@matyix I have tested your last commits and was able to make it work in my
env (with both zeppelin `in-` and `out` k8s cluster).
Your implement a new (specific for spark-k8s) launch
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2637
Just tried the `vanilla` (so without this #2637 PR) zeppelin on spark-k8s
with the `in-cluster client mode` branch
(https://github.com/apache-spark-on-k8s/spark/pull/456).
It works fine
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2637
@matyix I have a local spark-k8s setup and have this branch (without
success so far, so debugging SparkK8RemoteInterpreterManagedProcess to tackle
down the issue). A few questions:
+ I
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2418
@zjffdu I am thinking to automation (using the notes in an scheduled or
batch process). Does it make sense to you?
---
If your project is set up for it, you can reply to this email and have
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2418
@jongyoul sorry, I was not clear enough. With frontend, I was meaning the
web layer (so jetty). Jetty could communicate via a variety of protocols to the
interpreters. Now going further
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2418
In case of SNPEGO Web Auth (not yet supported by Zeppelin0,, you could
consider transfert the Kerberos ticket from front-end to back-end and use it to
, this the usecase I was thinking
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2329
Late question: This implementation uses the raw Yarn APIs. Did you consider
using higher-level APIs such as Twill (http://twill.apache.org) or Slider
(https://slider.incubator.apache.org
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2418
I'd like adding more points to the discussion:
- Do we need to support kerberos-like auth in the communication protocol
(you can achieve this with Thrift, not sure with Netty)?
- Do we
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2227
@1ambda I have added the log. Regarding you second comment, I am not sure
what you mean. Is there something I should change? Is it not working as
expected?
---
If your project is set up
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2227
@1ambda thx a lot for the follow-up and your great work.
This branch now supports what we want:
```
println("""%json
{"array":[1,2,3],"boolean&
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/932
It is working here with shiro-enabled (simple username password in
shiro,ini, not the ldaprealm).
I would need to test with ldaprealm...
@sohaibiftikhar is it working for your
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/932
Jenkins build is now green. @jongyoul @bzz Any other inputs/questions on
this PR ?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2227
@Leemoonsoo @1ambda I see your point and agree with it.
However, we need to decide which InterpreterResult to return. For now it
can be { TABLE, IMG, SVG, NULL }. The Java code needs
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2182
This issue is recurring since a long time and depends IMHO on each
environment (maven version...) - The main parameter to fix this is the
`javax.ws.rsapi.version`.
This PR upgrades cxf
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2182
How does this PR relates to #932 ?
#932 simply replaces cxf with jersey2. Here I see we still have some cxf
deps.
---
If your project is set up for it, you can reply to this email and have
Github user echarles closed the pull request at:
https://github.com/apache/zeppelin/pull/2226
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2226
This is solved with #2210 Bundle helium packages one by one
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2227
@Leemoonsoo I wanted to introduce minimum changes in javascript and stay
aligned with the idea of interpreters returning different display types.
Introducing a new `spell` display has sounded
GitHub user echarles opened a pull request:
https://github.com/apache/zeppelin/pull/2227
[ZEPPELIN-2359] Support Spell as Display
### What is this PR for?
SPELL should be considered as another display type, just like TEXT, HTML,
TABLE...
### What type of PR
GitHub user echarles opened a pull request:
https://github.com/apache/zeppelin/pull/2226
[ZEPPELIN-2235] Helium load.js should reside in subfolder + update babel
and webpack versions
### What is this PR for?
Changes are needed to make zeppelin-sigma-spell work
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2112
Would be good to generalize this precode execution to all interprerters,
having methods like `prerun`, `postrun`... at `Interpeter` interface level.
---
If your project is set up for it, you
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2060
I am adding a `json` file in the `helium` folder with the artifact that
points to a full path on my local drive. In that location I have the spell
project. It was working 3 days ago. Today, I
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/2060
I think this change breaks the installation of spell modules that are not
yet published in npmjs repository.
---
If your project is set up for it, you can reply to this email and have your
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/1764
LGTM
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/1390
I have a prototype that supports the 3 modes. Give me a few days to polish
and commit.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/932
@bzz pushed my local merge. Anything else that should be done before you
merge?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/930
Closing this PR, I can not reproduce the issue anymore.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user echarles closed the pull request at:
https://github.com/apache/zeppelin/pull/930
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/1390
@khalidhuseynov
- have fixed the format issues
- I didn't change Notebook#getNotebookAuthorization, it was already
present. However, a single global NotebookAuthorization as you
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/1390
I have introduced a parameter in the URL `?runAs=...` that allows to
impersonate from an authenticated user another user. The needed R/W
authorization are respected.
An alternative
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/1385
@jongyoul `ZeppelinConfiguration.create()` is now used and method signature
are now like before.
---
If your project is set up for it, you can reply to this email and have your
reply appear
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/1390
@zjffdu Correct, this PR also implements ZEPPELIN-1338 User level
interpreter setting (I have updated the title and description on this PR).
@Leemoonsoo Will check and adapt if needed
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/1394
@prabhjyotsingh yes, assumption is correct. At the time of the R
interpreter dev, I was used to manually rename the note folder and edit the
json to set the id the same value.
This PR
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/1390
@khalidhuseynov Good to discuss with you about what a multiuser note
management would be.
For the file system repo, this PR will give you:
```
âââ anonynmous
âÂ
GitHub user echarles opened a pull request:
https://github.com/apache/zeppelin/pull/1385
[ZEPPELIN-1395] Local or Remote Interpreter by Configuration
### What is this PR for?
The current remote interpreter (launched via shell) is scalable and open
but suffers from 2 limitations
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/1371
Upon numeric values, the automatic detection of dates... would be great.
Detection at client (javascript) side could be misleading as you only get a
subset of the data
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/932
Merged with latest master.
@bzz I don't know where I found CDDL 2.0 (sounded indeed strange when I was
writing this some time ago). jax-rs is now CDDL 1.0, beanvalidation is now ASL2
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/1357
Didn't try the changes but definitively +1 for this to enhance performance
(tried to imagine side effects but didn't find any atm)
---
If your project is set up for it, you can reply
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/932
@bzz are we ok now with the license information?
Travis is red for 3 on the 9 profiles, but this comes from a timeout trying
to launch/access spark
```16/08/17 15:36:04 INFO
GitHub user echarles opened a pull request:
https://github.com/apache/zeppelin/pull/1361
[ZEPPELIN-1354] [WIP] Inject Services
### What is this PR for?
Services like authentication, authorization, security filters... should be
injected rather than manually instanciated
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/1322
Btw, for the hadoop case (or spark on yarn case), this PR may give an issue
for `doAs`.
Typically, you configure `hadoop.proxyuser.foo.hosts` and
`hadoop.proxyuser.foo.group`, `foo
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/1322
... and make ZEPPELIN-1320 a subtask of ZEPPELIN-1337
?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/1322
To make ZEPPELIN-1337 Umbrella for multiple user support for zeppelin more
readable, should we rename the following:
- ZEPPELIN-1340: "Run Hadoop-based interpreter process on Ker
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/1322
Whatever `su` or `ssh` is used, I feel the main trick is the user
provisioning on the host running the interpreter. Until now, the shiro
authentication system had no impact on the user
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/932
@bzz I have moved `LICENSE-jersery-2` to
`zeppelin-distribution/src/bin_license`.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/932
@bzz I have updated the PR descrption (first comment) with the need to
update license and adding a note on how easy it is with jersey to map a full
json to a pojo being passed as method parameter
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/1259
LGTM
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/932
Failing with
org.apache.zeppelin.interpreter.InterpreterException:
org.apache.thrift.TApplicationException: Internal error processing
createInterpreter
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/1265
Quickly went through the changes, but not sure to get it.
In which way is this related to the various intepreter modes we already
have?
In which way is this related to ZEPPELIN-1000
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/1259
@minahlee Just saw you comment on ZEPPELIN-1260, but @Leemoonsoo has been
fast...
I have tested the changes, and now sparkr dataframes are working well (with
the `spark` variable which
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/932
@Leemoonsoo Just pushed the asked changes regarding licenses.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/1195
Tested this with spark 2.0 and scala 2.11.
Spark 2.0 works well with scala, R and python.
@minahlee comment makes sense - we should ship the latest version.
---
If your project
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/980
Closing this. Spark 2.0 is implemented with #1195
Optionally, a new PR can be opened to port the Spark interpreter from Java
to Scala if interest.
---
If your project is set up for it, you
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/930
No, not ready. None of the envisaged solutions are practicable.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/930
pong :) I don't see any solution for this. Does this issue bother anyone
else?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/998
LGTM
I have tested and works well for me.
Gone through the code and changes make sense.
Will be useful to get it into 0.6 release (especially if #836 is also in
0.6
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/994
@minahlee thx for this precision and context.
True, I just realized after sending the comment that repo is not part of
zeppelin-server.
However, I need zeppelin-server in my project (I
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/993
@AhyoungRyu If you can come to an implementation that fits @prabhjyotsingh
good idea, it would be great if you could make it `generic`, with a
configurable list of functions that reflect
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/994
Good to hear the release plugin is working fine.
The release manager is responsible for the tools he wants. Fine to me if it
is a script or a plugin, but at the end the artifacts must
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/994
Didn't look at the code... just saw in the description (and @minahlee just
confirmed it would be published).
Thinking more about this PR:
- Why the deploy and release plugins were
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/994
why spark is not published. is it related to the assembly?
Btw, spark 2 doesn't use assembly any more and favor dependencies in
separate jars. See https://issues.apache.org/jira/browse
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/980
- If you ship in the same folder scala libs from different versions, it
will at runtime - You don't have to rebuilt, but you have to arrange classpath
is built with scala libs of the same version
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/980
@Leemoonsoo
- I was just saying that a single binary will not fit all various users
need (multiple combination of interpeters and versions).
- #629 is merged. What remains to get ZEPPELIN
Github user echarles commented on the issue:
https://github.com/apache/zeppelin/pull/980
Dealing with mixed scala 2.10/2.11 and spark 1.x/2.x with a same
implementation is always possible but drives to code plenty of method
invocation (see e.g.
https://github.com/lresende/incubator
Github user echarles commented on the issue:
https://github.com/apache/incubator-zeppelin/pull/980
Sure, we can wait on #747 merge.
I see there is a
`spark/src/main/scala-2.11/org/apache/zeppelin/spark/SparkInterpreter.java`:
does this mean that there will be 2 separate
GitHub user echarles opened a pull request:
https://github.com/apache/incubator-zeppelin/pull/980
[ZEPPELIN-871] [WIP] spark 2.0 interpreter on scala 2.11
### What is this PR for?
Spark interpreter for spark version 2.0.0 and scala 2.11 (implemented in
Scala)
### What
Github user echarles commented on the issue:
https://github.com/apache/incubator-zeppelin/pull/932
Any feedback on moving to jersey 2? (btw CI is green)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project
Github user echarles commented on the issue:
https://github.com/apache/incubator-zeppelin/pull/949
All Green now. LGTM confirmed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user echarles commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/930
Tried with the ${session.executionRootDirectory} and got [ERROR] around
Ant part ...
Github user echarles commented on the pull request:
https://github.com/apache/incubator-zeppelin/pull/930
@bzz Just commented on ZEPPELIN-902 - My concern was on my local build, not
on Travis stability.
As mentionned onthe JIRA, the target `target` folder is not present after
GitHub user echarles opened a pull request:
https://github.com/apache/incubator-zeppelin/pull/932
Replace CXF with Jersey2 [ZEPPELIN-903]
### What is this PR for?
Use jersey2 instead of CXF to manage JSON REST requests and responses.
Jersey2 can better manage the JSON bodies
GitHub user echarles opened a pull request:
https://github.com/apache/incubator-zeppelin/pull/930
Make path for .spark-dist folder always accessible
### What is this PR for?
Current Path for .spark-dist is outside the reactor, which can breaks build.
[INFO
91 matches
Mail list logo
