Maziyar PANAHI created ZEPPELIN-3987:
----------------------------------------
Summary: Zeppelin 0.9.0 fail to access Notebooks from HDFS
Key: ZEPPELIN-3987
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3987
Project: Zeppelin
Issue Type: Bug
Affects Versions: 0.9.0
Environment: Cloudera 6.1
Spark 2.4
Hadoop 3.0
Shiro, LDAP
Reporter: Maziyar PANAHI
Attachments: Screenshot 2019-02-03 17.59.35.png
Hi,
I have built Zeppelin-0.9.0-SNAPSHOT and copied my configs from previous
version 0.8.2 into this new directory. Usually, all the versions after 0.8.0
(0.8.1, 0.8.2) immediately after start will fetch all the notebooks from HDFS.
However, in 0.9.0 the UI is empty and the logs also indicate the reading
Notebooks did not happen.
{code:java}
<property> <name>zeppelin.notebook.storage</name>
<value>org.apache.zeppelin.notebook.repo.FileSystemNotebookRepo</value>
<description>hadoop compatible file system notebook persistence layer
implementation</description> </property>
<property> <name>zeppelin.notebook.dir</name>
<value>hdfs://hadoop-master-1:8020/user/zeppelin/notebook</value>
<description>path or URI for notebook persist</description> </property>
{code}
The startup logs:
{code:java}
INFO [2019-02-03 17:55:41,797] ({main} ZeppelinConfiguration.java[create]:127)
- Load configuration from
file:/opt/zeppelin-0.9.0-SNAPSHOT/conf/zeppelin-site.xml
INFO [2019-02-03 17:55:41,856] ({main} ZeppelinConfiguration.java[create]:135)
- Server Host: 0.0.0.0
INFO [2019-02-03 17:55:41,857] ({main} ZeppelinConfiguration.java[create]:137)
- Server Port: 8080
INFO [2019-02-03 17:55:41,857] ({main} ZeppelinConfiguration.java[create]:141)
- Context Path: /
INFO [2019-02-03 17:55:41,857] ({main} ZeppelinConfiguration.java[create]:142)
- Zeppelin Version: 0.9.0-SNAPSHOT
INFO [2019-02-03 17:55:41,876] ({main} Log.java[initialized]:193) - Logging
initialized @440ms to org.eclipse.jetty.util.log.Slf4jLog
WARN [2019-02-03 17:55:41,994] ({main}
ServerConnector.java[setSoLingerTime]:458) - Ignoring deprecated socket close
linger time
INFO [2019-02-03 17:55:42,064] ({main}
ZeppelinServer.java[setupWebAppContext]:403) - ZeppelinServer Webapp path:
/opt/zeppelin-0.9.0-SNAPSHOT/webapps
WARN [2019-02-03 17:55:42,223] ({main}
NotebookAuthorization.java[getInstance]:79) - Notebook authorization module was
called without initialization, initializing with default configuration
WARN [2019-02-03 17:55:42,225] ({main}
ZeppelinConfiguration.java[getConfigFSDir]:545) - zeppelin.config.fs.dir is not
specified, fall back to local conf directory zeppelin.conf.dir
WARN [2019-02-03 17:55:42,225] ({main}
ZeppelinConfiguration.java[getConfigFSDir]:545) - zeppelin.config.fs.dir is not
specified, fall back to local conf directory zeppelin.conf.dir
INFO [2019-02-03 17:55:42,225] ({main}
LocalConfigStorage.java[loadNotebookAuthorization]:84) - Load notebook
authorization from file:
/opt/zeppelin-0.9.0-SNAPSHOT/conf/notebook-authorization.json
INFO [2019-02-03 17:55:42,279] ({main} Credentials.java[loadFromFile]:121) -
/opt/zeppelin-0.9.0-SNAPSHOT/conf/credentials.json
INFO [2019-02-03 17:55:42,350] ({main} NotebookServer.java[<init>]:145) -
NotebookServer instantiated: org.apache.zeppelin.socket.NotebookServer@ae13544
INFO [2019-02-03 17:55:42,350] ({main}
NotebookServer.java[setServiceLocator]:150) - Injected ServiceLocator:
ServiceLocatorImpl(shared-locator,0,1089504328)
INFO [2019-02-03 17:55:42,351] ({main} NotebookServer.java[setNotebook]:156) -
Injected NotebookProvider
INFO [2019-02-03 17:55:42,353] ({main}
NotebookServer.java[setNotebookService]:163) - Injected NotebookServiceProvider
INFO [2019-02-03 17:55:42,359] ({main} ZeppelinServer.java[main]:233) -
Starting zeppelin server
INFO [2019-02-03 17:55:42,361] ({main} Server.java[doStart]:370) -
jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git:
c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_201-b09
INFO [2019-02-03 17:55:44,696] ({main}
StandardDescriptorProcessor.java[visitServlet]:283) - NO JSP Support for /, did
not find org.eclipse.jetty.jsp.JettyJspServlet
INFO [2019-02-03 17:55:44,711] ({main}
DefaultSessionIdManager.java[doStart]:365) - DefaultSessionIdManager
workerName=node0
INFO [2019-02-03 17:55:44,711] ({main}
DefaultSessionIdManager.java[doStart]:370) - No SessionScavenger set, using
defaults
INFO [2019-02-03 17:55:44,713] ({main} HouseKeeper.java[startScavenging]:149) -
node0 Scavenging every 660000ms
INFO [2019-02-03 17:55:44,720] ({main} ContextHandler.java[log]:2345) -
Initializing Shiro environment
INFO [2019-02-03 17:55:44,720] ({main}
EnvironmentLoader.java[initEnvironment]:133) - Starting Shiro environment
initialization.
INFO [2019-02-03 17:55:45,078] ({main} IniRealm.java[processDefinitions]:188) -
IniRealm defined, but there is no [users] section defined. This realm will not
be populated with any users and it is assumed that they will be populated
programatically. Users must be defined for this Realm instance to be useful.
INFO [2019-02-03 17:55:45,078] ({main}
IniSecurityManagerFactory.java[isAutoApplyRealms]:127) - Realms have been
explicitly set on the SecurityManager instance - auto-setting of realms will
not occur.
INFO [2019-02-03 17:55:45,082] ({main}
EnvironmentLoader.java[initEnvironment]:147) - Shiro environment initialized in
361 ms.
INFO [2019-02-03 17:55:46,010] ({main} ContextHandler.java[doStart]:855) -
Started
o.e.j.w.WebAppContext@38e79ae3{zeppelin-web,/,file:///opt/zeppelin-0.9.0-SNAPSHOT/webapps/webapp/,AVAILABLE}{/opt/zeppelin-0.9.0-SNAPSHOT/zeppelin-web-0.9.0-SNAPSHOT.war}
INFO [2019-02-03 17:55:46,027] ({main} AbstractConnector.java[doStart]:292) -
Started ServerConnector@7a18e8d{HTTP/1.1,[http/1.1]}{0.0.0.0:8080}
INFO [2019-02-03 17:55:46,027] ({main} Server.java[doStart]:407) - Started
@4593ms
INFO [2019-02-03 17:55:46,027] ({main} ZeppelinServer.java[main]:243) - Done,
zeppelin server started
{code}
Built by
{code:java}
mvn clean package -Pbuild-distr -DskipTests -Pspark-2.4 -Pscala-2.11 -pl '!beam'
{code}
And
{code:java}
mvn clean package -Pbuild-distr -DskipTests -Dhadoop3 -Pspark-2.4 -Pscala-2.11
-pl '!beam'
{code}
With the same result of missing Notebooks. If I start my Zeppelin 0.8.x with
the same conf directory, all the notebooks are there.
Thanks.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
