Maziyar PANAHI created ZEPPELIN-3987:
----------------------------------------

             Summary: Zeppelin 0.9.0 fail to access Notebooks from HDFS
                 Key: ZEPPELIN-3987
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3987
             Project: Zeppelin
          Issue Type: Bug
    Affects Versions: 0.9.0
         Environment: Cloudera 6.1

Spark 2.4

Hadoop 3.0

Shiro, LDAP
            Reporter: Maziyar PANAHI
         Attachments: Screenshot 2019-02-03 17.59.35.png

Hi,

I have built Zeppelin-0.9.0-SNAPSHOT and copied my configs from previous 
version 0.8.2 into this new directory. Usually, all the versions after 0.8.0 
(0.8.1, 0.8.2) immediately after start will fetch all the notebooks from HDFS. 
However, in 0.9.0 the UI is empty and the logs also indicate the reading 
Notebooks did not happen. 
{code:java}
<property> <name>zeppelin.notebook.storage</name> 
<value>org.apache.zeppelin.notebook.repo.FileSystemNotebookRepo</value> 
<description>hadoop compatible file system notebook persistence layer 
implementation</description> </property>
<property> <name>zeppelin.notebook.dir</name> 
<value>hdfs://hadoop-master-1:8020/user/zeppelin/notebook</value> 
<description>path or URI for notebook persist</description> </property>
{code}
The startup logs:

 
{code:java}
INFO [2019-02-03 17:55:41,797] ({main} ZeppelinConfiguration.java[create]:127) 
- Load configuration from 
file:/opt/zeppelin-0.9.0-SNAPSHOT/conf/zeppelin-site.xml
INFO [2019-02-03 17:55:41,856] ({main} ZeppelinConfiguration.java[create]:135) 
- Server Host: 0.0.0.0
INFO [2019-02-03 17:55:41,857] ({main} ZeppelinConfiguration.java[create]:137) 
- Server Port: 8080
INFO [2019-02-03 17:55:41,857] ({main} ZeppelinConfiguration.java[create]:141) 
- Context Path: /
INFO [2019-02-03 17:55:41,857] ({main} ZeppelinConfiguration.java[create]:142) 
- Zeppelin Version: 0.9.0-SNAPSHOT
INFO [2019-02-03 17:55:41,876] ({main} Log.java[initialized]:193) - Logging 
initialized @440ms to org.eclipse.jetty.util.log.Slf4jLog
WARN [2019-02-03 17:55:41,994] ({main} 
ServerConnector.java[setSoLingerTime]:458) - Ignoring deprecated socket close 
linger time
INFO [2019-02-03 17:55:42,064] ({main} 
ZeppelinServer.java[setupWebAppContext]:403) - ZeppelinServer Webapp path: 
/opt/zeppelin-0.9.0-SNAPSHOT/webapps
WARN [2019-02-03 17:55:42,223] ({main} 
NotebookAuthorization.java[getInstance]:79) - Notebook authorization module was 
called without initialization, initializing with default configuration
WARN [2019-02-03 17:55:42,225] ({main} 
ZeppelinConfiguration.java[getConfigFSDir]:545) - zeppelin.config.fs.dir is not 
specified, fall back to local conf directory zeppelin.conf.dir
WARN [2019-02-03 17:55:42,225] ({main} 
ZeppelinConfiguration.java[getConfigFSDir]:545) - zeppelin.config.fs.dir is not 
specified, fall back to local conf directory zeppelin.conf.dir
INFO [2019-02-03 17:55:42,225] ({main} 
LocalConfigStorage.java[loadNotebookAuthorization]:84) - Load notebook 
authorization from file: 
/opt/zeppelin-0.9.0-SNAPSHOT/conf/notebook-authorization.json
INFO [2019-02-03 17:55:42,279] ({main} Credentials.java[loadFromFile]:121) - 
/opt/zeppelin-0.9.0-SNAPSHOT/conf/credentials.json
INFO [2019-02-03 17:55:42,350] ({main} NotebookServer.java[<init>]:145) - 
NotebookServer instantiated: org.apache.zeppelin.socket.NotebookServer@ae13544
INFO [2019-02-03 17:55:42,350] ({main} 
NotebookServer.java[setServiceLocator]:150) - Injected ServiceLocator: 
ServiceLocatorImpl(shared-locator,0,1089504328)
INFO [2019-02-03 17:55:42,351] ({main} NotebookServer.java[setNotebook]:156) - 
Injected NotebookProvider
INFO [2019-02-03 17:55:42,353] ({main} 
NotebookServer.java[setNotebookService]:163) - Injected NotebookServiceProvider
INFO [2019-02-03 17:55:42,359] ({main} ZeppelinServer.java[main]:233) - 
Starting zeppelin server
INFO [2019-02-03 17:55:42,361] ({main} Server.java[doStart]:370) - 
jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: 
c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_201-b09
INFO [2019-02-03 17:55:44,696] ({main} 
StandardDescriptorProcessor.java[visitServlet]:283) - NO JSP Support for /, did 
not find org.eclipse.jetty.jsp.JettyJspServlet
INFO [2019-02-03 17:55:44,711] ({main} 
DefaultSessionIdManager.java[doStart]:365) - DefaultSessionIdManager 
workerName=node0
INFO [2019-02-03 17:55:44,711] ({main} 
DefaultSessionIdManager.java[doStart]:370) - No SessionScavenger set, using 
defaults
INFO [2019-02-03 17:55:44,713] ({main} HouseKeeper.java[startScavenging]:149) - 
node0 Scavenging every 660000ms
INFO [2019-02-03 17:55:44,720] ({main} ContextHandler.java[log]:2345) - 
Initializing Shiro environment
INFO [2019-02-03 17:55:44,720] ({main} 
EnvironmentLoader.java[initEnvironment]:133) - Starting Shiro environment 
initialization.
INFO [2019-02-03 17:55:45,078] ({main} IniRealm.java[processDefinitions]:188) - 
IniRealm defined, but there is no [users] section defined. This realm will not 
be populated with any users and it is assumed that they will be populated 
programatically. Users must be defined for this Realm instance to be useful.
INFO [2019-02-03 17:55:45,078] ({main} 
IniSecurityManagerFactory.java[isAutoApplyRealms]:127) - Realms have been 
explicitly set on the SecurityManager instance - auto-setting of realms will 
not occur.
INFO [2019-02-03 17:55:45,082] ({main} 
EnvironmentLoader.java[initEnvironment]:147) - Shiro environment initialized in 
361 ms.
INFO [2019-02-03 17:55:46,010] ({main} ContextHandler.java[doStart]:855) - 
Started 
o.e.j.w.WebAppContext@38e79ae3{zeppelin-web,/,file:///opt/zeppelin-0.9.0-SNAPSHOT/webapps/webapp/,AVAILABLE}{/opt/zeppelin-0.9.0-SNAPSHOT/zeppelin-web-0.9.0-SNAPSHOT.war}
INFO [2019-02-03 17:55:46,027] ({main} AbstractConnector.java[doStart]:292) - 
Started ServerConnector@7a18e8d{HTTP/1.1,[http/1.1]}{0.0.0.0:8080}
INFO [2019-02-03 17:55:46,027] ({main} Server.java[doStart]:407) - Started 
@4593ms
INFO [2019-02-03 17:55:46,027] ({main} ZeppelinServer.java[main]:243) - Done, 
zeppelin server started
{code}
Built by
{code:java}
mvn clean package -Pbuild-distr -DskipTests -Pspark-2.4 -Pscala-2.11 -pl '!beam'
{code}
And 
{code:java}
mvn clean package -Pbuild-distr -DskipTests -Dhadoop3 -Pspark-2.4 -Pscala-2.11 
-pl '!beam'
{code}
With the same result of missing Notebooks. If I start my Zeppelin 0.8.x with 
the same conf directory, all the notebooks are there.

 

Thanks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to