Re: How to add Cassandra Interpreter to Zeppelin on EMR?

2018-12-22 Thread Xun Liu
I don't have Cassandra in my zeppelin, so I can only help you guess where the 
problem is from the log.

From your log, These two questions should all be caused by the lack of 
dependent JAR packages that Cassandra runs. You may not be setting up the 
runtime environment for Cassandra(or scala) correctly.
You can look at the missing class according to the log, then download the JAR 
package from the class name to the `zeppelin/interpreter/Cassandra/…` directory 
and try to solve the problem.


> 在 2018年12月23日,上午12:03,shyla deshpande  写道:
> 
> I wanted to add that I am using
> emr-5.20.0
> Applications:Spark 2.4.0, Zeppelin 0.8.0, 
> Thanks 
> 
> On Sat, Dec 22, 2018 at 7:56 AM shyla deshpande  > wrote:
> Hi Xun,
> 
> Thank you for your response. You set me in the right direction and I made 
> some progress.
> I still have 2 issues.
> 1. I was able to add the cassandra interpreter. But now I am getting the 
> following error. 
> 
> 2. I am unable to add spark-cassandra-connector 
> 
> 
> I appreciate your help.
> Thanks
> -Shyla
> 
> On Fri, Dec 21, 2018 at 7:21 PM Xun Liu  > wrote:
> hi, shyla deshpande
> 
> You can check if the cassandra interpreter is registered in zeppelin's 
> startup log in the zeppelin/logs/zeppelin-{hostname}.log file.
> You may need to restart zeppelin and you can easily see the interpreter 
> registration information.
> 
>  INFO [2018-12-21 21:36:18,967] ({Thread-13} 
> RemoteInterpreterEventServer.java[run]:103) - InterpreterEventServer is 
> starting at 10.120.196.234:48573 
>  INFO [2018-12-21 21:36:19,455] ({main} 
> RemoteInterpreterEventServer.java[start]:127) - RemoteInterpreterEventServer 
> is started
>  INFO [2018-12-21 21:36:19,492] ({main} 
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
> InterpreterSettingTemplate: hazelcastjet
>  INFO [2018-12-21 21:36:19,497] ({main} 
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
> InterpreterSettingTemplate: flink
>  INFO [2018-12-21 21:36:19,501] ({main} 
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
> InterpreterSettingTemplate: ignite
>  INFO [2018-12-21 21:36:19,509] ({main} 
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
> InterpreterSettingTemplate: kylin
>  INFO [2018-12-21 21:36:19,512] ({main} 
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
> InterpreterSettingTemplate: angular
>  WARN [2018-12-21 21:36:19,546] ({main} 
> InterpreterSettingManager.java[loadInterpreterSettingFromDefaultDir]:335) - 
> No interpreter-setting.json found in 
> /home/hadoop/zeppelin-current/interpreter/scio
>  INFO [2018-12-21 21:36:19,550] ({main} 
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
> InterpreterSettingTemplate: cassandra
>  INFO [2018-12-21 21:36:19,553] ({main} 
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
> InterpreterSettingTemplate: scalding
>  INFO [2018-12-21 21:36:19,555] ({main} 
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
> InterpreterSettingTemplate: lens
>  INFO [2018-12-21 21:36:19,559] ({main} 
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
> InterpreterSettingTemplate: livy
>  INFO [2018-12-21 21:36:19,562] ({main} 
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
> InterpreterSettingTemplate: java
>  INFO [2018-12-21 21:36:19,565] ({main} 
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
> InterpreterSettingTemplate: sh
>  INFO [2018-12-21 21:36:19,567] ({main} 
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
> InterpreterSettingTemplate: alluxio
>  INFO [2018-12-21 21:36:19,570] ({main} 
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
> InterpreterSettingTemplate: beam
>  INFO [2018-12-21 21:36:19,572] ({main} 
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
> InterpreterSettingTemplate: elasticsearch
>  INFO [2018-12-21 21:36:19,575] ({main} 
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
> InterpreterSettingTemplate: md
>  INFO [2018-12-21 21:36:19,578] ({main} 
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
> InterpreterSettingTemplate: spark
>  INFO [2018-12-21 21:36:19,580] ({main} 
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
> InterpreterSettingTemplate: file
>  INFO [2018-12-21 21:36:19,584] ({main} 
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
> InterpreterSettingTemplate: submarine
>  INFO [2018-12-21 21:36:19,586] ({main} 
> InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
> InterpreterSettingTemplate: geode
>  INFO [2018-12-21 2

Re: How to add Cassandra Interpreter to Zeppelin on EMR?

2018-12-21 Thread Xun Liu
hi, shyla deshpande

You can check if the cassandra interpreter is registered in zeppelin's startup 
log in the zeppelin/logs/zeppelin-{hostname}.log file.
You may need to restart zeppelin and you can easily see the interpreter 
registration information.

 INFO [2018-12-21 21:36:18,967] ({Thread-13} 
RemoteInterpreterEventServer.java[run]:103) - InterpreterEventServer is 
starting at 10.120.196.234:48573
 INFO [2018-12-21 21:36:19,455] ({main} 
RemoteInterpreterEventServer.java[start]:127) - RemoteInterpreterEventServer is 
started
 INFO [2018-12-21 21:36:19,492] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: hazelcastjet
 INFO [2018-12-21 21:36:19,497] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: flink
 INFO [2018-12-21 21:36:19,501] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: ignite
 INFO [2018-12-21 21:36:19,509] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: kylin
 INFO [2018-12-21 21:36:19,512] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: angular
 WARN [2018-12-21 21:36:19,546] ({main} 
InterpreterSettingManager.java[loadInterpreterSettingFromDefaultDir]:335) - No 
interpreter-setting.json found in /home/hadoop/zeppelin-current/interpreter/scio
 INFO [2018-12-21 21:36:19,550] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: cassandra
 INFO [2018-12-21 21:36:19,553] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: scalding
 INFO [2018-12-21 21:36:19,555] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: lens
 INFO [2018-12-21 21:36:19,559] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: livy
 INFO [2018-12-21 21:36:19,562] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: java
 INFO [2018-12-21 21:36:19,565] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: sh
 INFO [2018-12-21 21:36:19,567] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: alluxio
 INFO [2018-12-21 21:36:19,570] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: beam
 INFO [2018-12-21 21:36:19,572] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: elasticsearch
 INFO [2018-12-21 21:36:19,575] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: md
 INFO [2018-12-21 21:36:19,578] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: spark
 INFO [2018-12-21 21:36:19,580] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: file
 INFO [2018-12-21 21:36:19,584] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: submarine
 INFO [2018-12-21 21:36:19,586] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: geode
 INFO [2018-12-21 21:36:19,588] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: bigquery
 INFO [2018-12-21 21:36:19,590] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: pig
 INFO [2018-12-21 21:36:19,593] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: neo4j
 INFO [2018-12-21 21:36:19,595] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: hbase
 INFO [2018-12-21 21:36:19,597] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: groovy
 INFO [2018-12-21 21:36:19,599] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: sap
 INFO [2018-12-21 21:36:19,602] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: python
 INFO [2018-12-21 21:36:19,604] ({main} 
InterpreterSettingManager.java[registerInterpreterSetting]:429) - Register 
InterpreterSettingTemplate: jdbc
 INFO [2018-12-21 21:36:19,610] ({main} 
FileSystemConfigStorage.java[loadInterpreterSettings]:75) - Load Interpreter 
Setting from file: hdfs://mldev/user/hadoop

How to add Cassandra Interpreter to Zeppelin on EMR?

2018-12-21 Thread shyla deshpande
Directory /usr/lib/zeppelin/interpreter/cassandra already exists.

But when Create new interpreter in 'Interpreter' menu on Zeppelin GUI,
What are the properties name and value I should specify. Any dependencies I
should add?

Appreciate your help
Thanks
-shyla