Hi Pablo,
Yes, you need the AWS environment variables o credentials file in .aws
folder in your home...
2015-11-04 11:34 GMT+01:00 Pablo Torre <pablotorr...@gmail.com>:
> Hi Victor,
>
> Taking a look at your suggestion, I was wondering if we need to export the
> AWS Credentials.....
>
> Best,
> Pablo
>
> 2015-11-03 10:46 GMT+01:00 Victor Manuel Garcia <victor.gar...@beeva.com>:
>
>> Hi Josef,
>> For use S3 you need:
>>
>> Folder structure needs S3:
>> bucket/username/notebook/
>>
>> set the enviroment variable:
>> export ZEPPELIN_NOTEBOOK_S3_BUCKET=bucket
>> export ZEPPELIN_NOTEBOOK_S3_USER=username
>>
>> and in zeppelin-site.xml:
>> <!-- If used S3 to storage the notebooks, it is necessary the following
>> folder structure bucketname/username/notebook/ -->
>> <!--
>> <property>
>> <name>zeppelin.notebook.s3.user</name>
>> <value>user</value>
>> <description>user name for s3 folder structure</description>
>> </property>
>> <property>
>> <name>zeppelin.notebook.s3.bucket</name>
>> <value>zeppelin</value>
>> <description>bucket name for notebook storage</description>
>> </property>
>>
>> Uncomment:
>> <property> <name>zeppelin.notebook.storage</name>
>> <value>org.apache.zeppelin.notebook.repo.S3NotebookRepo</value>
>> <description>notebook persistence layer implementation</description>
>> </property>
>>
>> Comment:
>> <property>
>> <name>zeppelin.notebook.storage</name>
>> <value>org.apache.zeppelin.notebook.repo.VFSNotebookRepo</value>
>> <description>notebook persistence layer implementation</description>
>> </property>
>>
>>
>>
>>
>>
>> 2015-11-03 10:11 GMT+01:00 Josef A. Habdank <jahabd...@gmail.com>:
>>
>>> Hello,
>>>
>>> on the presentation on Spark Summit Amsterdam Moon showcased that it is
>>> possible to change a location of the storage of the notebooks to S3 (so
>>> they are not stored locally on the zeppelin machine).
>>>
>>> I am running a standard Amazon EMR cluster with Zeppelin 0.6 SNAPSHOT
>>> (default Amazon installation).
>>>
>>> I tried to modify the /etc/zeppelin/conf.dist/zeppelin-env.sh file
>>> changing
>>> export ZEPPELIN_NOTEBOOK_DIR=/var/lib/zeppelin/notebook
>>>
>>> to the following:
>>> export ZEPPELIN_NOTEBOOK_DIR=s3:/bucket/folder
>>> export ZEPPELIN_NOTEBOOK_DIR=s3://bucket/folder
>>> export ZEPPELIN_NOTEBOOK_DIR=s3n://bucket/folder
>>>
>>> and each time when I restart Zeppelin using
>>> sudo /usr/lib/zeppelin/bin/zeppelin-daemon.sh stop
>>> sudo /usr/lib/zeppelin/bin/zeppelin-daemon.sh start
>>>
>>> I get error:
>>> "Notebook dir doesn't exist, create"
>>>
>>> when looking in to the zeppelin-env.sh I noticed it only checks for the
>>> local folder.
>>> if [[ ! -d "${ZEPPELIN_NOTEBOOK_DIR}" ]]; then
>>> echo "Notebook dir doesn't exist, create ${ZEPPELIN_NOTEBOOK_DIR}"
>>> $(mkdir -p "${ZEPPELIN_NOTEBOOK_DIR}")
>>> fi
>>>
>>> So I assume it is not the way :)
>>>
>>> Can you please tell me how can I do it? I want to store all my notebooks
>>> on s3 folder, rather than locally.
>>>
>>> Thanks a lot!
>>>
>>> Josef
>>>
>>
>>
>>
>> --
>> *Victor Manuel Garcia Martinez*
>> *Ingeniero de Software
>> *
>>
>> *+34 672104297 <%2B34%20672104297> | victor.gar...@beeva.com
>> <marta.ta...@beeva.com>*
>> * | victormanuel.garcia.marti...@bbva.com
>> <marta.ta...@bbva.com>*
>>
>>
>>
>> <http://www.beeva.com/>
>>
>>
>>
>
>
> --
> Pablo Torre.
> Freelance software engineer and Ruby on Rails developer.
> Oleiros (Coruña)
> *Personal site <http://www.pablotorrerodriguez.com>*
> My blog <http://www.aboutechnologies.com>
>
--
*Victor Manuel Garcia Martinez*
*Ingeniero de Software
*
*+34 672104297 | victor.gar...@beeva.com <marta.ta...@beeva.com>*
* | victormanuel.garcia.marti...@bbva.com
<marta.ta...@bbva.com>*
<http://www.beeva.com/>
