Hi Fan, You were right, I didn't download the distribution package correctly. Thank you for the idea.
After downloading distribution package, i did as the vagrant file says. but now when i browse in to openrdf-workbench i don't get the correct window. i get status 500 massage. any idea about this is appreciated. Thank you! On Sat, May 14, 2016 at 8:39 PM, Fan Yang <[email protected]> wrote: > Hi Amila, > > I’m nor sure if you download and unzip the distribution package correctly. > For me, I have 226 jar packages under “lib” folder. You could try to > manually download the distribution package from " > https://www.dropbox.com/s/7e74yiuq4jmu0od/rya.indexing.example-3.2.10 > -distribution.zip” and redo the steps on vagrant file to see if it works. > > Bests, > > Fan > > On May 14, 2016, at 7:53 AM, Amila Wijayarathna <[email protected]> > wrote: > > Hi Adina, > I went through the vagrant file. And there is a line, > > > *# soft linking the files doesn't seem to work in tomcat, so we copy them > instead :(* > > *sudo cp > rya.indexing.example-${RYA_EXAMPLE_VERSION}-distribution/dist/lib/* > /var/lib/tomcat7/webapps/openrdf-workbench/WEB-INF/lib/* > > *sudo cp > rya.indexing.example-${RYA_EXAMPLE_VERSION}-distribution/dist/lib/* > /var/lib/tomcat7/webapps/openrdf-sesame/WEB-INF/lib/* > > But I was unable to do so because I cannot find */dist/lib/* .* > Any guidelines about this is thoroughly appreciated. > > Thank you! > > On Mon, May 9, 2016 at 7:45 PM, Amila Wijayarathna < > [email protected] > > wrote: > > > Hi Adina, > > The files you mentioned are not existing in the directory. > I will go through your guidelines and vagrant file. > > Thank you! > > On Mon, May 9, 2016 at 7:29 PM, Adina Crainiceanu <[email protected]> wrote: > > Based on your error and the vagrant readme file, I think the OpenRDF > Workbench transformations are not installed. > > Try this - adapted for your computer instead of the vagrant VM: > "OpenRDF Workbench requires a set of "transformations" for listing Rya in > the OpenRDF Workbench Repository list. The transforms are in this > directory: /var/lib/tomcat7/webapps/openrdf-workbench/transformations/ > > 1. Verify that this file exists: create-RyaAccumuloSail.xsl > 2. Verify that create.xsl has been updated for rya. (run: "cat > > create.xsl | grep Rya" and make sure there's some stuff there.) > > If these files do note exists, open the vagrant file and look for the > line echo "Downloading Rya". Try working through those commands manually > on your Vagrant VM." > > In particular, the lines for "# Download and install new templates for > OpenRdf WorkBench" in the vagrant file might be the ones that you are > missing. > > Please make detailed notes of what you are doing, so we can reproduce the > process on a new machine - I'm tryiong to get an Amazon EC2 instance so we > can all have access to it. > > > Adina > > > > > On Mon, May 9, 2016 at 9:09 AM, Amila Wijayarathna < > [email protected]> wrote: > > Hi Adina, > As in the vagrant file i tried to connect Rya via OpenRDF workbench to > insert data. When i create new repository in workbench i have chose the > type. But there is no "Rya Accumulo Store" type to chose as in the > vagrant file. > Any idea about this is thoroughly appriciated. > > Thank you! > > On Sat, May 7, 2016 at 9:36 PM, Adina Crainiceanu <[email protected]> > wrote: > > Hi, > > The screen shot for the web.rya/sparqlQuery.jsp looks correct. You > should try to insert some data and see if you can query it back. You might > be able to do an insert and select through the web.rya interface, but I'm > not sure about the insert. > > > The easiest way to do insert is through the openRDF Workbench interface. > Look in the vagrant file to see how to set it up. > Look in the Readme file for the vagrant example to see how to load some > data > > https://github.com/apache/incubator-rya/tree/develop/extras/vagrantExample/src/main/vagrant > > Once you have data, you should be able to use either the we.rya > interface or the openRDf workbench interface to query the data using a > sparql select query. > > Adina > > On Sat, May 7, 2016 at 8:37 AM, Amila Wijayarathna < > [email protected]> wrote: > > Hi Adina, > > I changed some settings and restart tomcat server. And when I browse > in to http://localhost:8080/web.rya/sparqlQuery.jsp , I got the > following window. > > Am I doing it correctly? If it is, I would like to know how to proceed > further. > > > Thank you! > > On Sat, May 7, 2016 at 12:43 PM, Amila Wijayarathna < > [email protected]> wrote: > > Hi Adina, > > When I changed the Accumulo instance volume in accumulo site.xml , I > can successfully start accumulo and I think it will not a problem for > instance name, it is remaining the same. So after a restart my laptop I > started the hadoop, zookeeper and accumulo and got the following, > > amila@amila-X550LD:~$ ~/Installs/hadoop-2.7.2/sbin/start-dfs.sh > Starting namenodes on [localhost] > localhost: starting namenode, logging to > > /home/amila/Installs/hadoop-2.7.2/logs/hadoop-amila-namenode-amila-X550LD.out > localhost: starting datanode, logging to > > /home/amila/Installs/hadoop-2.7.2/logs/hadoop-amila-datanode-amila-X550LD.out > Starting secondary namenodes [0.0.0.0] > 0.0.0.0: starting secondarynamenode, logging to > > /home/amila/Installs/hadoop-2.7.2/logs/hadoop-amila-secondarynamenode-amila-X550LD.out > > amila@amila-X550LD:~$ ~/Installs/zookeeper-3.4.8/bin/zkServer.sh > start > ZooKeeper JMX enabled by default > Using config: /home/amila/Installs/zookeeper-3.4.8/bin/../conf/zoo.cfg > Starting zookeeper ... STARTED > > amila@amila-X550LD:~$ ~/Installs/accumulo-1.6.4/bin/accumulo init > 2016-05-07 08:44:23,775 [init.Initialize] INFO : Hadoop Filesystem is > hdfs://localhost:9000 > 2016-05-07 08:44:23,776 [init.Initialize] INFO : Accumulo data dirs > are [hdfs://localhost:9000/ACCUMULO] > 2016-05-07 08:44:23,776 [init.Initialize] INFO : Zookeeper server is > localhost:2181 > 2016-05-07 08:44:23,776 [init.Initialize] INFO : Checking if > Zookeeper is available. If this hangs, then you need to make sure zookeeper > is running > Instance name : AMILA > Enter initial password for root (this may not be applicable for your > security setup): ******* > Confirm initial password for root: ******* > 2016-05-07 08:45:35,904 [Configuration.deprecation] INFO : > dfs.replication.min is deprecated. Instead, use > dfs.namenode.replication.min > 2016-05-07 08:45:36,948 [Configuration.deprecation] INFO : > dfs.block.size is deprecated. Instead, use dfs.blocksize > 2016-05-07 08:45:37,903 [conf.AccumuloConfiguration] INFO : Loaded > class : org.apache.accumulo.server.security.handler.ZKAuthorizor > 2016-05-07 08:45:37,907 [conf.AccumuloConfiguration] INFO : Loaded > class : org.apache.accumulo.server.security.handler.ZKAuthenticator > 2016-05-07 08:45:37,911 [conf.AccumuloConfiguration] INFO : Loaded > class : org.apache.accumulo.server.security.handler.ZKPermHandler > > amila@amila-X550LD:~$ > ~/Installs/accumulo-1.6.4/bin/start-all.shStarting monitor on localhost > WARN : Max open files on localhost is 1024, recommend 32768 > Starting tablet servers .... done > Starting tablet server on localhost > WARN : Max open files on localhost is 1024, recommend 32768 > 2016-05-07 08:46:05,553 [server.Accumulo] INFO : Attempting to talk > to zookeeper > 2016-05-07 08:46:05,711 [server.Accumulo] INFO : ZooKeeper connected > and initialized, attempting to talk to HDFS > 2016-05-07 08:46:05,844 [server.Accumulo] INFO : Connected to HDFS > Starting master on localhost > WARN : Max open files on localhost is 1024, recommend 32768 > Starting garbage collector on localhost > WARN : Max open files on localhost is 1024, recommend 32768 > Starting tracer on localhost > WARN : Max open files on localhost is 1024, recommend 32768 > > amila@amila-X550LD:~/Downloads$ cd apache-tomcat-7.0.68 > amila@amila-X550LD:~/Downloads/apache-tomcat-7.0.68$ ./bin/startup.sh > Using CATALINA_BASE: /home/amila/Downloads/apache-tomcat-7.0.68 > Using CATALINA_HOME: /home/amila/Downloads/apache-tomcat-7.0.68 > Using CATALINA_TMPDIR: /home/amila/Downloads/apache-tomcat-7.0.68/temp > Using JRE_HOME: /usr/local/java/jdk1.8.0_74/jre > Using CLASSPATH: > > /home/amila/Downloads/apache-tomcat-7.0.68/bin/bootstrap.jar:/home/amila/Downloads/apache-tomcat-7.0.68/bin/tomcat-juli.jar > Tomcat started. > > Earlier I didn't add the openrdf-sesame and openrdf-workbench war > files to the webapp folder as in the vagrant file. So I added them. But > when I open browser to http://localhost:8080/openrdf-sesame/protocol > I got the massage HTTP Status 404 - /openrdf-sesame/protocol > I think there must be a problem with tomcat cofigurations and i'm > working on that. > > Am I doing these things in a correct way? Any ideas about this is > appriciated. > > Thank you! > > On Fri, May 6, 2016 at 8:38 PM, Adina Crainiceanu <[email protected]> > wrote: > > Amila, > > Any progress in getting Accumulo and Rya running? What did you try > for this? > > As one of the emails suggested, you can delete the directory where > accumulo stores it data, and then re-initialize. The instance name does not > matter for Rya - it is just a parameter provided to Rya. > > The following snippet is the relevant part in the vagrant script to > re-create the data folders and re-initialize accumulo - note that the > vagrant script does not use hadoop, just the file system and zookeeper: > > sudo mkdir /data > sudo chown vagrant:vagrant /data > mkdir /data/accumulo > mkdir /data/accumulo/lib > mkdir /data/accumulo/lib/ext > echo "Starting Accumulo..." > accumulo-${ACCUMULO_VERSION}/bin/accumulo init --instance-name dev > --password root > accumulo-${ACCUMULO_VERSION}/bin/start-all.sh > > I am concerned by the lack of progress and the lack of a clear plan > for the project once the coding period begins. Please let me know what your > plans are. I'm here to help you to be successful. Failing, either after the > bonding period, at the mid-term time or at the end is not something that > anyone wants. > > > Adina > > On Tue, May 3, 2016 at 1:36 PM, Adina Crainiceanu <[email protected]> > wrote: > > Hi Amila, > > 1) Rya should be able to use whatever Accumulo instance name you > provide - did you try to use Rya with a given Accumulo instance name and it > did not work? What did you try? > > 2) > > DId you look at the vagrant script to see if it does something > different than you did? > > DId you have the problem first time you installed Accumulo, or only > on restart? > > Did you try to ping Zookeeper, to make sure it is up? > Ping Zookeeper (run: echo ruok | nc 127.0.0.1 2181). -- or > whatever ip/port you use for Zookeeper > > - If Zookeeper is okay, you should see the response imok > - Otherwise, restart Zookeeper (run something similar to > ~/Installs//zookeeper-3.4.5-cdh4.5.0/bin/zkServer.sh > > start) > > > 3) Try to connect to the Rya "office hours" tomorrow (Wednesday) at > 12pm EST. A message with connect information should be sent out tomorrow > morning. Then maybe you will be able to share your screen and ask for help. > > Adina > > > > On Tue, May 3, 2016 at 9:25 AM, Amila Wijayarathna < > [email protected]> wrote: > > Hi Adina, These days I'm trying to run Rya in my Ubuntu laptop. > Therefore I set up Hadoop, Zookeeper and Accumulo. After a shutdown, I need > to restart hadoop, zookeeper and accumulo. But when i do Hadoop and > Zookeeper servers are starting successfully but when i initialize Accumulo > i get the following, 2016-04-19 16:56:06,984 [fs.VolumeManagerImpl] WARN : > dfs.datanode.synconclose set to false in : data loss is possible on hard > system reset or power loss 2016-04-19 16:56:06,985 [init.Initialize] INFO : > Hadoop Filesystem is hdfs://localhost:9000 2016-04-19 16:56:06,986 > [init.Initialize] INFO : Accumulo data dirs are > [hdfs://localhost:9000/accumulo] 2016-04-19 16:56:06,986 [init.Initialize] > INFO : Zookeeper server is localhost:2181 2016-04-19 16:56:06,986 > [init.Initialize] INFO : Checking if Zookeeper is available. If this hangs, > then you need to make sure zookeeper is running 2016-04-19 16:56:07,250 > [init.Initialize] FATAL: It appears the directories > [hdfs://localhost:9000/accumulo] were previously initialized. 2016-04-19 > 16:56:07,250 [init.Initialize] FATAL: Change the property instance.volumes > to use different filesystems, 2016-04-19 16:56:07,250 [init.Initialize] > FATAL: or change the property instance.dfs.dir to use a different > directory. 2016-04-19 16:56:07,250 [init.Initialize] FATAL: The current > value of instance.dfs.uri is || 2016-04-19 16:56:07,250 [init.Initialize] > FATAL: The current value of instance.dfs.dir is |/accumulo| 2016-04-19 > 16:56:07,250 [init.Initialize] FATAL: The current value of instance.volumes > is |hdfs://localhost:9000/accumulo| Then i tried to start Accumulo with > ~/Installs/accumulo-1.6.4/bin/start-all.sh then i get following, WARN : > Using Zookeeper /home/amila/Installs/zookeeper-3.4.8/zookeeper-3.4.8. Use > version 3.3.0 or greater to avoid zookeeper deadlock bug. Starting monitor > on localhost WARN : Max open files on localhost is 1024, recommend 32768 > Starting tablet servers .... done 2016-04-19 17:40:43,303 > [fs.VolumeManagerImpl] WARN : dfs.datanode.synconclose set to false in > hdfs-site.xml: data loss is possible on hard system reset or power loss > 2016-04-19 17:40:43,308 [server.Accumulo] INFO : Attempting to talk to > zookeeper 2016-04-19 17:40:43,522 [server.Accumulo] INFO : Waiting for > accumulo to be initialized 2016-04-19 17:40:44,534 [server.Accumulo] INFO : > Waiting for accumulo to be initialized 2016-04-19 17:40:45,536 > [server.Accumulo] INFO : Waiting for accumulo to be initialized 2016-04-19 > 17:40:46,538 [server.Accumulo] INFO : Waiting for accumulo to be > initialized 2016-04-19 17:40:47,541 [server.Accumulo] INFO : Waiting for > accumulo to be initialized 2016-04-19 17:40:48,543 [server.Accumulo] INFO : > Waiting for accumulo to be initialized 2016-04-19 17:40:49,545 > [server.Accumulo] INFO : Waiting for accumulo to be initialized 2016-04-19 > 17:40:50,547 [server.Accumulo] INFO : Waiting for accumulo to be > initialized 2016-04-19 17:40:51,549 [server.Accumulo] INFO : Waiting for > accumulo to be initialized 2016-04-19 17:40:52,550 [server.Accumulo] INFO : > Waiting for accumulo to be initialized Starting tablet server on localhost > WARN : Max open files on localhost is 1024, recommend 32768 2016-04-19 > 17:40:53,551 [server.Accumulo] INFO : Waiting for accumulo to be > initialized 2016-04-19 17:40:54,552 [server.Accumulo] INFO : Waiting for > accumulo to be initialized 2016-04-19 17:40:55,554 [server.Accumulo] INFO : > Waiting for accumulo to be initialized 2016-04-19 17:40:56,555 > [server.Accumulo] INFO : Waiting for accumulo to be initialized 2016-04-19 > 17:40:57,556 [server.Accumulo] INFO : Waiting for accumulo to be > initialized 2016-04-19 17:40:58,558 [server.Accumulo] INFO : Waiting for > accumulo to be initialized 2016-04-19 17:40:59,559 [server.Accumulo] INFO : > Waiting for accumulo to be initialized 2016-04-19 17:41:00,561 > [server.Accumulo] INFO : Waiting for accumulo to be initialized But when I > change the instance name in accumulo-site.xml then I can successfully start > Accumulo. But I think to run Rya there must be a constant instance name as > in Rya README.md. I asked help from Accumulo-dev about this problem but I'm > unable to find a correct path to solve this. > Any idea about this is thoroughly appriciated. > Thank you. > > On Mon, May 2, 2016 at 8:39 PM, Adina Crainiceanu <[email protected]> > wrote: > > Hi Amila, > > Were you able to get Accumulo and Rya running on your machine? If > not, did you take a look at the Rya Vagrant example > > https://github.com/apache/incubator-rya/tree/develop/extras/vagrantExample/src/main/vagrant > to see if it helps? > > During this community bonding period, you will need to refine the > project proposal and have a concrete plan that you can start implementing > when the coding starts. A weekly plan would be best, or at least a plan > that has 2-week period sprints. When making the plan, please take into > consideration your outside commitments, exams, etc, and include those in > planning, so we know what to expect. We will help with the plan, just ask. > > In order to make it easy for everyone to collaborate, I created a > page on the Rya Confluence for your proposal - you should be able to create > a Confluence account and edit the page/add pages with details. > > https://cwiki.apache.org/confluence/display/RYA/Set-up+continuous+integration+for+Apache+Rya > > Here is an example for how a proposal and the details/planning, > etc looks like for a different project (not Rya) from last year GSoC: > > > https://cwiki.apache.org/confluence/display/AIRAVATA/%5BGSoC+Proposal%5D+Securing+Airavata+API > > Here is a fragment from a message about the expectation for > students during the community bonding period April 22-May 22: > > *Community Bonding activities may involve:* > > - Becoming familiar with the community practices and > processes. (This often involves a mix of observation and participation.) > - Participating on Mailing Lists / IRC / etc. (Not just > lurking.) > - Setting up their development environment. > - Small (or large) patches/bug fixes. (These do not need to > be directly related to their GSoC project.) > - Participating in code reviews for others. (Even someone who > isn't familiar with the project can contribute by pointing out potential > inefficiencies, bad error handling, etc.) > - Working with their mentor and other org members on refining > their project plan. This might include finalizing deadlines and > milestones, > adding more detail, figuring out potential issues, etc. > - If the student is already familiar with the organization, > they could be helping others get involved in the community. > - Reading (and updating!) documentation they will need to > understand to complete their project. > - Reporting or replicating bugs. > > > > Looking forward to working with you, > Adina > > > -- > Dr. Adina Crainiceanu > Associate Professor, Computer Science Department > United States Naval Academy > 410-293-6822 > [email protected] > http://www.usna.edu/Users/cs/adina/ > > > > > -- > > *Amila Wijayarathna* > Undergraduate, > Faculty of Information Technology, > University of Moratuwa, > Sri Lanka. > > > > > -- > Dr. Adina Crainiceanu > Associate Professor, Computer Science Department > United States Naval Academy > 410-293-6822 > [email protected] > http://www.usna.edu/Users/cs/adina/ > > > > > -- > Dr. Adina Crainiceanu > Associate Professor, Computer Science Department > United States Naval Academy > 410-293-6822 > [email protected] > http://www.usna.edu/Users/cs/adina/ > > > > > -- > > *Amila Wijayarathna* > Undergraduate, > Faculty of Information Technology, > University of Moratuwa, > Sri Lanka. > > > > > -- > > *Amila Wijayarathna* > Undergraduate, > Faculty of Information Technology, > University of Moratuwa, > Sri Lanka. > > > > > -- > Dr. Adina Crainiceanu > Associate Professor, Computer Science Department > United States Naval Academy > 410-293-6822 > [email protected] > http://www.usna.edu/Users/cs/adina/ > > > > > -- > > *Amila Wijayarathna* > Undergraduate, > Faculty of Information Technology, > University of Moratuwa, > Sri Lanka. > > > > > -- > Dr. Adina Crainiceanu > Associate Professor, Computer Science Department > United States Naval Academy > 410-293-6822 > [email protected] > http://www.usna.edu/Users/cs/adina/ > > > > > -- > > *Amila Wijayarathna* > Undergraduate, > Faculty of Information Technology, > University of Moratuwa, > Sri Lanka. > > > > > -- > > *Amila Wijayarathna* > Undergraduate, > Faculty of Information Technology, > University of Moratuwa, > Sri Lanka. > > > -- *Amila Wijayarathna* Undergraduate, Faculty of Information Technology, University of Moratuwa, Sri Lanka.
