On 23 March 2013 07:05, gaurav pant <[email protected]> wrote: > Hi All, > > I am now using new code. But facing below problems with the new repository. > > @Jona- Yes I am using Amazon Elastic Block Storage. Is there any issue with > this?
Not really, but... I don't know much about EBS, but I assume it's basically a network file system. I would recommend putting only the downloaded dumps on EBS and everything else (source code and binaries for Java, Maven, DBpedia, Apache, MySQL, MediaWiki, and MySQL database files) on the local hard drive. Should improve performance and stability. That Maven couldn't delete /mnt/ebs/perl/framework/dbpedia/target/classes is strange and may have to do with that folder living on a different system. > > @All- I could not be able to understand that where I should give "mysql > user-name" and password.Also I want that it should use fresh blank database > specified by me. > > I have changed my importer configuration at pom.xml file as below > > > <launcher> > <id>import</id> > > <mainClass>org.dbpedia.extraction.dump.sql.Import</mainClass> > <jvmArgs> > <jvmArg>-server</jvmArg> > </jvmArgs> > <args> > <arg>/mnt/ebs/framework/test_dump</arg> > > <arg>/mnt/ebs/framework/media_wiki/wikimedia/maintenance/tables.sql</arg> > <arg>localhost</arg><!-- MySQL host:port > no user name & password--> > <arg>false</arg><!-- > require-download-complete --> > <arg>en</arg><!-- languages and article > count ranges, comma-separated --> > </args> > </launcher> > > Thanks for all the suggestions. > > > On Wed, Mar 20, 2013 at 8:08 PM, Dimitris Kontokostas <[email protected]> > wrote: >> >> I also think that this is a maven / folder permissions like JC and Andrea >> suggested. >> The script breaks at $mvn clean >> so you should check your system >> >> Dimitris >> >> >> On Wed, Mar 20, 2013 at 4:32 PM, Jona Christopher Sahnwaldt >> <[email protected]> wrote: >>> >>> Yes, this is almost certainly a problem with file/folder permissions. >>> >>> >From looking at your path /mnt/ebs/, I assume you're using Amazon >>> Elastic Block Storage. Is that correct? >>> >>> On Wed, Mar 20, 2013 at 11:48 AM, Andrea Di Menna <[email protected]> >>> wrote: >>> > Hi Gaurav, >>> > >>> > which are the permissions this folder? >>> > >>> > /mnt/ebs/perl/framework/dbpedia/target/classes >>> > >>> > Maybe not related, but the error message seems to suggest maven cannot >>> > clean >>> > that directory. >>> > >>> > Also, it might be useful to rerun the maven command with -eX switches. >>> > >>> > Regards >>> > Andrea >>> > >>> > 2013/3/20 gaurav pant <[email protected]> >>> >> >>> >> Hi Morsey/All, >>> >> >>> >> Please find pom.xml file contents as below. >>> >> >>> >> " >>> >> <?xml version="1.0" encoding="UTF-8"?> >>> >> <project xmlns="http://maven.apache.org/POM/4.0.0";> >>> >> >>> >> <modelVersion>4.0.0</modelVersion> >>> >> >>> >> <parent> >>> >> <groupId>org.dbpedia</groupId> >>> >> <artifactId>extraction</artifactId> >>> >> <version>3.8</version> >>> >> </parent> >>> >> >>> >> <groupId>org.dbpedia.extraction</groupId> >>> >> <artifactId>dump</artifactId><?xml version="1.0" >>> >> encoding="UTF-8"?> >>> >> <project xmlns="http://maven.apache.org/POM/4.0.0";> >>> >> >>> >> <modelVersion>4.0.0</modelVersion> >>> >> >>> >> <parent> >>> >> <groupId>org.dbpedia</groupId> >>> >> <artifactId>extraction</artifactId> >>> >> <version>3.8</version> >>> >> </parent> >>> >> >>> >> <groupId>org.dbpedia.extraction</groupId> >>> >> <artifactId>dump</artifactId> >>> >> <name>DBpedia Dump Extraction</name> >>> >> >>> >> <build> >>> >> <plugins> >>> >> <plugin> >>> >> >>> >> <groupId>org.scala-tools</groupId> >>> >> <artifactId>maven-scala-plugin</artifactId> >>> >> >>> >> <configuration> >>> >> <launchers> >>> >> >>> >> <launcher> >>> >> <id>import</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.sql.Import</mainClass> >>> >> <jvmArgs> >>> >> <jvmArg>-server</jvmArg> >>> >> </jvmArgs> >>> >> <args> >>> >> >>> >> <arg>/mnt/ebs3/dbpedia_other_lang_dump/trimmed</arg> >>> >> >>> >> >>> >> >>> >> <arg>/mnt/ebs/perl/framework/media_wiki/wikimedia/maintenance/tables.sql</arg> >>> >> <arg>localhost</arg><!-- MySQL >>> >> host:port >>> >> --> >>> >> <arg>true</arg><!-- >>> >> require-download-complete --> >>> >> >>> >> <arg>de</arg><!-- languages and >>> >> article >>> >> count ranges, comma-separated --> >>> >> </args> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>extraction</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.extract.Extraction</mainClass> >>> >> <jvmArgs> >>> >> <jvmArg>-server</jvmArg> >>> >> <jvmArg>-Xmx1024m</jvmArg> >>> >> </jvmArgs> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>compress</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.compress.Compress</mainClass> >>> >> <jvmArgs> >>> >> <jvmArg>-Xmx1024m</jvmArg> >>> >> </jvmArgs> >>> >> <!-- mvn scala:run -Dlauncher=Compress >>> >> "-DaddArgs=/data|/data-compressed" --> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>download</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.download.Download</mainClass> >>> >> <!-- ../run download >>> >> config=download.properties --> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>purge-download</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.clean.Clean</mainClass> >>> >> <args> >>> >> <arg>/home/release/wikipedia</arg> >>> >> <arg>download-complete</arg> >>> >> <arg>1</arg><!-- keep only one latest >>> >> download --> >>> >> >>> >> >>> >> <arg>*.sql.gz,*.xml.bz2,*.sql,*-pages-articles.xml,index.html</arg><!-- >>> >> delete these files --> >>> >> </args> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>purge-extraction</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.clean.Clean</mainClass> >>> >> <args> >>> >> <arg>/home/release/wikipedia</arg> >>> >> <arg>extraction-complete</arg> >>> >> <arg>2</arg><!-- keep two extractions >>> >> --> >>> >> >>> >> <arg>*.nt,*.nq,*.tql,*.ttl,*.trix,*-redirects.obj</arg><!-- delete >>> >> these >>> >> files --> >>> >> </args> >>> >> </launcher> >>> >> >>> >> </launchers> >>> >> </configuration> >>> >> >>> >> </plugin> >>> >> </plugins> >>> >> </build> >>> >> >>> >> <dependencies> >>> >> >>> >> <dependency> >>> >> <groupId>org.dbpedia.extraction</groupId> >>> >> <artifactId>core</artifactId> >>> >> </dependency> >>> >> >>> >> <dependency> >>> >> <groupId>org.apache.commons</groupId> >>> >> <artifactId>commons-compress</artifactId> >>> >> </dependency> >>> >> >>> >> <dependency> >>> >> <groupId>mysql</groupId> >>> >> <artifactId>mysql-connector-java</artifactId> >>> >> <version>5.1.20</version> >>> >> </dependency> >>> >> >>> >> </dependencies> >>> >> >>> >> </project> >>> >> >>> >> <name>DBpedia Dump Extraction</name> >>> >> >>> >> <build> >>> >> <plugins> >>> >> <plugin> >>> >> >>> >> <groupId>org.scala-tools</groupId> >>> >> <artifactId>maven-scala-plugin</artifactId> >>> >> >>> >> <configuration> >>> >> <launchers> >>> >> >>> >> <launcher> >>> >> <id>import</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.sql.Import</mainClass> >>> >> <jvmArgs> >>> >> <jvmArg>-server</jvmArg> >>> >> </jvmArgs> >>> >> <args> >>> >> >>> >> <arg>/mnt/ebs3/dbpedia_other_lang_dump/trimmed</arg> >>> >> >>> >> >>> >> >>> >> <arg>/mnt/ebs/perl/framework/media_wiki/wikimedia/maintenance/tables.sql</arg> >>> >> <arg>localhost</arg><!-- MySQL >>> >> host:port >>> >> --> >>> >> <arg>true</arg><!-- >>> >> require-download-complete --> >>> >> >>> >> <arg>de</arg><!-- languages and >>> >> article >>> >> count ranges, comma-separated --> >>> >> </args> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>extraction</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.extract.Extraction</mainClass> >>> >> <jvmArgs> >>> >> <jvmArg>-server</jvmArg> >>> >> <jvmArg>-Xmx1024m</jvmArg> >>> >> </jvmArgs> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>compress</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.compress.Compress</mainClass> >>> >> <jvmArgs> >>> >> <jvmArg>-Xmx1024m</jvmArg> >>> >> </jvmArgs> >>> >> <!-- mvn scala:run -Dlauncher=Compress >>> >> "-DaddArgs=/data|/data-compressed" --> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>download</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.download.Download</mainClass> >>> >> <!-- ../run download >>> >> config=download.properties --> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>purge-download</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.clean.Clean</mainClass> >>> >> <args> >>> >> <arg>/home/release/wikipedia</arg> >>> >> <arg>download-complete</arg> >>> >> <arg>1</arg><!-- keep only one latest >>> >> download --> >>> >> >>> >> >>> >> <arg>*.sql.gz,*.xml.bz2,*.sql,*-pages-articles.xml,index.html</arg><!-- >>> >> delete these files --> >>> >> </args> >>> >> </launcher> >>> >> >>> >> <launcher> >>> >> <id>purge-extraction</id> >>> >> >>> >> <mainClass>org.dbpedia.extraction.dump.clean.Clean</mainClass> >>> >> <args> >>> >> <arg>/home/release/wikipedia</arg> >>> >> <arg>extraction-complete</arg> >>> >> <arg>2</arg><!-- keep two extractions >>> >> --> >>> >> >>> >> <arg>*.nt,*.nq,*.tql,*.ttl,*.trix,*-redirects.obj</arg><!-- delete >>> >> these >>> >> files --> >>> >> </args> >>> >> </launcher> >>> >> >>> >> </launchers> >>> >> </configuration> >>> >> >>> >> </plugin> >>> >> </plugins> >>> >> </build> >>> >> >>> >> <dependencies> >>> >> >>> >> <dependency> >>> >> <groupId>org.dbpedia.extraction</groupId> >>> >> <artifactId>core</artifactId> >>> >> </dependency> >>> >> >>> >> <dependency> >>> >> <groupId>org.apache.commons</groupId> >>> >> <artifactId>commons-compress</artifactId> >>> >> </dependency> >>> >> >>> >> <dependency> >>> >> <groupId>mysql</groupId> >>> >> <artifactId>mysql-connector-java</artifactId> >>> >> <version>5.1.20</version> >>> >> </dependency> >>> >> >>> >> </dependencies> >>> >> >>> >> </project> >>> >> >>> >> " >>> >> >>> >> On Wed, Mar 20, 2013 at 3:44 PM, Mohamed Morsey >>> >> <[email protected]> wrote: >>> >>> >>> >>> Hi Gaurav, >>> >>> >>> >>> would you please send us the full pom file? >>> >>> >>> >>> >>> >>> On 03/20/2013 11:01 AM, gaurav pant wrote: >>> >>> >>> >>> Hi, >>> >>> >>> >>> I am trying to extract cleaner abstracts using >>> >>> git://github.com/dbpedia/extraction-framework.git. >>> >>> >>> >>> I have configured pom.xml inside dump directory as below. >>> >>> >>> >>> <arg>/mnt/ebs3/dbpedia_other_lang_dump/trimmed</arg> <!-- file >>> >>> where my page-article.cump exists --> >>> >>> >>> >>> >>> >>> <arg>/mnt/ebs/perl/framework/media_wiki/wikimedia/maintenance/tables.sql</arg> >>> >>> <arg>localhost</arg><!-- MySQL >>> >>> host:port >>> >>> --> >>> >>> <arg>false</arg><!-- not >>> >>> require-download-complete; as downloaded manually --> >>> >>> <arg>de</arg><!-- languages and >>> >>> article >>> >>> count ranges, comma-separated --> >>> >>> >>> >>> >>> >>> Then I ran command "../clean-install-run import". I got below error. >>> >>> " >>> >>> $sh ../clean-install-run import >>> >>> [INFO] Scanning for projects... >>> >>> [INFO] >>> >>> >>> >>> ------------------------------------------------------------------------ >>> >>> [INFO] Reactor Build Order: >>> >>> [INFO] >>> >>> [INFO] Parent POM of the DBpedia framework >>> >>> [INFO] DBpedia Core Libraries >>> >>> [INFO] DBpedia Server >>> >>> [INFO] DBpedia Dump Extraction >>> >>> [INFO] DBpedia Scripts >>> >>> [INFO] Live extraction >>> >>> [INFO] Wiktionary Dump >>> >>> [INFO] >>> >>> [INFO] >>> >>> >>> >>> ------------------------------------------------------------------------ >>> >>> [INFO] Building Parent POM of the DBpedia framework 3.8 >>> >>> [INFO] >>> >>> >>> >>> ------------------------------------------------------------------------ >>> >>> [INFO] >>> >>> [INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ >>> >>> extraction >>> >>> --- >>> >>> [INFO] Deleting /mnt/ebs/perl/framework/dbpedia/dump/../target >>> >>> [INFO] >>> >>> >>> >>> ------------------------------------------------------------------------ >>> >>> [INFO] Reactor Summary: >>> >>> [INFO] >>> >>> [INFO] Parent POM of the DBpedia framework ............... FAILURE >>> >>> [2.864s] >>> >>> [INFO] DBpedia Core Libraries ............................ SKIPPED >>> >>> [INFO] DBpedia Server .................................... SKIPPED >>> >>> [INFO] DBpedia Dump Extraction ........................... SKIPPED >>> >>> [INFO] DBpedia Scripts ................................... SKIPPED >>> >>> [INFO] Live extraction ................................... SKIPPED >>> >>> [INFO] Wiktionary Dump ................................... SKIPPED >>> >>> [INFO] >>> >>> >>> >>> ------------------------------------------------------------------------ >>> >>> [INFO] BUILD FAILURE >>> >>> [INFO] >>> >>> >>> >>> ------------------------------------------------------------------------ >>> >>> [INFO] Total time: 6.262s >>> >>> [INFO] Finished at: Wed Mar 20 09:39:56 UTC 2013 >>> >>> [INFO] Final Memory: 7M/56M >>> >>> [INFO] >>> >>> >>> >>> ------------------------------------------------------------------------ >>> >>> [ERROR] Failed to execute goal >>> >>> org.apache.maven.plugins:maven-clean-plugin:2.4.1:clean >>> >>> (default-clean) on >>> >>> project extraction: Failed to clean project: Failed to delete >>> >>> /mnt/ebs/perl/framework/dbpedia/target/classes -> [Help 1] >>> >>> [ERROR] >>> >>> [ERROR] To see the full stack trace of the errors, re-run Maven with >>> >>> the >>> >>> -e switch. >>> >>> [ERROR] Re-run Maven using the -X switch to enable full debug >>> >>> logging. >>> >>> [ERROR] >>> >>> [ERROR] For more information about the errors and possible solutions, >>> >>> please read the following articles: >>> >>> [ERROR] [Help 1] >>> >>> >>> >>> http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException >>> >>> >>> >>> " >>> >>> >>> >>> I have below concerns. >>> >>> >>> >>> 1- Which database it will use As I want to create dbf file into >>> >>> different >>> >>> directory everytime due to space constraint? >>> >>> 2- Where to give login credential for database also database name to >>> >>> be >>> >>> used? >>> >>> 3- Also please help me to sort out the error! >>> >>> >>> >>> >>> >>> -- >>> >>> Regards >>> >>> Gaurav Pant >>> >>> +91-7709196607,+91-9405757794 >>> >>> >>> >>> >>> >>> >>> >>> -- >>> >>> Kind Regards >>> >>> Mohamed Morsey >>> >>> Department of Computer Science >>> >>> University of Leipzig >>> >> >>> >> >>> >> >>> >> >>> >> -- >>> >> Regards >>> >> Gaurav Pant >>> >> +91-7709196607,+91-9405757794 >>> >> >>> >> >>> >> >>> >> ------------------------------------------------------------------------------ >>> >> Everyone hates slow websites. So do we. >>> >> Make your web apps faster with AppDynamics >>> >> Download AppDynamics Lite for free today: >>> >> http://p.sf.net/sfu/appdyn_d2d_mar >>> >> _______________________________________________ >>> >> Dbpedia-discussion mailing list >>> >> [email protected] >>> >> https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion >>> >> >>> > >>> > >>> > >>> > ------------------------------------------------------------------------------ >>> > Everyone hates slow websites. So do we. >>> > Make your web apps faster with AppDynamics >>> > Download AppDynamics Lite for free today: >>> > http://p.sf.net/sfu/appdyn_d2d_mar >>> > _______________________________________________ >>> > Dbpedia-discussion mailing list >>> > [email protected] >>> > https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion >>> > >>> >>> >>> ------------------------------------------------------------------------------ >>> Everyone hates slow websites. So do we. >>> Make your web apps faster with AppDynamics >>> Download AppDynamics Lite for free today: >>> http://p.sf.net/sfu/appdyn_d2d_mar >>> _______________________________________________ >>> Dbpedia-discussion mailing list >>> [email protected] >>> https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion >> >> >> >> >> -- >> Kontokostas Dimitris > > > > > -- > Regards > Gaurav Pant > +91-7709196607,+91-9405757794 ------------------------------------------------------------------------------ Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_mar _______________________________________________ Dbpedia-discussion mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/dbpedia-discussion
