[
https://issues.apache.org/jira/browse/MRQL-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13743352#comment-13743352
]
Leonidas Fegaras commented on MRQL-2:
-------------------------------------
I have restructured the code and have written the initial POM files. I have
only worked on installation and verification. It still needs many other
components, such as assembly.
Description:
The maven description is in pom.xml. It uses 4 maven modules: Gen, MapReduce,
BSP, and Spark. Each one has its own pom.xml located under the directory with
the associated name. The Gen module builds the Gen preprocessor (that
translates *.gen files to *.java). The modules MapReduce, BSP, and Spark build
the jar libraries for MRQL evaluation on Hadoop, Hama, and Spark, respectively.
The generated jar files are lib/mrql.jar, lib/mrql-bsp.jar, and
lib/mrql-spark.jar. They are used by the shell scripts bin/mrql, bin/mrql.bsp,
and bin/mrql.spark.
The source files have been moved to src/main/java in 5 subdirectories: gen,
core, MapReduce, BSP, and spark. The core subdirectory contains all the common
source files used by all 3 evaluation modes.
To build MRQL using maven, download:
http://lambda.uta.edu/mrql-maven.tgz
untar it, go to the directory mrql-maven, and do:
mvn package
It will create lib/mrql.jar, lib/mrql-bsp.jar, and lib/mrql-spark.jar.
To validate the installation in all modes (this will take long) do:
mvn verify
The old ant build.xml and Makefile still work under the new code restructuring.
Note that the shell scripts in the bin directory use the vanilla hadoop and
hama scripts, which use different jars from those provided by the maven
installation. This means that the hadoop & Hama dependencies specified in
pom.xml must match your existing hadoop & Hama installation (which is specified
in conf/mrql-conf.sh).
I am attaching the patch MRQL-2.1.patch. I would like to apply it soon so that
we can start using the new code structure as soon as possible. Later we can
modify and expand it. Please let me know by Friday if this patch is acceptable.
> Mavenize MRQL
> -------------
>
> Key: MRQL-2
> URL: https://issues.apache.org/jira/browse/MRQL-2
> Project: MRQL
> Issue Type: Bug
> Reporter: Karthik Kambatla
> Assignee: Karthik Kambatla
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
