Apologies if you receive multiple copies of this CFP.
------------------------------------------------------------------------------
CALL FOR EVALUATION PAPERS
ISWC 2013
The 12th International Semantic Web Conference
21-15 October 2013, Sydney, Australia
http://iswc2013.semanticweb.org/
------------------------------------------------------------------------------
The Semantic Web and Linked Open Data has been an active area of research for
several years. For the second time, the 12th edition of the International
Semantic Web conference runs the Evaluation Track. Its goal is to consolidate
research material and to gain new scientific insights and results by providing
a place for in-depth experimental studies of significant scale. It aims at
promoting experimental evaluations in Semantic Web/Linked Open Data research
trying to create a research cycle between theory and experiments as in other
sciences (e.g., physics).
A typical Evaluation paper has set its focus on the verification of an existing
method by applying it to a specific task, and reporting the outcome of an
experiment on an established or new dataset. Papers that propose new algorithms
and architectures should continue to be submitted to the regular research
track. Besides quantitative evaluation (i.e. Accuracy, Precision, Speed or
similar measures), a qualitative error analysis should be included that
discusses cases where the method succeeds and fails.
Papers in this track can fit in different categories:
* Comparative evaluation studies comparing a spectrum of approaches to a
particular problem and, through extensive experiments, providing a
comprehensive perspective on the underlying phenomena or approaches.
* Analyses of experimental results providing insights on the nature or
characteristics of studied phenomena, including negative results.
* Result verification focusing on verifying or refuting published results and,
through the renewed analysis, help to advance the state of the art.
* Benchmarking, focusing on datasets and algorithms for comprehensible and
systematic evaluation of existing and future systems.
* Development of new evaluation methodologies, and their demonstration in an
experimental study
Public availability of experimental datasets is highly encouraged.
In addition, these papers will be more specifically judged on the basis of
their:
* Precise description of controlled experimental conditions
* Reproducibility
* Applicability range (broad coverage results being better than narrow
applicability).
* Validity of the evaluation methodology (size of dataset, significance tests,
..)
Special attention will be paid to reproducibility. Hence, experimental settings
will have to be extensively described so that the results could be
independently reproduced, so that counter-experiments could be designed and
subsequent work is enabled to improve over the presented results.
The experimental approach is based on systematic scientific methods used in
many disciplines. The page http://explorable.com provides a good collection of
methods, experiment design strategies, and resources.
Topics of Interests
For a list of topic of interests please visit the Call for Research Papers at
http://iswc2013.semanticweb.org/content/call-research-papers.
Submission
Pre-submission of abstracts is a strict requirement. All papers and abstracts
have to be submitted electronically via the EasyChair conference submission
system https://www.easychair.org/conferences/?conf=iswc2013.
All research submissions must be in English, and no longer than 16 pages.
Papers that exceed this limit will be rejected without review. Submissions must
be in PDF formatted in the style of the Springer Publications format for
Lecture Notes in Computer Science (LNCS). For details on the LNCS style, see
Springer’s Author Instructions. ISWC-2013 submissions are not anonymous.
Authors of accepted papers will be required to provide semantic annotations for
the abstract of their submission, which will be made available on the
conference web site. Details will be provided at the time of acceptance.
Accepted papers will be distributed to conference attendees and also published
by Springer in the printed conference proceedings, as part of the Lecture Notes
in Computer Science series. At least one author of each accepted paper must
register for the conference and present the paper there.
Prior Publication And Multiple Submissions
ISWC 2013 will not accept research papers that, at the time of submission, are
under review for or have already been published in or accepted for publication
in a journal or another conference. The conference organizers may share
information on submissions with other venues to ensure that this rule is not
violated.
Important Dates (same as Research Track)
* Abstracts: May 1, 201311:59pm Hawaii time
* Full Paper Submission: May 10, 2013, 11:59pm Hawaii time
* Author Rebuttals: June 17-19, 2013
* Notifications: July 3, 2013
* Camera-Ready Versions: August 5, 2013
* Conference: October 21-25, 2013
No extensions of the submission deadline will be granted.
Evaluation Track Chairs
* Chris Biemann, Technische Universität Darmstadt, Germany
* Josiane Xavier Parreira, DERI - National University of Galway, Ireland
http://iswc2013.semanticweb.org/content/call-evaluation-papers
