Not what you were looking for? Maybe you have been searching for Stanford's EON project, which creates components for medical decision support systems.
Here you will find the other EON workshops: EON2006, EON2003, and EON2002
Objectives Top
In the Evaluation of Ontology-based Tools workshop we intend to bring together researchers and practitioners from the fastly developing research areas Ontologies and Semantic Web. Currently the semantic web attracts researchers from all around the world. Numerous tools and applications of semantic web technologies are already available and the number is growing fast. However, deploying large scale ontology solutions typically involves several separate tasks and requires applying multiple tools. Therefore pragmatic issues such as interoperability are key if industry is to be encouraged to take up ontology technology rapidly. The main aim of this workshop is therefore to encourage and stimulate discussions about the evaluation of ontology-based tools.
The large visibility of the semantic web, its tools and applications already attract industrial partners. In particular, as tools move from academic institutions into commercial environments they have to fulfil stronger requirements and in some cases new requirements (e.g. concerning scalability and multi-user access). Different tools from different sources need to interoperate. Typically tools are not anymore standalone solutions but integrated into a framework. This framework must be open to other commercial applications and provide connectors and interfaces to industrial standards. Larger applications need also larger ontologies and therefore require substantially more performance and scalability.
A systematic evaluation of the tools might lead to a consistent level of quality and thus acceptance by industry. For the future this might lead into certification efforts for such tools.
This event is supported by
Program & Experiment Top
The agenda of the workshop is available here!
For this workshop we propose to experiment on ontology alignment. The experimental setting is available here: http://co4.inrialpes.fr/align/Contest/
The EON Ontology Alignment Contest will target the characterization of alignment methods with regard to particular ontology features. This contest aims at defining a proper set of benchmark tests for assessing feature-related behavior.
The goal of the EON Ontology Alignment Contest is to provide the participants with a complete test base, including pairs of ontologies to align as well as expected results. The test is based on one particular ontology dedicated to a very narrow domain and a number of alternative ontologies of the same domain for which alignments are provided. The ontologies are provided in OWL. The expected alignments are provided in a standard format expressed in RDF/XML. From these alignments and the ontology to compare, the competitors are able to compute a number of measures on their results. They can use the ontology provided here for giving their results.
The contest is open to anyone able to provide a paper following some simple guidelines with results to these tests. The goal of the benchmark is to assess the respective merits of some algorithms with respect to precise situations; it is not to single out one winner.
Please note +++ Please note +++ Please note
In the original set of ontologies there were some non-valid RDF/OWL
definitions that made them hard to deal with with the use of common parsers (e.g., Jena).
Natasha Noy has contributed this zip file where she has made some corrections to those
files so that they can be correctly read. You may decide whether using the original
set of ontologies or this one
Topics of Interest Top
Topics of interest include but are not limited to:
- Interoperability of tools
- Integration of tools into frameworks
- Performance benchmarks
- Scalability of tools
- Certification of tools
- Annotation tools
- Inference engines
- Ontology editors and browsers
- Ontology servers
- Ontology mapping tools
- Repositories
- Retrieval tools
- Semantic search engines
Previous Workshops Top
The second workshop on Evaluation of Ontology-based Tools (EON2003) was celebrated in conjunction with the 2nd International Semantic Web Conference (ISWC2003) on October 20th 2003 in Sanibel Island, Florida, US.
The first workshop on Evaluation of Ontology-based Tools (EON2002) was celebrated in conjunction with the 13th International Conference on Knowledge Engineering and Knowledge Management (EKAW2002), in September 30th, 2002.
Both workshops attracted a large number of researchers and practitioners of ontology-based tools (each time over 25 participants).
Workshop Organising Committee Top
- York Sure (contact person and EON series inventor), Institute AIFB at University of Karlsruhe (DE)
- Oscar Corcho, Intelligent Software Components, S.A. (ES)
- Jérôme Euzenat, INRIA (FR)
- Todd Hughes, Lockheed Martin
(US)
Program Committee Top
- Dean Allemang, TopQuadrant, Inc. (US), dallemang_@_topquadrant.com
- Bill Andersen, Ontology Works, Inc. (US), andersen_@_ontologyworks.com
- Sean Bechhofer, University of Manchester (UK), seanb_@_cs.man.ac.uk
- Richard Benjamins, Intelligent Software Components, S.A. (ES), rbenjamins_@_isoco.com
- John Davies, BT (UK), john.nj.davies_@_bt.com
- AnHai Doan, University of Illinois (US), anhai_@_cs.uiuc.edu
- Christian Fillies, SemTalk (DE), cfillies_@_semtalk.com
- Fausto Giunchiglia, University of Trento (IT), fausto_@_dit.unitn.it
- Asunción Gómez-Pérez, Universidad Politécnica de Madrid (ES), asun_@_fi.upm.es
- Kouji Kozaki, Osaka University (JP), kozaki_@_ei.sanken.osaka-u.ac.jp
- Natasha F. Noy, Stanford University (US), noy_@_smi.stanford.edu
- Henrik Oppermann, Ontoprise (DE), oppermann_@_ontoprise.de
- Norman Sadeh, Carnegie Mellon University (US), sadeh_@_cs.cmu.edu
- Heiner Stuckenschmidt, Vrije Universiteit Amsterdam (NL), heiner_@_cs.vu.nl
- Rudi Studer, University of Karlsruhe (DE), studer_@_aifb.uni-karlsruhe.de
- Raphael Troncy, INA (France), for Institute National of Audiovisual, Raphael.Troncy_@_ina.fr
- Mike Uschold, Boeing (US), michael.f.uschold_@_boeing.com
- Takahira Yamaguchi, Keio University (JP), yamaguti_@_ae.keio.ac.jp
Submission and Proceedings Top
We invite three types of submissions for this workshop:
- Technical papers in any of the topics of interest of the workshop (but not limited to them)
- Short position papers in any of the topics of interest of the workshop (but not limited to them)
- Papers describing the results of the experiment proposed
Technical and short position papers will be peer-reviewed and selected on the basis of these reviews. Accepted papers will be presented at the workshop. The workshop will be divided in two main parts: (1) presentations of technical and short position papers, followed by discussions, and (2) presentations of the results of the experiment proposed, also followed by discussions. In order to obtain an intensive exchange of ideas between the participants, there will be left extensive time for discussion following each presentation. A final panel will discuss the research agenda for the coming years and predicted development trends to serve industrial requirements.
We explicitly encourage people to make demos of their tools.
Format requirements for submissions of papers are:
- Technical papers: Maximum 10 pages, excluding title page and bibliography .
- Short position papers: maximum 2 pages, excluding title page and bibliography.
- Experiment description papers: maximum 10 pages, excluding title page and bibliography. These submissions must follow the table of contents specified here.
Although not required for the initial submission, we recommend to follow the format guidelines of ISWC 2004 (Springer LNCS), as this will be the required format for accepted papers (cf. http://www.springer.de/comp/lncs/authors.html). We will publish the workshop proceedings online at CEUR-WS.
Important Dates Top
- First call for papers: May 28th, 2004
- Extended deadline for paper submissions: July 28th, 2004 (technical and short position papers)
- Extended notification of acceptance: September 7th, 2004
- Deadline for ontology alignment experiment paper submissions: September 15th
- Camera ready deadline: October 1st, 2004 (all papers)
- Workshop: November 8th, 2004
Please do not hesitate to contact York Sure for any questions you have!