Fourth DELOS Workshop
general_inf.gif (4017 bytes) programme.gif (4014 bytes) venue.gif (3957 bytes)
presentations.gif (4077 bytes) cfp.gif (3472 bytes) Accomodation.gif (4044 bytes)
participants.gif (4057 bytes) links.gif (3942 bytes)

Call for Workshop Papers

 

DELOS Workshop
on
Evaluation of digital libraries: Testbeds, measurements, and metrics

6-7 June 2002, MTA SZTAKI, Budapest, Hungary

Workshop web-page: http://www.sztaki.hu/conferences/deval/

Digital libraries can be viewed from a number of perspectives. They can be new forms of information institutions, multimedia information retrieval systems, or information systems that support the creation, use, and searching of digital content. Digital libraries are not an end in themselves; rather, they are enabling technologies for digital asset management, electronic commerce, electronic publishing, teaching and learning, and other activities. Accordingly, digital libraries need to be evaluated in the context of specific applications. The methods and metrics for evaluating digital libraries will vary by whether they are viewed as institutions, as information systems, as new technologies, or as new services.

The DL research communities need large test beds in order to be able to evaluate and demonstrate new concepts. Research results are most valuable when they are compared with other approaches and validated against many sets of data. Considering users, collections and systems as the major components of a digital library, evaluations may involve only a subset of these components. Besides the evaluation context, the underlying criteria have to be specified. Also, for comparing different evaluations, specification of the test material employed is essential. Since there are no standard description schemes yet and only little work has been done in this area so far, papers on ongoing research are especially invited.

We invite papers for the workshop that focus on generalizable metrics or that focus on methods and measures specific to individual digital library contexts. These include, but are not limited to, education, publishing, cultural heritage, science and technology, medicine, sound, and images.

Context-specific evaluation methods should provide background on the application, explanations of how and why evaluation is tailored, and the expected use of results (e.g., to improve learning, improve retrieval, improve navigation facilities).

Papers may also indicate how their approaches might be adapted to other contexts. We especially invite evaluation papers that address organizational contexts or that address digital libraries for creation and use of content, as well as for information retrieval.

Thus, this workshop should bring together researchers from different fields, such as libraries, publishers, computer science, content providers, user communities, and others, in order to exchange their ideas about DL evaluation.

INVITED SPEAKERS

The program will include 3-4 invited speakers. This will be posted on the Workshop's web-page (http://www.sztaki.hu/conferences/deval/programme.html).

TRAVEL SUPPORT

There is a possibility that the Delos Workshop can give some travel support to active Workshop participants (i.e. speakers). More info will be posted on the web-page (http://www.sztaki.hu/conferences/deval/accomodation.html).

IMPORTANT DATES:

April 15:    Initial submission of 5-page abstract in PDF format
May 1:    Notification of acceptance
May 24:    Final cameraready copy (in PDF format) for the workshop proceeding
June 6-7:    Workshop.

PAPER SUBMISSIONS:

Authors are invited to submit their contributions in the form of extended abstracts of their papers or position papers in PDF format by April 15. Final papers should not exceed 7 pages. All contributions should be submitted electronically to: submission@dsd.sztaki.hu

Accepted papers will be published by the ERCIM.

WORKSHOP ORGANIZERS:

General Chair:

Dr. László KOVÁCS

Head of Department of Distributed Systems
MTA SZTAKI,
Computer and Automation Research Institute of the Hungarian Academy of Sciences
H-1111 Budapest XI. Lágymányosi u. 11. Room 312 HUNGARY
Phone: (361) 209-5286 Fax: (361) 209-5288 E-mail: laszlo.kovacs@sztaki.hu
http://www.sztaki.hu/dsd/kovacs.html

Program Co-Chairs:

Christine L. Borgman

Professor and Presidential Chair in Information Studies
Department of Information Studies, Graduate School of Education and Information Studies,
235 GSE&IS Bldg, Box 951520
University of California, Los Angeles
Los Angeles, CA 90095-1520
Phone: (310) 825-6164; Fax: (310) 206-4460 Email: cborgman@ucla.edu
http://is.gseis.ucla.edu/cborgman/

Ingeborg Torvik Sřlvberg

Professor in Information Management
The Norwegian University of Science and Technology, Department of Computer and Information Science,
7491 Trondheim, Norway
Phone: +47 73596027; Fax: +47 73594466; Email: ingeborg.solvberg@idi.ntnu.no
http://www.idi.ntnu.no/~solvberg/

 

 Jump to top of page delos-logo.jpg (6899 bytes)