Questions for all the presentations:

1. Is this technique/method/approach in use or ready to be used immediately? What must be done to begin to use it for "real" systems of interest?

2. How well does the technique/method/approach apply to domains and communities outside it's original area?

Presentation-specific:

Pottenger & Ortega

1. How is a "validator" validated?

2. Where can we find good "gold standards"? What characteristics should we look for in a "reference collection"?

3. Are these validation methods similar at some fundamental level? Can we concieve of a general comparison/validation methodology?

Thomas, Powell, Kantor, and Fox:

1. Many digital library systems create qualitatively new capabilities and user experiences. Do we need entirely new metrics, or can we use existing techniques in new ways?

2. How can a variety of metrics, at different "levels" of the system be combined?

3. These four talks discuss the combination of multiple metrics, measuring the DL at a number of "levels". Are these approaches consistent and similar at some fundamental level?