Questions for all the presentations:
1. Is this technique/method/approach in use or ready to be used immediately? What must be done to begin to use it for "real" systems of interest?
2. How well does the technique/method/approach apply to domains and communities outside it's original area?
Presentation-specific:
Pottenger & Ortega
1. How is a "validator" validated?
2. Where can we find good "gold standards"? What characteristics should we look for in a "reference collection"?
3. Are these validation methods similar at some fundamental level? Can we concieve of a general comparison/validation methodology?
Thomas, Powell, Kantor, and Fox:
1. Many digital library systems create qualitatively new capabilities and user experiences. Do we need entirely new metrics, or can we use existing techniques in new ways?
2. How can a variety of metrics, at different "levels" of the system be combined?
3. These four talks discuss the combination of multiple metrics, measuring the DL at a number of "levels". Are these approaches consistent and similar at some fundamental level?