Evaluation metric - NLIDB

I am a part of a university research project on Natural Language Interface to Databases (NLIDB:s). As a part of this research, we will trying to establish some kind of metric measuring how well different techniques and/or contemporary applications extract information from a given database.

Please bear in mind that I'm still a novice in this area.

• Are there any current contemporary "universal" statistics for this purpose, such as recall, rejection rate, etc.?
• How are they exactly defined?
• Where can I find resources on this topic?
• What are the metrics in conventional DBMS:s?

Help much appreciated.

Regards,

Hakan Lane
Email:hlane_at_surf.its.bond.edu.au Received on Tue Jun 19 2001 - 01:34:29 CDT