Evaluation metric - NLIDB

From: (wrong string) åkan Lane <hlane_at_surf.its.bond.edu.au>
Date: Tue, 19 Jun 2001 16:34:29 +1000
Message-ID: <3B2EF275.B9C_at_surf.its.bond.edu.au>


I am a part of a university research project on Natural Language Interface to Databases (NLIDB:s). As a part of this research, we will trying to establish some kind of metric measuring how well different techniques and/or contemporary applications extract information from a given database.

Please bear in mind that I'm still a novice in this area.

  • Are there any current contemporary "universal" statistics for this purpose, such as recall, rejection rate, etc.?
  • How are they exactly defined?
  • Where can I find resources on this topic?
  • What are the metrics in conventional DBMS:s?

Help much appreciated.

Regards,

Hakan Lane
Email:hlane_at_surf.its.bond.edu.au Received on Tue Jun 19 2001 - 08:34:29 CEST

Original text of this message