[Ltg] LTG Seminar [Tuomo Kakkonen, 2008-02-25, E6A 202,11am]

[Marc Tilbrook]

----
   LTG Seminar
    - see: http://www.clt.mq.edu.au/Events/Seminars.html

    Monday, 10th March, 2008, 11am
    Macquarie University, E6A, Room 202
----

----
NOTE: the new venue is the Access Grid room in E6A202
----

Title: Evaluation of Syntactic Parsers: a Framework and Set of Linguistic
Resources
Speaker: Tuomo Kakkonen

Because of the wide variety of contemporary practices used in the automatic
syntactic parsing of natural languages, it has become necessary to analyze
and evaluate the strengths and weaknesses of different approaches. Parser
evaluation is all the more necessary because there are currently no genre-
and domain-independent parsers that are able to analyze unrestricted text
with 100% preciseness. All these factors create a need for methods and
resources that can be used to evaluate and compare parsing systems.

This presentation describes a research consisting of: (1) A theoretical
analysis of current achievements in parsing and parser evaluation. (2) A
framework (called FEPa) that can be used to carry out practical parser
evaluations and comparisons. (3) A set of new evaluation resources: FiEval
is a Finnish treebank under construction, and MGTS and RobSet are parser
evaluation resources in English. (4) The results of experiments in which the
developed evaluation framework and the two resources for English were used
for evaluating a set of selected parsers.