SrlEvalScorer(self, srl_eval_path:str='/local/deploy/agent2/work/8feb324ce7c68d53/allennlp/tools/srl-eval.pl', ignore_classes:List[str]=None) -> None
This class uses the external srl-eval.pl script for computing the CoNLL SRL metrics.
AllenNLP contains the srl-eval.pl script, but you will need perl 5.x.
Note that this metric reads and writes from disk quite a bit. In particular, it writes and subsequently reads two files per call, which is typically invoked once per batch. You probably don't want to include it in your training loop; instead, you should calculate this on a validation set only.
- srl_eval_path :
str, optional. The path to the srl-eval.pl script.
- ignore_classes :
List[str], optional (default=
None). A list of classes to ignore.
A Dict per label containing following the span based metrics:
overall key is included, which provides the precision,
recall and f1-measure for all spans.