allennlp.commands.evaluateΒΆ

The evaluate subcommand can be used to evaluate a trained model against a dataset and report any metrics calculated by the model.

$ allennlp evaluate --help
usage: allennlp [command] evaluate [-h] --evaluation-data-file
                                        EVALUATION_DATA_FILE
                                        [--cuda-device CUDA_DEVICE]
                                        [-o OVERRIDES]
                                        [--include-package INCLUDE_PACKAGE]
                                        archive_file

Evaluate the specified model + dataset

positional arguments:
archive_file          path to an archived trained model

optional arguments:
-h, --help            show this help message and exit
--evaluation-data-file EVALUATION_DATA_FILE
                        path to the file containing the evaluation data
--cuda-device CUDA_DEVICE
                        id of GPU to use (if any)
-o OVERRIDES, --overrides OVERRIDES
                        a HOCON structure used to override the experiment
                        configuration
--include-package INCLUDE_PACKAGE
                        additional packages to include