Can we calculate validation loss of the model saved by dietclassifier?

Rasa Open Source
1

rasa_version: 2.8.3 python_version: 3.8.0 Is there any way to calculate validation loss of a already saved model with our own validation set? Below is the config.yml file used:

language: en

pipeline:

  • name: WhitespaceTokenizer
  • name: RegexFeaturizer
  • name: LexicalSyntacticFeaturizer
  • name: CountVectorsFeaturizer
  • name: CountVectorsFeaturizer analyzer: char_wb min_ngram: 1 max_ngram: 4
  • name: DIETClassifier epochs: 300 evaluate_on_number_of_examples: 40 evaluate_every_number_of_epochs: 5 tensorboard_log_directory: “tensorboard” tensorboard_log_level: “epoch” checkpoint_model: true constrain_similarities: true
  • name: EntitySynonymMapper
  • name: ResponseSelector epochs: 300 evaluate_on_number_of_examples: 40 evaluate_every_number_of_epochs: 5 tensorboard_log_directory: “tensorboard” tensorboard_log_level: “epoch” checkpoint_model: true constrain_similarities: true

policies:

  • name: MemoizationPolicy
  • name: TEDPolicy max_history: 5 epochs: 300 evaluate_on_number_of_examples: 40 evaluate_every_number_of_epochs: 5 tensorboard_log_directory: “tensorboard” tensorboard_log_level: “epoch” constrain_similarities: true
  • name: RulePolicy