I get for the normal mode for core wrong prediction for next action whereas in online training mode I get the right results. I trained my dialogue model with online training but now I get different behaviour?
I use 10.4
Are there any difference I have to take care? I use of course same arguments like epoch etc…
If the KerasPolicy is used to predict these actions, then its predictions can differ from training run to training run
Thanks. Yes, I recognized after each training the behaviour is different. So you have to find the run where all is fine…
But both are using Keras and online predicts everytime correct even if I restart both, the normal mode does not predict correct. But online does. It really seems online is more rigorous…
I recognize that
`Creating states and action examples from collected trackers’ varies also by several 100 each time…
And the action_examples are alway higher with online training. I suppose that this is the reason fopr better prediction.
Might be that the default augmentation_factor is higher or something
Thanks. I set both augmenation factor to 0 and online is really more stable. I get right at the beginning false Keras prediction for normal mode. That is really strange and I don’t know why. I feel I have to train it several times whereas for online I don’t need to train it several times until it works.
When I want to be near of that of stories augmenation of 0 is better, right? Or when is a higher value better? Also for batch size and epoch time?
I send the logs. Maybe you see something. Although augmentation is 0 why are there augmenation rounds?
DEBUG:rasa_core.training.generator:Generated trackers will be deduplicated based on their unique last 4 states.
DEBUG:rasa_core.training.generator:Number of augmentation rounds is 3
DEBUG:rasa_core.training.generator:Starting data generation round 0 ... (with 1 trackers)
Processed Story Blocks: 100%|████████████████████████████████████████████| 85/85 [00:01<00:00, 72.63it/s, # trackers=1]
DEBUG:rasa_core.training.generator:Finished phase (80 training samples found).
DEBUG:rasa_core.training.generator:Data generation rounds finished.
DEBUG:rasa_core.training.generator:Found 0 unused checkpoints
DEBUG:rasa_core.training.generator:Starting augmentation round 0 ... (with 20 trackers)
Processed Story Blocks: 100%|███████████████████████████████████████████| 85/85 [00:12<00:00, 6.65it/s, # trackers=19]
DEBUG:rasa_core.training.generator:Finished phase (1602 training samples found).
DEBUG:rasa_core.training.generator:Starting augmentation round 1 ... (with 20 trackers)
Processed Story Blocks: 100%|███████████████████████████████████████████| 85/85 [00:15<00:00, 5.54it/s, # trackers=17]
DEBUG:rasa_core.training.generator:Finished phase (2961 training samples found).
DEBUG:rasa_core.training.generator:Starting augmentation round 2 ... (with 20 trackers)
Processed Story Blocks: 100%|███████████████████████████████████████████| 85/85 [00:11<00:00, 7.21it/s, # trackers=16]
DEBUG:rasa_core.training.generator:Finished phase (4242 training samples found).
DEBUG:rasa_core.training.generator:Found 4242 training trackers.
DEBUG:rasa_core.agent:Agent trainer got kwargs: {'epochs': 300, 'batch_size': 50, 'augmentation_factor': 50}
INFO:rasa_core.featurizers:Creating states and action examples from collected trackers (by MaxHistoryTrackerFeaturizer)...
Processed trackers: 100%|██████████████████████████████████████████| 4242/4242 [00:52<00:00, 80.05it/s, # actions=4349]
INFO:rasa_core.featurizers:Created 4349 action examples.
_________________________________________________________________
Layer (type) Output Shape Param #
=================================================================
masking_1 (Masking) (None, 4, 148) 0
_________________________________________________________________
lstm_1 (LSTM) (None, 32) 23168
_________________________________________________________________
dense_1 (Dense) (None, 38) 1254
_________________________________________________________________
activation_1 (Activation) (None, 38) 0
=================================================================
Total params: 24,422
Trainable params: 24,422
Non-trainable params: 0
_________________________________________________________________
DEBUG:rasa_core.policies.keras_policy:None
INFO:rasa_core.policies.keras_policy:Fitting model with 4349 total samples and a validation split of 0.0
DEBUG:rasa_core.policies.policy:Parameters ignored by `model.fit(...)`: {'augmentation_factor': 50}
Epoch 1/300
2018-11-07 14:56:22.660417: I T:\src\github\tensorflow\tensorflow\core\platform\cpu_feature_guard.cc:140] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2
4349/4349 [==============================] - 6s 1ms/step - loss: 2.8880 - acc: 0.3058
Epoch 2/300
4349/4349 [==============================] - 3s 652us/step - loss: 2.2302 - acc: 0.3185
Epoch 3/300
4349/4349 [==============================] - 3s 626us/step - loss: 1.9872 - acc: 0.3633
Epoch 4/300
4349/4349 [==============================] - 3s 602us/step - loss: 1.7327 - acc: 0.5105
Epoch 5/300
4349/4349 [==============================] - 3s 598us/step - loss: 1.4964 - acc: 0.5822
Epoch 6/300
4349/4349 [==============================] - 3s 649us/step - loss: 1.2933 - acc: 0.6342
Epoch 7/300
4349/4349 [==============================] - 3s 602us/step - loss: 1.1345 - acc: 0.6666
Epoch 8/300
4349/4349 [==============================] - 2s 549us/step - loss: 1.0112 - acc: 0.7045
Epoch 9/300
4349/4349 [==============================] - 2s 566us/step - loss: 0.8853 - acc: 0.7393
Epoch 10/300
4349/4349 [==============================] - 3s 593us/step - loss: 0.7876 - acc: 0.7774
Epoch 11/300
4349/4349 [==============================] - 3s 696us/step - loss: 0.7077 - acc: 0.8000
Epoch 12/300
4349/4349 [==============================] - 3s 683us/step - loss: 0.6359 - acc: 0.8250
Epoch 13/300
4349/4349 [==============================] - 3s 590us/step - loss: 0.5698 - acc: 0.8478
Epoch 14/300
4349/4349 [==============================] - 3s 597us/step - loss: 0.5152 - acc: 0.8586
Epoch 15/300
4349/4349 [==============================] - 3s 608us/step - loss: 0.4793 - acc: 0.8701
Epoch 16/300
4349/4349 [==============================] - 3s 611us/step - loss: 0.4402 - acc: 0.8823
Epoch 17/300
4349/4349 [==============================] - 3s 592us/step - loss: 0.4054 - acc: 0.8848
Epoch 18/300
4349/4349 [==============================] - 3s 628us/step - loss: 0.3822 - acc: 0.8981
Epoch 19/300
4349/4349 [==============================] - 3s 613us/step - loss: 0.3618 - acc: 0.8991
Epoch 20/300
4349/4349 [==============================] - 3s 649us/step - loss: 0.3442 - acc: 0.9046
Epoch 21/300
4349/4349 [==============================] - 3s 640us/step - loss: 0.3250 - acc: 0.9087
Epoch 22/300
4349/4349 [==============================] - 3s 639us/step - loss: 0.3044 - acc: 0.9131
Epoch 23/300
4349/4349 [==============================] - 3s 691us/step - loss: 0.2967 - acc: 0.9163
Epoch 24/300
4349/4349 [==============================] - 3s 628us/step - loss: 0.2815 - acc: 0.9175
Epoch 25/300
4349/4349 [==============================] - 3s 612us/step - loss: 0.2633 - acc: 0.9262
Epoch 26/300
4349/4349 [==============================] - 3s 638us/step - loss: 0.2626 - acc: 0.9193
Epoch 27/300
4349/4349 [==============================] - 3s 677us/step - loss: 0.2478 - acc: 0.9273
Epoch 28/300
4349/4349 [==============================] - 3s 630us/step - loss: 0.2298 - acc: 0.9372
Epoch 29/300
4349/4349 [==============================] - 3s 683us/step - loss: 0.2253 - acc: 0.9296
Epoch 30/300
4349/4349 [==============================] - 3s 667us/step - loss: 0.2224 - acc: 0.9326
Epoch 31/300
4349/4349 [==============================] - 3s 631us/step - loss: 0.2152 - acc: 0.9393
Epoch 32/300
4349/4349 [==============================] - 2s 565us/step - loss: 0.2236 - acc: 0.9352
Epoch 33/300
4349/4349 [==============================] - 3s 608us/step - loss: 0.1894 - acc: 0.9409
Epoch 34/300
4349/4349 [==============================] - 3s 641us/step - loss: 0.1856 - acc: 0.9437
Epoch 35/300
4349/4349 [==============================] - 3s 618us/step - loss: 0.1907 - acc: 0.9414
Epoch 36/300
4349/4349 [==============================] - 3s 628us/step - loss: 0.1837 - acc: 0.9423
Epoch 37/300
4349/4349 [==============================] - 3s 576us/step - loss: 0.1786 - acc: 0.9416
Epoch 38/300
4349/4349 [==============================] - 3s 601us/step - loss: 0.1754 - acc: 0.9441
Epoch 39/300
4349/4349 [==============================] - 3s 652us/step - loss: 0.1749 - acc: 0.9398
Epoch 40/300
4349/4349 [==============================] - 3s 674us/step - loss: 0.1668 - acc: 0.9460
Epoch 41/300
4349/4349 [==============================] - 4s 848us/step - loss: 0.1550 - acc: 0.9487
Epoch 42/300
4349/4349 [==============================] - 3s 714us/step - loss: 0.1640 - acc: 0.9446
Epoch 43/300
50/4349 [..............................] - ETA: 4s - loss: 0.2477 - acc: 0.8800C:\Users\chris1\Anaconda3\envs\master\lib\site-packages\keras\callbacks.py:120: UserWarning: Method on_batch_end() is slow compared to the batch update (0.119932). Check your callbacks.
% delta_t_median)
100/4349 [..............................] - ETA: 25s - loss: 0.1716 - acc: 0.9300C:\Users\chris1\Anaconda3\envs\master\lib\site-packages\keras\callbacks.py:120: UserWarning: Method on_batch_end() is slow compared to the batch update (0.169594). Check your callbacks.
% delta_t_median)
4349/4349 [==============================] - 5s 1ms/step - loss: 0.1515 - acc: 0.9506
Epoch 44/300
4349/4349 [==============================] - 5s 1ms/step - loss: 0.1470 - acc: 0.9499
Epoch 45/300
4349/4349 [==============================] - 5s 1ms/step - loss: 0.1480 - acc: 0.9517
Epoch 46/300
4349/4349 [==============================] - 5s 1ms/step - loss: 0.1480 - acc: 0.9506
Epoch 47/300
4349/4349 [==============================] - 5s 1ms/step - loss: 0.1480 - acc: 0.9531
Epoch 48/300
4349/4349 [==============================] - 5s 1ms/step - loss: 0.1382 - acc: 0.9579
Epoch 49/300
4349/4349 [==============================] - 5s 1ms/step - loss: 0.1351 - acc: 0.9586
Epoch 50/300
4349/4349 [==============================] - 5s 1ms/step - loss: 0.1330 - acc: 0.9575
Epoch 51/300
4349/4349 [==============================] - 5s 1ms/step - loss: 0.1378 - acc: 0.9533
Epoch 52/300
4349/4349 [==============================] - 5s 1ms/step - loss: 0.1322 - acc: 0.9577
Epoch 53/300
4349/4349 [==============================] - 3s 674us/step - loss: 0.1216 - acc: 0.9586
Epoch 54/300
4349/4349 [==============================] - 3s 671us/step - loss: 0.1262 - acc: 0.9561
Epoch 55/300
4349/4349 [==============================] - 3s 625us/step - loss: 0.1246 - acc: 0.9609
Epoch 56/300
4349/4349 [==============================] - 3s 717us/step - loss: 0.1216 - acc: 0.9591
Epoch 57/300
4349/4349 [==============================] - 3s 767us/step - loss: 0.1207 - acc: 0.9600
Epoch 58/300
4349/4349 [==============================] - 3s 714us/step - loss: 0.1161 - acc: 0.9609
Epoch 59/300
4349/4349 [==============================] - 3s 766us/step - loss: 0.1186 - acc: 0.9628
Epoch 60/300
4349/4349 [==============================] - 3s 684us/step - loss: 0.1104 - acc: 0.9628
Epoch 61/300
4349/4349 [==============================] - 4s 1ms/step - loss: 0.1081 - acc: 0.9628
Epoch 62/300
4349/4349 [==============================] - 3s 757us/step - loss: 0.1157 - acc: 0.9623
Epoch 63/300
4349/4349 [==============================] - 3s 664us/step - loss: 0.1008 - acc: 0.9660
Epoch 64/300
4349/4349 [==============================] - 3s 717us/step - loss: 0.1132 - acc: 0.9614
Epoch 65/300
4349/4349 [==============================] - 3s 777us/step - loss: 0.1096 - acc: 0.9667
Epoch 66/300
4349/4349 [==============================] - 4s 831us/step - loss: 0.1089 - acc: 0.9598
Epoch 67/300
4349/4349 [==============================] - 4s 829us/step - loss: 0.1040 - acc: 0.9641
Epoch 68/300
4349/4349 [==============================] - 3s 711us/step - loss: 0.1025 - acc: 0.9639
Epoch 69/300
4349/4349 [==============================] - 3s 741us/step - loss: 0.0988 - acc: 0.9673
Epoch 70/300
4349/4349 [==============================] - 4s 868us/step - loss: 0.0964 - acc: 0.9676
Epoch 71/300
4349/4349 [==============================] - 6s 1ms/step - loss: 0.0940 - acc: 0.9667
Epoch 72/300
4349/4349 [==============================] - 3s 764us/step - loss: 0.0932 - acc: 0.9664
Epoch 73/300
4349/4349 [==============================] - 3s 795us/step - loss: 0.0920 - acc: 0.9692
Epoch 74/300
4349/4349 [==============================] - 4s 812us/step - loss: 0.0993 - acc: 0.9669
Epoch 75/300
4349/4349 [==============================] - 4s 847us/step - loss: 0.0989 - acc: 0.9655
Epoch 76/300
4349/4349 [==============================] - 3s 789us/step - loss: 0.0922 - acc: 0.9673
Epoch 77/300
4349/4349 [==============================] - 3s 756us/step - loss: 0.0947 - acc: 0.9671
Epoch 78/300
4349/4349 [==============================] - 3s 774us/step - loss: 0.0851 - acc: 0.9713
Epoch 79/300
4349/4349 [==============================] - 3s 747us/step - loss: 0.0864 - acc: 0.9701
Epoch 80/300
4349/4349 [==============================] - 4s 833us/step - loss: 0.0907 - acc: 0.9690
Epoch 81/300
4349/4349 [==============================] - 3s 746us/step - loss: 0.0860 - acc: 0.9699
Epoch 82/300
4349/4349 [==============================] - 3s 755us/step - loss: 0.0921 - acc: 0.9639
Epoch 83/300
4349/4349 [==============================] - 3s 770us/step - loss: 0.0870 - acc: 0.9690
Epoch 84/300
4349/4349 [==============================] - 3s 732us/step - loss: 0.0885 - acc: 0.9641
Epoch 85/300
4349/4349 [==============================] - 4s 821us/step - loss: 0.0830 - acc: 0.9713
Epoch 86/300
4349/4349 [==============================] - 3s 749us/step - loss: 0.0805 - acc: 0.9719
Epoch 87/300
4349/4349 [==============================] - 3s 783us/step - loss: 0.0747 - acc: 0.9726
Epoch 88/300
4349/4349 [==============================] - 3s 763us/step - loss: 0.0799 - acc: 0.9708
Epoch 89/300
4349/4349 [==============================] - 3s 758us/step - loss: 0.0829 - acc: 0.9694
Epoch 90/300
4349/4349 [==============================] - 3s 760us/step - loss: 0.0860 - acc: 0.9680
Epoch 91/300
4349/4349 [==============================] - 3s 743us/step - loss: 0.0848 - acc: 0.9673
Epoch 92/300
4349/4349 [==============================] - 3s 788us/step - loss: 0.0874 - acc: 0.9678
Epoch 93/300
4349/4349 [==============================] - 3s 756us/step - loss: 0.0770 - acc: 0.9708
Epoch 94/300
4349/4349 [==============================] - 4s 902us/step - loss: 0.0822 - acc: 0.9687
Epoch 95/300
4349/4349 [==============================] - 3s 785us/step - loss: 0.0762 - acc: 0.9713
Epoch 96/300
4349/4349 [==============================] - 3s 693us/step - loss: 0.0792 - acc: 0.9706
Epoch 97/300
4349/4349 [==============================] - 4s 827us/step - loss: 0.0786 - acc: 0.9710
Epoch 98/300
4349/4349 [==============================] - 3s 749us/step - loss: 0.0761 - acc: 0.9706
Epoch 99/300
4349/4349 [==============================] - 3s 778us/step - loss: 0.0827 - acc: 0.9667
Epoch 100/300
4349/4349 [==============================] - 4s 849us/step - loss: 0.0804 - acc: 0.9696
Epoch 101/300
4349/4349 [==============================] - 3s 772us/step - loss: 0.0724 - acc: 0.9717
Epoch 102/300
4349/4349 [==============================] - 4s 936us/step - loss: 0.0742 - acc: 0.9722
Epoch 103/300
4349/4349 [==============================] - 3s 703us/step - loss: 0.0825 - acc: 0.9685
Epoch 104/300
4349/4349 [==============================] - 3s 730us/step - loss: 0.0714 - acc: 0.9726
Epoch 105/300
4349/4349 [==============================] - 3s 688us/step - loss: 0.0723 - acc: 0.9738
Epoch 106/300
4349/4349 [==============================] - 3s 766us/step - loss: 0.0739 - acc: 0.9715
Epoch 107/300
4349/4349 [==============================] - 3s 780us/step - loss: 0.0713 - acc: 0.9719
Epoch 108/300
4349/4349 [==============================] - 3s 700us/step - loss: 0.0713 - acc: 0.9736
Epoch 109/300
4349/4349 [==============================] - 3s 736us/step - loss: 0.0733 - acc: 0.9724
Epoch 110/300
4349/4349 [==============================] - 2s 571us/step - loss: 0.0689 - acc: 0.9759
Epoch 111/300
4349/4349 [==============================] - 2s 573us/step - loss: 0.0737 - acc: 0.9696
Epoch 112/300
4349/4349 [==============================] - 2s 553us/step - loss: 0.0722 - acc: 0.9726
Epoch 113/300
4349/4349 [==============================] - 2s 560us/step - loss: 0.0707 - acc: 0.9729
Epoch 114/300
4349/4349 [==============================] - 2s 545us/step - loss: 0.0686 - acc: 0.9742
Epoch 115/300
4349/4349 [==============================] - 2s 571us/step - loss: 0.0701 - acc: 0.9724
Epoch 116/300
4349/4349 [==============================] - 4s 847us/step - loss: 0.0729 - acc: 0.9706
Epoch 117/300
4349/4349 [==============================] - 3s 739us/step - loss: 0.0683 - acc: 0.9722
Epoch 118/300
4349/4349 [==============================] - 4s 928us/step - loss: 0.0703 - acc: 0.9738
Epoch 119/300
4349/4349 [==============================] - 4s 871us/step - loss: 0.0720 - acc: 0.9747
Epoch 120/300
4349/4349 [==============================] - 5s 1ms/step - loss: 0.0731 - acc: 0.9699
Epoch 121/300
4349/4349 [==============================] - 5s 1ms/step - loss: 0.0693 - acc: 0.9706
Epoch 122/300
4349/4349 [==============================] - 5s 1ms/step - loss: 0.0707 - acc: 0.9729
Epoch 123/300
4349/4349 [==============================] - 4s 961us/step - loss: 0.0634 - acc: 0.9765
Epoch 124/300
4349/4349 [==============================] - 4s 842us/step - loss: 0.0667 - acc: 0.9726
Epoch 125/300
4349/4349 [==============================] - 3s 803us/step - loss: 0.0699 - acc: 0.9717
Epoch 126/300
4349/4349 [==============================] - 3s 804us/step - loss: 0.0732 - acc: 0.9706
Epoch 127/300
4349/4349 [==============================] - 4s 839us/step - loss: 0.0711 - acc: 0.9710
Epoch 128/300
4349/4349 [==============================] - 4s 809us/step - loss: 0.0672 - acc: 0.9754
Epoch 129/300
4349/4349 [==============================] - 4s 841us/step - loss: 0.0702 - acc: 0.9719
Epoch 130/300
4349/4349 [==============================] - 4s 856us/step - loss: 0.0656 - acc: 0.9754
Epoch 131/300
4349/4349 [==============================] - 4s 902us/step - loss: 0.0670 - acc: 0.9742
Epoch 132/300
4349/4349 [==============================] - 4s 873us/step - loss: 0.0624 - acc: 0.9738
Epoch 133/300
4349/4349 [==============================] - 4s 868us/step - loss: 0.0669 - acc: 0.9752
Epoch 134/300
4349/4349 [==============================] - 4s 884us/step - loss: 0.0624 - acc: 0.9747
Epoch 135/300
4349/4349 [==============================] - 4s 919us/step - loss: 0.0650 - acc: 0.9733
Epoch 136/300
4349/4349 [==============================] - 4s 951us/step - loss: 0.0619 - acc: 0.9747
Epoch 137/300
4349/4349 [==============================] - 4s 1ms/step - loss: 0.0595 - acc: 0.9745
Epoch 138/300
4349/4349 [==============================] - 4s 916us/step - loss: 0.0654 - acc: 0.9722
Epoch 139/300
4349/4349 [==============================] - 3s 650us/step - loss: 0.0648 - acc: 0.9738
Epoch 140/300
4349/4349 [==============================] - 3s 600us/step - loss: 0.0639 - acc: 0.9719
Epoch 141/300
4349/4349 [==============================] - 3s 687us/step - loss: 0.0670 - acc: 0.9736
Epoch 142/300
4349/4349 [==============================] - 3s 659us/step - loss: 0.0647 - acc: 0.9710
Epoch 143/300
4349/4349 [==============================] - 3s 619us/step - loss: 0.0600 - acc: 0.9761
Epoch 144/300
4349/4349 [==============================] - 3s 690us/step - loss: 0.0615 - acc: 0.9775
Epoch 145/300
4349/4349 [==============================] - 3s 636us/step - loss: 0.0595 - acc: 0.9752
Epoch 146/300
4349/4349 [==============================] - 3s 683us/step - loss: 0.0599 - acc: 0.9765
Epoch 147/300
4349/4349 [==============================] - 3s 682us/step - loss: 0.0644 - acc: 0.9736
Epoch 148/300
4349/4349 [==============================] - 3s 799us/step - loss: 0.0620 - acc: 0.9740
Epoch 149/300
4349/4349 [==============================] - 3s 690us/step - loss: 0.0593 - acc: 0.9779
Epoch 150/300
4349/4349 [==============================] - 3s 677us/step - loss: 0.0615 - acc: 0.9738
Epoch 151/300
4349/4349 [==============================] - 3s 719us/step - loss: 0.0597 - acc: 0.9761
Epoch 152/300
4349/4349 [==============================] - 3s 685us/step - loss: 0.0616 - acc: 0.9747
Epoch 153/300
4349/4349 [==============================] - 3s 621us/step - loss: 0.0610 - acc: 0.9747
Epoch 154/300
4349/4349 [==============================] - 3s 697us/step - loss: 0.0612 - acc: 0.9731
Epoch 155/300
4349/4349 [==============================] - 3s 706us/step - loss: 0.0554 - acc: 0.9754
Epoch 156/300
4349/4349 [==============================] - 3s 678us/step - loss: 0.0579 - acc: 0.9756
Epoch 157/300
4349/4349 [==============================] - 3s 644us/step - loss: 0.0601 - acc: 0.9742
Epoch 158/300
4349/4349 [==============================] - 3s 687us/step - loss: 0.0591 - acc: 0.9749
Epoch 159/300
4349/4349 [==============================] - 3s 629us/step - loss: 0.0617 - acc: 0.9752
Epoch 160/300
4349/4349 [==============================] - 3s 644us/step - loss: 0.0585 - acc: 0.9763
Epoch 161/300
4349/4349 [==============================] - 3s 745us/step - loss: 0.0577 - acc: 0.9761
Epoch 162/300
4349/4349 [==============================] - 3s 616us/step - loss: 0.0611 - acc: 0.9736
Epoch 163/300
4349/4349 [==============================] - 3s 589us/step - loss: 0.0585 - acc: 0.9742
Epoch 164/300
4349/4349 [==============================] - 3s 679us/step - loss: 0.0592 - acc: 0.9738
Epoch 165/300
4349/4349 [==============================] - 3s 706us/step - loss: 0.0617 - acc: 0.9722
Epoch 166/300
4349/4349 [==============================] - 3s 677us/step - loss: 0.0547 - acc: 0.9768
Epoch 167/300
4349/4349 [==============================] - 3s 613us/step - loss: 0.0579 - acc: 0.9731
Epoch 168/300
4349/4349 [==============================] - 3s 635us/step - loss: 0.0590 - acc: 0.9752
Epoch 169/300
4349/4349 [==============================] - 3s 615us/step - loss: 0.0628 - acc: 0.9745
Epoch 170/300
4349/4349 [==============================] - 3s 716us/step - loss: 0.0585 - acc: 0.9749
Epoch 171/300
4349/4349 [==============================] - 3s 639us/step - loss: 0.0566 - acc: 0.9749
Epoch 172/300
4349/4349 [==============================] - 3s 705us/step - loss: 0.0563 - acc: 0.9765
Epoch 173/300
4349/4349 [==============================] - 3s 721us/step - loss: 0.0580 - acc: 0.9763
Epoch 174/300
4349/4349 [==============================] - 3s 713us/step - loss: 0.0554 - acc: 0.9740
Epoch 175/300
4349/4349 [==============================] - 3s 688us/step - loss: 0.0641 - acc: 0.9729
Epoch 176/300
4349/4349 [==============================] - 3s 669us/step - loss: 0.0590 - acc: 0.9761
Epoch 177/300
4349/4349 [==============================] - 3s 685us/step - loss: 0.0594 - acc: 0.9763
Epoch 178/300
4349/4349 [==============================] - 3s 685us/step - loss: 0.0618 - acc: 0.9759
Epoch 179/300
4349/4349 [==============================] - 3s 682us/step - loss: 0.0589 - acc: 0.9754
Epoch 180/300
4349/4349 [==============================] - 3s 683us/step - loss: 0.0587 - acc: 0.9759
Epoch 181/300
4349/4349 [==============================] - 3s 649us/step - loss: 0.0593 - acc: 0.9763
Epoch 182/300
4349/4349 [==============================] - 3s 651us/step - loss: 0.0543 - acc: 0.9768
Epoch 183/300
4349/4349 [==============================] - 3s 656us/step - loss: 0.0521 - acc: 0.9786
Epoch 184/300
4349/4349 [==============================] - 3s 675us/step - loss: 0.0516 - acc: 0.9779
Epoch 185/300
4349/4349 [==============================] - 3s 659us/step - loss: 0.0539 - acc: 0.9749
Epoch 186/300
4349/4349 [==============================] - 3s 715us/step - loss: 0.0562 - acc: 0.9777
Epoch 187/300
4349/4349 [==============================] - 3s 642us/step - loss: 0.0553 - acc: 0.9752
Epoch 188/300
4349/4349 [==============================] - 3s 623us/step - loss: 0.0558 - acc: 0.9749
Epoch 189/300
4349/4349 [==============================] - 3s 651us/step - loss: 0.0473 - acc: 0.9805
Epoch 190/300
4349/4349 [==============================] - 3s 660us/step - loss: 0.0538 - acc: 0.9754
Epoch 191/300
4349/4349 [==============================] - 3s 673us/step - loss: 0.0550 - acc: 0.9786
Epoch 192/300
4349/4349 [==============================] - 3s 664us/step - loss: 0.0566 - acc: 0.9752
Epoch 193/300
4349/4349 [==============================] - 3s 630us/step - loss: 0.0579 - acc: 0.9759
Epoch 194/300
4349/4349 [==============================] - 3s 650us/step - loss: 0.0555 - acc: 0.9756
Epoch 195/300
4349/4349 [==============================] - 3s 683us/step - loss: 0.0587 - acc: 0.9742
Epoch 196/300
4349/4349 [==============================] - 3s 741us/step - loss: 0.0588 - acc: 0.9738
Epoch 197/300
4349/4349 [==============================] - 3s 627us/step - loss: 0.0561 - acc: 0.9761
Epoch 198/300
4349/4349 [==============================] - 3s 631us/step - loss: 0.0588 - acc: 0.9752
Epoch 199/300
4349/4349 [==============================] - 3s 669us/step - loss: 0.0509 - acc: 0.9768
Epoch 200/300
4349/4349 [==============================] - 3s 750us/step - loss: 0.0554 - acc: 0.9749
Epoch 201/300
4349/4349 [==============================] - 3s 645us/step - loss: 0.0516 - acc: 0.9763
Epoch 202/300
4349/4349 [==============================] - 3s 659us/step - loss: 0.0600 - acc: 0.9770
Epoch 203/300
4349/4349 [==============================] - 3s 620us/step - loss: 0.0506 - acc: 0.9782
Epoch 204/300
4349/4349 [==============================] - 3s 629us/step - loss: 0.0509 - acc: 0.9754
Epoch 205/300
4349/4349 [==============================] - 3s 646us/step - loss: 0.0533 - acc: 0.9754
Epoch 206/300
4349/4349 [==============================] - 3s 694us/step - loss: 0.0524 - acc: 0.9749
Epoch 207/300
4349/4349 [==============================] - 3s 644us/step - loss: 0.0537 - acc: 0.9754
Epoch 208/300
4349/4349 [==============================] - 3s 630us/step - loss: 0.0486 - acc: 0.9777
Epoch 209/300
4349/4349 [==============================] - 3s 575us/step - loss: 0.0516 - acc: 0.9770
Epoch 210/300
4349/4349 [==============================] - 3s 630us/step - loss: 0.0525 - acc: 0.9770
Epoch 211/300
4349/4349 [==============================] - 3s 613us/step - loss: 0.0560 - acc: 0.9765
Epoch 212/300
4349/4349 [==============================] - 3s 632us/step - loss: 0.0535 - acc: 0.9777
Epoch 213/300
4349/4349 [==============================] - 3s 725us/step - loss: 0.0464 - acc: 0.9791
Epoch 214/300
4349/4349 [==============================] - 3s 695us/step - loss: 0.0523 - acc: 0.9772
Epoch 215/300
4349/4349 [==============================] - 3s 771us/step - loss: 0.0519 - acc: 0.9761
Epoch 216/300
4349/4349 [==============================] - 4s 818us/step - loss: 0.0539 - acc: 0.9763
Epoch 217/300
4349/4349 [==============================] - 4s 989us/step - loss: 0.0565 - acc: 0.9745
Epoch 218/300
4349/4349 [==============================] - 5s 1ms/step - loss: 0.0510 - acc: 0.9756
Epoch 219/300
4349/4349 [==============================] - 4s 932us/step - loss: 0.0575 - acc: 0.9740
Epoch 220/300
4349/4349 [==============================] - 4s 913us/step - loss: 0.0494 - acc: 0.9788
Epoch 221/300
4349/4349 [==============================] - 4s 886us/step - loss: 0.0547 - acc: 0.9747
Epoch 222/300
4349/4349 [==============================] - 3s 754us/step - loss: 0.0512 - acc: 0.9765
Epoch 223/300
4349/4349 [==============================] - 3s 762us/step - loss: 0.0487 - acc: 0.9786
Epoch 224/300
4349/4349 [==============================] - 3s 685us/step - loss: 0.0540 - acc: 0.9752
Epoch 225/300
4349/4349 [==============================] - 3s 747us/step - loss: 0.0501 - acc: 0.9770
Epoch 226/300
4349/4349 [==============================] - 3s 744us/step - loss: 0.0459 - acc: 0.9802
Epoch 227/300
4349/4349 [==============================] - 3s 800us/step - loss: 0.0489 - acc: 0.9775
Epoch 228/300
4349/4349 [==============================] - 3s 691us/step - loss: 0.0529 - acc: 0.9765
Epoch 229/300
4349/4349 [==============================] - 3s 768us/step - loss: 0.0541 - acc: 0.9770
Epoch 230/300
4349/4349 [==============================] - 3s 784us/step - loss: 0.0540 - acc: 0.9763
Epoch 231/300
4349/4349 [==============================] - 3s 737us/step - loss: 0.0577 - acc: 0.9733
Epoch 232/300
4349/4349 [==============================] - 3s 746us/step - loss: 0.0574 - acc: 0.9731
Epoch 233/300
4349/4349 [==============================] - 3s 709us/step - loss: 0.0493 - acc: 0.9772
Epoch 234/300
4349/4349 [==============================] - 3s 770us/step - loss: 0.0554 - acc: 0.9754
Epoch 235/300
4349/4349 [==============================] - 3s 662us/step - loss: 0.0478 - acc: 0.9768
Epoch 236/300
4349/4349 [==============================] - 3s 631us/step - loss: 0.0527 - acc: 0.9775
Epoch 237/300
4349/4349 [==============================] - 3s 650us/step - loss: 0.0484 - acc: 0.9800
Epoch 238/300
4349/4349 [==============================] - 3s 765us/step - loss: 0.0529 - acc: 0.9768
Epoch 239/300
4349/4349 [==============================] - 3s 734us/step - loss: 0.0476 - acc: 0.9777
Epoch 240/300
4349/4349 [==============================] - 4s 809us/step - loss: 0.0526 - acc: 0.9731
Epoch 241/300
50/4349 [..............................] - ETA: 9s - loss: 0.0492 - acc: 0.9600C:\Users\chris1\Anaconda3\envs\master\lib\site-packages\keras\callbacks.py:120: UserWarning: Method on_batch_end() is slow compared to the batch update (0.117933). Check your callbacks.
% delta_t_median)
4349/4349 [==============================] - 4s 850us/step - loss: 0.0491 - acc: 0.9784
Epoch 242/300
4349/4349 [==============================] - 4s 839us/step - loss: 0.0492 - acc: 0.9759
Epoch 243/300
4349/4349 [==============================] - 4s 908us/step - loss: 0.0481 - acc: 0.9795
Epoch 244/300
4349/4349 [==============================] - 3s 670us/step - loss: 0.0508 - acc: 0.9763
Epoch 245/300
4349/4349 [==============================] - 4s 809us/step - loss: 0.0501 - acc: 0.9782
Epoch 246/300
4349/4349 [==============================] - 3s 781us/step - loss: 0.0517 - acc: 0.9756
Epoch 247/300
4349/4349 [==============================] - 4s 941us/step - loss: 0.0484 - acc: 0.9770
Epoch 248/300
4349/4349 [==============================] - 4s 960us/step - loss: 0.0498 - acc: 0.9798
Epoch 249/300
4349/4349 [==============================] - 4s 919us/step - loss: 0.0524 - acc: 0.9777
Epoch 250/300
4349/4349 [==============================] - 4s 831us/step - loss: 0.0479 - acc: 0.9772
Epoch 251/300
4349/4349 [==============================] - 3s 747us/step - loss: 0.0497 - acc: 0.9761
Epoch 252/300
4349/4349 [==============================] - 2s 533us/step - loss: 0.0475 - acc: 0.9784
Epoch 253/300
4349/4349 [==============================] - 2s 471us/step - loss: 0.0502 - acc: 0.9759
Epoch 254/300
4349/4349 [==============================] - 2s 421us/step - loss: 0.0483 - acc: 0.9777
Epoch 255/300
4349/4349 [==============================] - 2s 414us/step - loss: 0.0471 - acc: 0.9770
Epoch 256/300
4349/4349 [==============================] - 2s 439us/step - loss: 0.0512 - acc: 0.9772
Epoch 257/300
4349/4349 [==============================] - 2s 379us/step - loss: 0.0479 - acc: 0.9798
Epoch 258/300
4349/4349 [==============================] - 2s 363us/step - loss: 0.0500 - acc: 0.9791
Epoch 259/300
4349/4349 [==============================] - 2s 359us/step - loss: 0.0545 - acc: 0.9740
Epoch 260/300
4349/4349 [==============================] - 2s 361us/step - loss: 0.0483 - acc: 0.9791
Epoch 261/300
4349/4349 [==============================] - 1s 343us/step - loss: 0.0446 - acc: 0.9795
Epoch 262/300
4349/4349 [==============================] - 1s 342us/step - loss: 0.0521 - acc: 0.9747
Epoch 263/300
4349/4349 [==============================] - 1s 323us/step - loss: 0.0474 - acc: 0.9782
Epoch 264/300
4349/4349 [==============================] - 1s 339us/step - loss: 0.0491 - acc: 0.9772
Epoch 265/300
4349/4349 [==============================] - 1s 315us/step - loss: 0.0459 - acc: 0.9798
Epoch 266/300
4349/4349 [==============================] - 1s 328us/step - loss: 0.0539 - acc: 0.9749
Epoch 267/300
4349/4349 [==============================] - 1s 285us/step - loss: 0.0481 - acc: 0.9816
Epoch 268/300
4349/4349 [==============================] - 1s 344us/step - loss: 0.0442 - acc: 0.9795
Epoch 269/300
4349/4349 [==============================] - 1s 326us/step - loss: 0.0535 - acc: 0.9759
Epoch 270/300
4349/4349 [==============================] - 1s 326us/step - loss: 0.0522 - acc: 0.9756
Epoch 271/300
4349/4349 [==============================] - 2s 361us/step - loss: 0.0460 - acc: 0.9782
Epoch 272/300
4349/4349 [==============================] - 1s 285us/step - loss: 0.0417 - acc: 0.9823
Epoch 273/300
4349/4349 [==============================] - 1s 300us/step - loss: 0.0503 - acc: 0.9759
Epoch 274/300
4349/4349 [==============================] - 1s 321us/step - loss: 0.0446 - acc: 0.9823
Epoch 275/300
4349/4349 [==============================] - 1s 339us/step - loss: 0.0512 - acc: 0.9765
Epoch 276/300
4349/4349 [==============================] - 1s 318us/step - loss: 0.0493 - acc: 0.9779
Epoch 277/300
4349/4349 [==============================] - 1s 336us/step - loss: 0.0507 - acc: 0.9765
Epoch 278/300
4349/4349 [==============================] - 2s 383us/step - loss: 0.0437 - acc: 0.9798
Epoch 279/300
4349/4349 [==============================] - 1s 326us/step - loss: 0.0493 - acc: 0.9784
Epoch 280/300
4349/4349 [==============================] - 1s 313us/step - loss: 0.0481 - acc: 0.9775
Epoch 281/300
4349/4349 [==============================] - 1s 312us/step - loss: 0.0432 - acc: 0.9802
Epoch 282/300
4349/4349 [==============================] - 1s 337us/step - loss: 0.0517 - acc: 0.9763
Epoch 283/300
4349/4349 [==============================] - 1s 280us/step - loss: 0.0469 - acc: 0.9777
Epoch 284/300
4349/4349 [==============================] - 1s 286us/step - loss: 0.0459 - acc: 0.9759
Epoch 285/300
4349/4349 [==============================] - 1s 273us/step - loss: 0.0480 - acc: 0.9807
Epoch 286/300
4349/4349 [==============================] - 1s 232us/step - loss: 0.0550 - acc: 0.9749
Epoch 287/300
4349/4349 [==============================] - 1s 226us/step - loss: 0.0481 - acc: 0.9779
Epoch 288/300
4349/4349 [==============================] - 1s 298us/step - loss: 0.0465 - acc: 0.9775
Epoch 289/300
4349/4349 [==============================] - 1s 324us/step - loss: 0.0523 - acc: 0.9765
Epoch 290/300
4349/4349 [==============================] - 1s 279us/step - loss: 0.0500 - acc: 0.9784
Epoch 291/300
4349/4349 [==============================] - 1s 294us/step - loss: 0.0457 - acc: 0.9791
Epoch 292/300
4349/4349 [==============================] - 1s 254us/step - loss: 0.0507 - acc: 0.9770
Epoch 293/300
4349/4349 [==============================] - 1s 256us/step - loss: 0.0497 - acc: 0.9754
Epoch 294/300
4349/4349 [==============================] - 2s 363us/step - loss: 0.0487 - acc: 0.9772
Epoch 295/300
4349/4349 [==============================] - 1s 341us/step - loss: 0.0450 - acc: 0.9770
Epoch 296/300
4349/4349 [==============================] - 1s 266us/step - loss: 0.0438 - acc: 0.9791
Epoch 297/300
4349/4349 [==============================] - 1s 340us/step - loss: 0.0458 - acc: 0.9795
Epoch 298/300
4349/4349 [==============================] - 1s 323us/step - loss: 0.0461 - acc: 0.9779
Epoch 299/300
4349/4349 [==============================] - 1s 322us/step - loss: 0.0426 - acc: 0.9805
Epoch 300/300
4349/4349 [==============================] - 1s 339us/step - loss: 0.0412 - acc: 0.9795
INFO:rasa_core.policies.keras_policy:Done fitting keras policy model
Can you post the logs of both offline and online training? Including the commands you used?
Still facing interesting different behaviour such that for normal mode I have to include more stories of specific situations which handles online mode by itself and no additional training is neccessary!
Here the log for online:
2018-11-07 14:22:53 DEBUG rasa_core.training.generator - Generated trackers will be deduplicated based on their unique last 4 states.
2018-11-07 14:22:53 DEBUG rasa_core.training.generator - Number of augmentation rounds is 3
2018-11-07 14:22:53 DEBUG rasa_core.training.generator - Starting data generation round 0 ... (with 1 trackers)
Processed Story Blocks: 100%|███████████████████████████████████████████| 84/84 [00:00<00:00, 334.52it/s, # trackers=1]
2018-11-07 14:22:54 DEBUG rasa_core.training.generator - Finished phase (79 training samples found).
2018-11-07 14:22:54 DEBUG rasa_core.training.generator - Data generation rounds finished.
2018-11-07 14:22:54 DEBUG rasa_core.training.generator - Found 0 unused checkpoints
2018-11-07 14:22:54 DEBUG rasa_core.training.generator - Starting augmentation round 0 ... (with 20 trackers)
Processed Story Blocks: 100%|███████████████████████████████████████████| 84/84 [00:04<00:00, 20.14it/s, # trackers=20]
2018-11-07 14:22:58 DEBUG rasa_core.training.generator - Finished phase (1662 training samples found).
2018-11-07 14:22:58 DEBUG rasa_core.training.generator - Starting augmentation round 1 ... (with 20 trackers)
Processed Story Blocks: 100%|███████████████████████████████████████████| 84/84 [00:03<00:00, 22.25it/s, # trackers=17]
2018-11-07 14:23:02 DEBUG rasa_core.training.generator - Finished phase (2931 training samples found).
2018-11-07 14:23:02 DEBUG rasa_core.training.generator - Starting augmentation round 2 ... (with 20 trackers)
Processed Story Blocks: 100%|███████████████████████████████████████████| 84/84 [00:03<00:00, 23.80it/s, # trackers=16]
2018-11-07 14:23:05 DEBUG rasa_core.training.generator - Finished phase (4042 training samples found).
2018-11-07 14:23:05 DEBUG rasa_core.training.generator - Found 4042 training trackers.
2018-11-07 14:23:05 DEBUG rasa_core.agent - Agent online trainer got kwargs: {'batch_size': 50, 'epochs': 300, 'augmentation_factor': 50}
2018-11-07 14:23:05 INFO rasa_core.featurizers - Creating states and action examples from collected trackers (by MaxHistoryTrackerFeaturizer)...
Processed trackers: 100%|█████████████████████████████████████████| 4042/4042 [00:17<00:00, 226.63it/s, # actions=4614]
2018-11-07 14:23:23 INFO rasa_core.featurizers - Created 4614 action examples.
_________________________________________________________________
Layer (type) Output Shape Param #
=================================================================
masking_1 (Masking) (None, 4, 148) 0
_________________________________________________________________
lstm_1 (LSTM) (None, 32) 23168
_________________________________________________________________
dense_1 (Dense) (None, 38) 1254
_________________________________________________________________
activation_1 (Activation) (None, 38) 0
=================================================================
Total params: 24,422
Trainable params: 24,422
Non-trainable params: 0
_________________________________________________________________
2018-11-07 14:23:24 DEBUG rasa_core.policies.keras_policy - None
2018-11-07 14:23:24 INFO rasa_core.policies.keras_policy - Fitting model with 4614 total samples and a validation split of 0.0
2018-11-07 14:23:24 DEBUG rasa_core.policies.policy - Parameters ignored by `model.fit(...)`: {'augmentation_factor': 50}
Epoch 1/300
4614/4614 [==============================] - 2s 369us/step - loss: 2.8362 - acc: 0.3084
Epoch 2/300
4614/4614 [==============================] - 1s 174us/step - loss: 2.2132 - acc: 0.3216
Epoch 3/300
4614/4614 [==============================] - 1s 176us/step - loss: 2.0059 - acc: 0.3496
Epoch 4/300
4614/4614 [==============================] - 1s 186us/step - loss: 1.7835 - acc: 0.4612
Epoch 5/300
4614/4614 [==============================] - 1s 179us/step - loss: 1.5513 - acc: 0.5451
Epoch 6/300
4614/4614 [==============================] - 1s 174us/step - loss: 1.3183 - acc: 0.6378
Epoch 7/300
4614/4614 [==============================] - 1s 177us/step - loss: 1.1409 - acc: 0.6821
Epoch 8/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.9768 - acc: 0.7436
Epoch 9/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.8478 - acc: 0.7750
Epoch 10/300
4614/4614 [==============================] - 1s 176us/step - loss: 0.7318 - acc: 0.8075
Epoch 11/300
4614/4614 [==============================] - 1s 177us/step - loss: 0.6426 - acc: 0.8377
Epoch 12/300
4614/4614 [==============================] - 1s 173us/step - loss: 0.5669 - acc: 0.8589
Epoch 13/300
4614/4614 [==============================] - 1s 171us/step - loss: 0.5095 - acc: 0.8717
Epoch 14/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.4619 - acc: 0.8775
Epoch 15/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.4215 - acc: 0.8862
Epoch 16/300
4614/4614 [==============================] - 1s 178us/step - loss: 0.3951 - acc: 0.8958
Epoch 17/300
4614/4614 [==============================] - 1s 189us/step - loss: 0.3482 - acc: 0.9116
Epoch 18/300
4614/4614 [==============================] - 1s 173us/step - loss: 0.3395 - acc: 0.9070
Epoch 19/300
4614/4614 [==============================] - 1s 173us/step - loss: 0.3169 - acc: 0.9159
Epoch 20/300
4614/4614 [==============================] - 1s 173us/step - loss: 0.3002 - acc: 0.9194
Epoch 21/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.2764 - acc: 0.9250
Epoch 22/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.2612 - acc: 0.9315
Epoch 23/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.2464 - acc: 0.9304
Epoch 24/300
4614/4614 [==============================] - 1s 176us/step - loss: 0.2415 - acc: 0.9339
Epoch 25/300
4614/4614 [==============================] - 1s 177us/step - loss: 0.2233 - acc: 0.9376
Epoch 26/300
4614/4614 [==============================] - 1s 178us/step - loss: 0.2118 - acc: 0.9395
Epoch 27/300
4614/4614 [==============================] - 1s 176us/step - loss: 0.2055 - acc: 0.9369
Epoch 28/300
4614/4614 [==============================] - 1s 178us/step - loss: 0.2004 - acc: 0.9415
Epoch 29/300
4614/4614 [==============================] - 1s 176us/step - loss: 0.1820 - acc: 0.9499
Epoch 30/300
4614/4614 [==============================] - 1s 183us/step - loss: 0.1800 - acc: 0.9463
Epoch 31/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.1805 - acc: 0.9426
Epoch 32/300
4614/4614 [==============================] - 1s 180us/step - loss: 0.1826 - acc: 0.9445
Epoch 33/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.1616 - acc: 0.9512
Epoch 34/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.1618 - acc: 0.9493
Epoch 35/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.1573 - acc: 0.9499
Epoch 36/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.1607 - acc: 0.9502
Epoch 37/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.1427 - acc: 0.9556
Epoch 38/300
4614/4614 [==============================] - 1s 177us/step - loss: 0.1451 - acc: 0.9538
Epoch 39/300
4614/4614 [==============================] - 1s 177us/step - loss: 0.1464 - acc: 0.9547
Epoch 40/300
4614/4614 [==============================] - 1s 184us/step - loss: 0.1325 - acc: 0.9573
Epoch 41/300
4614/4614 [==============================] - 1s 182us/step - loss: 0.1284 - acc: 0.9586
Epoch 42/300
4614/4614 [==============================] - 1s 182us/step - loss: 0.1326 - acc: 0.9603
Epoch 43/300
4614/4614 [==============================] - 1s 178us/step - loss: 0.1238 - acc: 0.9595
Epoch 44/300
4614/4614 [==============================] - 1s 176us/step - loss: 0.1255 - acc: 0.9584
Epoch 45/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.1149 - acc: 0.9627
Epoch 46/300
4614/4614 [==============================] - 1s 181us/step - loss: 0.1147 - acc: 0.9597
Epoch 47/300
4614/4614 [==============================] - 1s 179us/step - loss: 0.1146 - acc: 0.9666
Epoch 48/300
4614/4614 [==============================] - 1s 177us/step - loss: 0.1097 - acc: 0.9634
Epoch 49/300
4614/4614 [==============================] - 1s 176us/step - loss: 0.1117 - acc: 0.9623
Epoch 50/300
4614/4614 [==============================] - 1s 177us/step - loss: 0.1038 - acc: 0.9655
Epoch 51/300
4614/4614 [==============================] - 1s 176us/step - loss: 0.1032 - acc: 0.9625
Epoch 52/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0986 - acc: 0.9640
Epoch 53/300
4614/4614 [==============================] - 1s 176us/step - loss: 0.1052 - acc: 0.9625
Epoch 54/300
4614/4614 [==============================] - 1s 182us/step - loss: 0.0977 - acc: 0.9658
Epoch 55/300
4614/4614 [==============================] - 1s 177us/step - loss: 0.1049 - acc: 0.9649
Epoch 56/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.1020 - acc: 0.9662
Epoch 57/300
4614/4614 [==============================] - 1s 209us/step - loss: 0.0941 - acc: 0.9671
Epoch 58/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0980 - acc: 0.9662
Epoch 59/300
4614/4614 [==============================] - 1s 200us/step - loss: 0.0908 - acc: 0.9694
Epoch 60/300
4614/4614 [==============================] - 1s 190us/step - loss: 0.0868 - acc: 0.9673
Epoch 61/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0869 - acc: 0.9688
Epoch 62/300
4614/4614 [==============================] - 1s 186us/step - loss: 0.0900 - acc: 0.9658
Epoch 63/300
4614/4614 [==============================] - 1s 179us/step - loss: 0.0903 - acc: 0.9664
Epoch 64/300
4614/4614 [==============================] - 1s 182us/step - loss: 0.0844 - acc: 0.9688
Epoch 65/300
4614/4614 [==============================] - 1s 176us/step - loss: 0.0844 - acc: 0.9703
Epoch 66/300
4614/4614 [==============================] - 1s 178us/step - loss: 0.0786 - acc: 0.9736
Epoch 67/300
4614/4614 [==============================] - 1s 180us/step - loss: 0.0885 - acc: 0.9686
Epoch 68/300
4614/4614 [==============================] - 1s 179us/step - loss: 0.0796 - acc: 0.9729
Epoch 69/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0802 - acc: 0.9736
Epoch 70/300
4614/4614 [==============================] - 1s 192us/step - loss: 0.0787 - acc: 0.9723
Epoch 71/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0802 - acc: 0.9705
Epoch 72/300
4614/4614 [==============================] - 1s 198us/step - loss: 0.0746 - acc: 0.9727
Epoch 73/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0830 - acc: 0.9720
Epoch 74/300
4614/4614 [==============================] - 1s 183us/step - loss: 0.0741 - acc: 0.9772
Epoch 75/300
4614/4614 [==============================] - 1s 185us/step - loss: 0.0738 - acc: 0.9731
Epoch 76/300
4614/4614 [==============================] - 1s 182us/step - loss: 0.0686 - acc: 0.9759
Epoch 77/300
4614/4614 [==============================] - 1s 182us/step - loss: 0.0757 - acc: 0.9723
Epoch 78/300
4614/4614 [==============================] - 1s 193us/step - loss: 0.0739 - acc: 0.9729
Epoch 79/300
4614/4614 [==============================] - 1s 176us/step - loss: 0.0700 - acc: 0.9742
Epoch 80/300
4614/4614 [==============================] - 1s 177us/step - loss: 0.0718 - acc: 0.9733
Epoch 81/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0721 - acc: 0.9762
Epoch 82/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0670 - acc: 0.9768
Epoch 83/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0702 - acc: 0.9699
Epoch 84/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.0697 - acc: 0.9740
Epoch 85/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0676 - acc: 0.9757
Epoch 86/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0686 - acc: 0.9759
Epoch 87/300
4614/4614 [==============================] - 1s 173us/step - loss: 0.0655 - acc: 0.9749
Epoch 88/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0598 - acc: 0.9772
Epoch 89/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0643 - acc: 0.9718
Epoch 90/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0661 - acc: 0.9749
Epoch 91/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.0602 - acc: 0.9770
Epoch 92/300
4614/4614 [==============================] - 1s 176us/step - loss: 0.0705 - acc: 0.9729
Epoch 93/300
4614/4614 [==============================] - 1s 176us/step - loss: 0.0628 - acc: 0.9759
Epoch 94/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.0585 - acc: 0.9772
Epoch 95/300
4614/4614 [==============================] - 1s 176us/step - loss: 0.0637 - acc: 0.9751
Epoch 96/300
4614/4614 [==============================] - 1s 176us/step - loss: 0.0611 - acc: 0.9775
Epoch 97/300
4614/4614 [==============================] - 1s 179us/step - loss: 0.0589 - acc: 0.9788
Epoch 98/300
4614/4614 [==============================] - 1s 172us/step - loss: 0.0625 - acc: 0.9740
Epoch 99/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0564 - acc: 0.9775
Epoch 100/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.0621 - acc: 0.9772
Epoch 101/300
4614/4614 [==============================] - 1s 173us/step - loss: 0.0614 - acc: 0.9757
Epoch 102/300
4614/4614 [==============================] - 1s 182us/step - loss: 0.0616 - acc: 0.9762
Epoch 103/300
4614/4614 [==============================] - 1s 180us/step - loss: 0.0587 - acc: 0.9777
Epoch 104/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.0542 - acc: 0.9792
Epoch 105/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0542 - acc: 0.9779
Epoch 106/300
4614/4614 [==============================] - 1s 176us/step - loss: 0.0558 - acc: 0.9768
Epoch 107/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.0528 - acc: 0.9781
Epoch 108/300
4614/4614 [==============================] - 1s 173us/step - loss: 0.0572 - acc: 0.9777
Epoch 109/300
4614/4614 [==============================] - 1s 178us/step - loss: 0.0562 - acc: 0.9777
Epoch 110/300
4614/4614 [==============================] - 1s 177us/step - loss: 0.0547 - acc: 0.9794
Epoch 111/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0546 - acc: 0.9792
Epoch 112/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.0523 - acc: 0.9794
Epoch 113/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0536 - acc: 0.9777
Epoch 114/300
4614/4614 [==============================] - 1s 182us/step - loss: 0.0511 - acc: 0.9775
Epoch 115/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0498 - acc: 0.9807
Epoch 116/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0586 - acc: 0.9762
Epoch 117/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0507 - acc: 0.9788
Epoch 118/300
4614/4614 [==============================] - 1s 179us/step - loss: 0.0531 - acc: 0.9770
Epoch 119/300
4614/4614 [==============================] - 1s 186us/step - loss: 0.0526 - acc: 0.9775
Epoch 120/300
4614/4614 [==============================] - 1s 207us/step - loss: 0.0516 - acc: 0.9777
Epoch 121/300
4614/4614 [==============================] - 1s 195us/step - loss: 0.0534 - acc: 0.9766
Epoch 122/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0496 - acc: 0.9790
Epoch 123/300
4614/4614 [==============================] - 1s 188us/step - loss: 0.0531 - acc: 0.9792
Epoch 124/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0512 - acc: 0.9785
Epoch 125/300
4614/4614 [==============================] - 1s 198us/step - loss: 0.0529 - acc: 0.9779
Epoch 126/300
4614/4614 [==============================] - 1s 189us/step - loss: 0.0543 - acc: 0.9770
Epoch 127/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0506 - acc: 0.9798
Epoch 128/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0524 - acc: 0.9788
Epoch 129/300
4614/4614 [==============================] - 1s 187us/step - loss: 0.0516 - acc: 0.9785
Epoch 130/300
4614/4614 [==============================] - 1s 199us/step - loss: 0.0510 - acc: 0.9781
Epoch 131/300
4614/4614 [==============================] - 1s 230us/step - loss: 0.0449 - acc: 0.9805
Epoch 132/300
4614/4614 [==============================] - 1s 213us/step - loss: 0.0560 - acc: 0.9775
Epoch 133/300
4614/4614 [==============================] - 1s 202us/step - loss: 0.0516 - acc: 0.9772
Epoch 134/300
4614/4614 [==============================] - 1s 190us/step - loss: 0.0476 - acc: 0.9779
Epoch 135/300
4614/4614 [==============================] - 1s 211us/step - loss: 0.0539 - acc: 0.9781
Epoch 136/300
4614/4614 [==============================] - 1s 187us/step - loss: 0.0496 - acc: 0.9794
Epoch 137/300
4614/4614 [==============================] - 1s 220us/step - loss: 0.0480 - acc: 0.9788
Epoch 138/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0489 - acc: 0.9790
Epoch 139/300
4614/4614 [==============================] - 1s 173us/step - loss: 0.0517 - acc: 0.9783
Epoch 140/300
4614/4614 [==============================] - 1s 187us/step - loss: 0.0454 - acc: 0.9803
Epoch 141/300
4614/4614 [==============================] - 1s 181us/step - loss: 0.0430 - acc: 0.9814
Epoch 142/300
4614/4614 [==============================] - 1s 176us/step - loss: 0.0457 - acc: 0.9816
Epoch 143/300
4614/4614 [==============================] - 1s 178us/step - loss: 0.0517 - acc: 0.9764
Epoch 144/300
4614/4614 [==============================] - 1s 173us/step - loss: 0.0517 - acc: 0.9796
Epoch 145/300
4614/4614 [==============================] - 1s 173us/step - loss: 0.0479 - acc: 0.9781
Epoch 146/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.0441 - acc: 0.9809
Epoch 147/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0452 - acc: 0.9811
Epoch 148/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0470 - acc: 0.9790
Epoch 149/300
4614/4614 [==============================] - 1s 171us/step - loss: 0.0436 - acc: 0.9794
Epoch 150/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0433 - acc: 0.9822
Epoch 151/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.0526 - acc: 0.9762
Epoch 152/300
4614/4614 [==============================] - 1s 173us/step - loss: 0.0513 - acc: 0.9772
Epoch 153/300
4614/4614 [==============================] - 1s 178us/step - loss: 0.0419 - acc: 0.9811
Epoch 154/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.0461 - acc: 0.9796
Epoch 155/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.0472 - acc: 0.9788
Epoch 156/300
4614/4614 [==============================] - 1s 176us/step - loss: 0.0465 - acc: 0.9794
Epoch 157/300
4614/4614 [==============================] - 1s 176us/step - loss: 0.0442 - acc: 0.9807
Epoch 158/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.0404 - acc: 0.9814
Epoch 159/300
4614/4614 [==============================] - 1s 170us/step - loss: 0.0467 - acc: 0.9785
Epoch 160/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0395 - acc: 0.9824
Epoch 161/300
4614/4614 [==============================] - 1s 173us/step - loss: 0.0433 - acc: 0.9801
Epoch 162/300
4614/4614 [==============================] - 1s 173us/step - loss: 0.0447 - acc: 0.9807
Epoch 163/300
4614/4614 [==============================] - 1s 177us/step - loss: 0.0443 - acc: 0.9822
Epoch 164/300
4614/4614 [==============================] - 1s 170us/step - loss: 0.0423 - acc: 0.9785
Epoch 165/300
4614/4614 [==============================] - 1s 178us/step - loss: 0.0442 - acc: 0.9807
Epoch 166/300
4614/4614 [==============================] - 1s 172us/step - loss: 0.0457 - acc: 0.9796
Epoch 167/300
4614/4614 [==============================] - 1s 178us/step - loss: 0.0475 - acc: 0.9783
Epoch 168/300
4614/4614 [==============================] - 1s 180us/step - loss: 0.0455 - acc: 0.9788
Epoch 169/300
4614/4614 [==============================] - 1s 174us/step - loss: 0.0465 - acc: 0.9785
Epoch 170/300
4614/4614 [==============================] - 1s 172us/step - loss: 0.0403 - acc: 0.9824
Epoch 171/300
4614/4614 [==============================] - 1s 177us/step - loss: 0.0424 - acc: 0.9833
Epoch 172/300
4614/4614 [==============================] - 1s 177us/step - loss: 0.0428 - acc: 0.9809
Epoch 173/300
4614/4614 [==============================] - 1s 177us/step - loss: 0.0449 - acc: 0.9801
Epoch 174/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0430 - acc: 0.9807
Epoch 175/300
4614/4614 [==============================] - 1s 175us/step - loss: 0.0481 - acc: 0.9775
Epoch 176/300
4614/4614 [==============================] - 1s 192us/step - loss: 0.0405 - acc: 0.9807
Epoch 177/300
4614/4614 [==============================] - 1s 188us/step - loss: 0.0424 - acc: 0.9792
Epoch 178/300
4614/4614 [==============================] - 1s 189us/step - loss: 0.0403 - acc: 0.9833
Epoch 179/300
4614/4614 [==============================] - 1s 187us/step - loss: 0.0424 - acc: 0.9805
Epoch 180/300
4614/4614 [==============================] - 1s 190us/step - loss: 0.0426 - acc: 0.9816
Epoch 181/300
4614/4614 [==============================] - 1s 185us/step - loss: 0.0460 - acc: 0.9779
Epoch 182/300
4614/4614 [==============================] - 1s 187us/step - loss: 0.0421 - acc: 0.9814
Epoch 183/300
4614/4614 [==============================] - 1s 193us/step - loss: 0.0437 - acc: 0.9798
Epoch 184/300
4614/4614 [==============================] - 1s 187us/step - loss: 0.0426 - acc: 0.9807
Epoch 185/300
4614/4614 [==============================] - 1s 195us/step - loss: 0.0430 - acc: 0.9809
Epoch 186/300
4614/4614 [==============================] - 1s 211us/step - loss: 0.0437 - acc: 0.9803
Epoch 187/300
4614/4614 [==============================] - 1s 207us/step - loss: 0.0452 - acc: 0.9816
Epoch 188/300
4614/4614 [==============================] - 1s 205us/step - loss: 0.0399 - acc: 0.9822
Epoch 189/300
4614/4614 [==============================] - 1s 192us/step - loss: 0.0437 - acc: 0.9811
Epoch 190/300
4614/4614 [==============================] - 1s 188us/step - loss: 0.0427 - acc: 0.9792
Epoch 191/300
4614/4614 [==============================] - 1s 193us/step - loss: 0.0394 - acc: 0.9818
Epoch 192/300
4614/4614 [==============================] - 1s 185us/step - loss: 0.0402 - acc: 0.9809
Epoch 193/300
4614/4614 [==============================] - 1s 190us/step - loss: 0.0411 - acc: 0.9816
Epoch 194/300
4614/4614 [==============================] - 1s 186us/step - loss: 0.0409 - acc: 0.9814
Epoch 195/300
4614/4614 [==============================] - 1s 192us/step - loss: 0.0433 - acc: 0.9811
Epoch 196/300
4614/4614 [==============================] - 1s 194us/step - loss: 0.0379 - acc: 0.9809
Epoch 197/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0398 - acc: 0.9818
Epoch 198/300
4614/4614 [==============================] - 1s 185us/step - loss: 0.0417 - acc: 0.9824
Epoch 199/300
4614/4614 [==============================] - 1s 188us/step - loss: 0.0374 - acc: 0.9831
Epoch 200/300
4614/4614 [==============================] - 1s 190us/step - loss: 0.0424 - acc: 0.9798
Epoch 201/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0422 - acc: 0.9794
Epoch 202/300
4614/4614 [==============================] - 1s 189us/step - loss: 0.0456 - acc: 0.9777
Epoch 203/300
4614/4614 [==============================] - 1s 187us/step - loss: 0.0392 - acc: 0.9820
Epoch 204/300
4614/4614 [==============================] - 1s 187us/step - loss: 0.0392 - acc: 0.9829
Epoch 205/300
4614/4614 [==============================] - 1s 187us/step - loss: 0.0443 - acc: 0.9777
Epoch 206/300
4614/4614 [==============================] - 1s 189us/step - loss: 0.0375 - acc: 0.9818
Epoch 207/300
4614/4614 [==============================] - 1s 199us/step - loss: 0.0434 - acc: 0.9792
Epoch 208/300
4614/4614 [==============================] - 1s 205us/step - loss: 0.0422 - acc: 0.9807
Epoch 209/300
4614/4614 [==============================] - 1s 188us/step - loss: 0.0376 - acc: 0.9822
Epoch 210/300
4614/4614 [==============================] - 1s 189us/step - loss: 0.0465 - acc: 0.9783
Epoch 211/300
4614/4614 [==============================] - 1s 185us/step - loss: 0.0376 - acc: 0.9818
Epoch 212/300
4614/4614 [==============================] - 1s 188us/step - loss: 0.0444 - acc: 0.9790
Epoch 213/300
4614/4614 [==============================] - 1s 188us/step - loss: 0.0396 - acc: 0.9809
Epoch 214/300
4614/4614 [==============================] - 1s 186us/step - loss: 0.0418 - acc: 0.9796
Epoch 215/300
4614/4614 [==============================] - 1s 189us/step - loss: 0.0435 - acc: 0.9809
Epoch 216/300
4614/4614 [==============================] - 1s 187us/step - loss: 0.0392 - acc: 0.9818
Epoch 217/300
4614/4614 [==============================] - 1s 188us/step - loss: 0.0393 - acc: 0.9814
Epoch 218/300
4614/4614 [==============================] - 1s 190us/step - loss: 0.0411 - acc: 0.9798
Epoch 219/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0379 - acc: 0.9809
Epoch 220/300
4614/4614 [==============================] - 1s 190us/step - loss: 0.0440 - acc: 0.9796
Epoch 221/300
4614/4614 [==============================] - 1s 188us/step - loss: 0.0403 - acc: 0.9811
Epoch 222/300
4614/4614 [==============================] - 1s 190us/step - loss: 0.0430 - acc: 0.9803
Epoch 223/300
4614/4614 [==============================] - 1s 192us/step - loss: 0.0387 - acc: 0.9814
Epoch 224/300
4614/4614 [==============================] - 1s 186us/step - loss: 0.0386 - acc: 0.9811
Epoch 225/300
4614/4614 [==============================] - 1s 184us/step - loss: 0.0379 - acc: 0.9796
Epoch 226/300
4614/4614 [==============================] - 1s 189us/step - loss: 0.0393 - acc: 0.9824
Epoch 227/300
4614/4614 [==============================] - 1s 189us/step - loss: 0.0387 - acc: 0.9829
Epoch 228/300
4614/4614 [==============================] - 1s 186us/step - loss: 0.0373 - acc: 0.9824
Epoch 229/300
4614/4614 [==============================] - 1s 185us/step - loss: 0.0444 - acc: 0.9794
Epoch 230/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0386 - acc: 0.9803
Epoch 231/300
4614/4614 [==============================] - 1s 188us/step - loss: 0.0371 - acc: 0.9820
Epoch 232/300
4614/4614 [==============================] - 1s 186us/step - loss: 0.0368 - acc: 0.9818
Epoch 233/300
4614/4614 [==============================] - 1s 185us/step - loss: 0.0418 - acc: 0.9811
Epoch 234/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0406 - acc: 0.9801
Epoch 235/300
4614/4614 [==============================] - 1s 189us/step - loss: 0.0421 - acc: 0.9807
Epoch 236/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0420 - acc: 0.9822
Epoch 237/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0380 - acc: 0.9820
Epoch 238/300
4614/4614 [==============================] - 1s 189us/step - loss: 0.0379 - acc: 0.9833
Epoch 239/300
4614/4614 [==============================] - 1s 189us/step - loss: 0.0400 - acc: 0.9809
Epoch 240/300
4614/4614 [==============================] - 1s 185us/step - loss: 0.0366 - acc: 0.9835
Epoch 241/300
4614/4614 [==============================] - 1s 186us/step - loss: 0.0392 - acc: 0.9831
Epoch 242/300
4614/4614 [==============================] - 1s 190us/step - loss: 0.0406 - acc: 0.9794
Epoch 243/300
4614/4614 [==============================] - 1s 188us/step - loss: 0.0386 - acc: 0.9829
Epoch 244/300
4614/4614 [==============================] - 1s 186us/step - loss: 0.0352 - acc: 0.9829
Epoch 245/300
4614/4614 [==============================] - 1s 202us/step - loss: 0.0376 - acc: 0.9792
Epoch 246/300
4614/4614 [==============================] - 1s 212us/step - loss: 0.0355 - acc: 0.9814
Epoch 247/300
4614/4614 [==============================] - 1s 197us/step - loss: 0.0381 - acc: 0.9805
Epoch 248/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0350 - acc: 0.9816
Epoch 249/300
4614/4614 [==============================] - 1s 184us/step - loss: 0.0378 - acc: 0.9818
Epoch 250/300
4614/4614 [==============================] - 1s 196us/step - loss: 0.0361 - acc: 0.9822
Epoch 251/300
4614/4614 [==============================] - 1s 190us/step - loss: 0.0379 - acc: 0.9805
Epoch 252/300
4614/4614 [==============================] - 1s 189us/step - loss: 0.0388 - acc: 0.9816
Epoch 253/300
4614/4614 [==============================] - 1s 190us/step - loss: 0.0363 - acc: 0.9809
Epoch 254/300
4614/4614 [==============================] - 1s 192us/step - loss: 0.0386 - acc: 0.9792
Epoch 255/300
4614/4614 [==============================] - 1s 189us/step - loss: 0.0367 - acc: 0.9807
Epoch 256/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0403 - acc: 0.9818
Epoch 257/300
4614/4614 [==============================] - 1s 190us/step - loss: 0.0326 - acc: 0.9835
Epoch 258/300
4614/4614 [==============================] - 1s 189us/step - loss: 0.0396 - acc: 0.9827
Epoch 259/300
4614/4614 [==============================] - 1s 187us/step - loss: 0.0370 - acc: 0.9833
Epoch 260/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0364 - acc: 0.9805
Epoch 261/300
4614/4614 [==============================] - 1s 190us/step - loss: 0.0328 - acc: 0.9824
Epoch 262/300
4614/4614 [==============================] - 1s 187us/step - loss: 0.0369 - acc: 0.9788
Epoch 263/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0351 - acc: 0.9824
Epoch 264/300
4614/4614 [==============================] - 1s 197us/step - loss: 0.0373 - acc: 0.9798
Epoch 265/300
4614/4614 [==============================] - 1s 192us/step - loss: 0.0409 - acc: 0.9794
Epoch 266/300
4614/4614 [==============================] - 1s 186us/step - loss: 0.0359 - acc: 0.9803
Epoch 267/300
4614/4614 [==============================] - 1s 185us/step - loss: 0.0371 - acc: 0.9807
Epoch 268/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0346 - acc: 0.9840
Epoch 269/300
4614/4614 [==============================] - 1s 188us/step - loss: 0.0335 - acc: 0.9829
Epoch 270/300
4614/4614 [==============================] - 1s 192us/step - loss: 0.0338 - acc: 0.9846
Epoch 271/300
4614/4614 [==============================] - 1s 190us/step - loss: 0.0373 - acc: 0.9809
Epoch 272/300
4614/4614 [==============================] - 1s 188us/step - loss: 0.0344 - acc: 0.9853
Epoch 273/300
4614/4614 [==============================] - 1s 189us/step - loss: 0.0385 - acc: 0.9824
Epoch 274/300
4614/4614 [==============================] - 1s 193us/step - loss: 0.0353 - acc: 0.9822
Epoch 275/300
4614/4614 [==============================] - 1s 184us/step - loss: 0.0369 - acc: 0.9805
Epoch 276/300
4614/4614 [==============================] - 1s 192us/step - loss: 0.0374 - acc: 0.9824
Epoch 277/300
4614/4614 [==============================] - 1s 192us/step - loss: 0.0345 - acc: 0.9822
Epoch 278/300
4614/4614 [==============================] - 1s 189us/step - loss: 0.0400 - acc: 0.9805
Epoch 279/300
4614/4614 [==============================] - 1s 191us/step - loss: 0.0373 - acc: 0.9829
Epoch 280/300
4614/4614 [==============================] - 1s 188us/step - loss: 0.0365 - acc: 0.9809
Epoch 281/300
4614/4614 [==============================] - 1s 183us/step - loss: 0.0339 - acc: 0.9842
Epoch 282/300
4614/4614 [==============================] - 1s 190us/step - loss: 0.0367 - acc: 0.9827
Epoch 283/300
4614/4614 [==============================] - 1s 192us/step - loss: 0.0353 - acc: 0.9801
Epoch 284/300
4614/4614 [==============================] - 1s 184us/step - loss: 0.0304 - acc: 0.9844
Epoch 285/300
4614/4614 [==============================] - 1s 185us/step - loss: 0.0328 - acc: 0.9850
Epoch 286/300
4614/4614 [==============================] - 1s 190us/step - loss: 0.0340 - acc: 0.9816
Epoch 287/300
4614/4614 [==============================] - 1s 189us/step - loss: 0.0353 - acc: 0.9827
Epoch 288/300
4614/4614 [==============================] - 1s 188us/step - loss: 0.0367 - acc: 0.9844
Epoch 289/300
4614/4614 [==============================] - 1s 187us/step - loss: 0.0383 - acc: 0.9801
Epoch 290/300
4614/4614 [==============================] - 1s 188us/step - loss: 0.0342 - acc: 0.9827
Epoch 291/300
4614/4614 [==============================] - 1s 190us/step - loss: 0.0351 - acc: 0.9831
Epoch 292/300
4614/4614 [==============================] - 1s 192us/step - loss: 0.0373 - acc: 0.9796
Epoch 293/300
4614/4614 [==============================] - 1s 185us/step - loss: 0.0376 - acc: 0.9822
Epoch 294/300
4614/4614 [==============================] - 1s 206us/step - loss: 0.0307 - acc: 0.9831
Epoch 295/300
4614/4614 [==============================] - 1s 196us/step - loss: 0.0324 - acc: 0.9853
Epoch 296/300
4614/4614 [==============================] - 1s 190us/step - loss: 0.0382 - acc: 0.9807
Epoch 297/300
4614/4614 [==============================] - 1s 190us/step - loss: 0.0341 - acc: 0.9818
Epoch 298/300
4614/4614 [==============================] - 1s 186us/step - loss: 0.0338 - acc: 0.9827
Epoch 299/300
4614/4614 [==============================] - 1s 187us/step - loss: 0.0327 - acc: 0.9831
Epoch 300/300
4614/4614 [==============================] - 1s 188us/step - loss: 0.0373 - acc: 0.9822
2018-11-07 14:27:41 INFO rasa_core.policies.keras_policy - Done fitting keras policy model
Both modes using the following 
fallback = FallbackPolicy(fallback_action_name="action_default_fallback",
core_threshold=0.1,
nlu_threshold=0.3)
agent = Agent(domain_file,
policies=[KerasPolicy(
MaxHistoryTrackerFeaturizer(BinarySingleStateFeaturizer(),
max_history=4)),fallback],
interpreter=interpreter)
training_data = agent.load_data(training_data_file)
agent.train_online(training_data,
input_channel=input_channel,
batch_size=50,
epochs=300,augmentation_factor = 50)
