Testing error less than validation error but higher than training error. Is that okay?
23 views (last 30 days)
Show older comments
I am trying a multilayer perceptron with 5 hidden nodes. However the testing error is lower than the validation error and higher than the training error. The coefficient of correlation on the test set is also higher than that on the validation set. Is that acceptable for a network? I've included the regression and performance plots.The generalization is okay according to me; not the best but adequate.
![](https://www.mathworks.com/matlabcentral/answers/uploaded_files/279062/image.jpeg)
![](https://www.mathworks.com/matlabcentral/answers/uploaded_files/279063/image.jpeg)
Thank you in advance. I am new to neural networks and have been trying different combinations for my project.
0 Comments
Answers (1)
Harsha Priya Daggubati
on 27 Mar 2020
Hi,
Training Set: this data set is used to adjust the weights on the neural network.
Validation Set: this data set is used to minimize overfitting, and adjust the weights to retrain.
Testing Set: this data set is used only for testing the final solution in order to confirm the actual predictive power of the network
Test error is consistently higher than training error: if this is by a small margin, and both error curves are decreasing with epochs, it should be fine. However if your test set error is not decreasing, while your training error is decreasing alot, it means you are over fitting severely.
I dont think you have to be concerned about comparing Validation and Testing Errors. You should be comparing Training Error Vs Validation Error and Training Error Vs Testing Error.
Hope this helps!
See Also
Categories
Find more on Define Shallow Neural Network Architectures in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!