This repository has been archived by the owner on Nov 16, 2023. It is now read-only.
add deconvnet and unet correctness train, val and test metrics as a unit test - facilitates certainty in results #318
Labels
Prior: High
Type: Bug
Something isn't working
Type: Correctness
anything to do with repo being technically correct
Milestone
add performance metrics similar to test/cicd/src/check_performance.py to quantify whether the models are training correctly on train and test sets on dummy synthetic checkerboard dataset
eventually this should be added as a unit test to increase code coverage
Patch-deconvnet: Need to investigate why the metrics are not close to perfect on checkerboard dataset, like with the UNet model – Pixel Accuracy has to be close to 1 on both training and validation set, Class Accuracy has to be close to 1.0, FW IoU, IoU, etc
For UNet model, modifying check_performance.py is relatively straightforward - metrics come out near-perfect on checkerboard dataset. But for patch-devonvnet, debugging is needed.
The text was updated successfully, but these errors were encountered: