Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Major] reduce batch size for small datasets, reduce overall epochs for most datasets #1533

Merged
merged 2 commits into from
Feb 14, 2024

Conversation

ourownstory
Copy link
Owner

@ourownstory ourownstory commented Feb 14, 2024

Reducing minimum batch size for better fitting of small datasets.
Reduced number of epochs for faster training times.

@ourownstory ourownstory changed the title reduce minimum batch size from 32 to 8 [Minor] reduce minimum batch size from 32 to 8 Feb 14, 2024
Copy link

github-actions bot commented Feb 14, 2024

Model Benchmark

Benchmark Metric main current diff
YosemiteTemps MAE_val 0.64178 0.56412 -12.1% 🎉
YosemiteTemps RMSE_val 0.92787 0.83161 -10.37% 🎉
YosemiteTemps Loss_val 0.0005 0.0004 -19.76% 🎉
YosemiteTemps MAE 1.092 0.98449 -9.85% 🎉
YosemiteTemps RMSE 1.89124 1.75389 -7.26% 🎉
YosemiteTemps Loss 0.00155 0.00132 -14.91% 🎉
YosemiteTemps time 65.3226 35.08 -46.3% 🎉
EnergyPriceDaily MAE_val 5.55889 5.41157 -2.65%
EnergyPriceDaily RMSE_val 7.12233 6.71538 -5.71% 🎉
EnergyPriceDaily Loss_val 0.02829 0.02525 -10.74% 🎉
EnergyPriceDaily MAE 6.37172 5.94936 -6.63% 🎉
EnergyPriceDaily RMSE 8.53016 7.9833 -6.41% 🎉
EnergyPriceDaily Loss 0.02907 0.02579 -11.28% 🎉
EnergyPriceDaily time 16.5338 15.52 -6.13% 🎉
PeytonManning MAE_val 0.3466 0.34955 0.85%
PeytonManning RMSE_val 0.49808 0.50049 0.48%
PeytonManning Loss_val 0.01752 0.01771 1.07%
PeytonManning MAE 0.34735 0.34653 -0.24%
PeytonManning RMSE 0.48788 0.49312 1.07%
PeytonManning Loss 0.01457 0.01464 0.51%
PeytonManning time 22.5106 12.67 -43.72% 🎉
AirPassengers MAE_val 31.6337 30.6285 -3.18%
AirPassengers RMSE_val 32.6669 31.5254 -3.49%
AirPassengers Loss_val 0.01372 0.01277 -6.87% 🎉
AirPassengers MAE 6.24136 6.16861 -1.17%
AirPassengers RMSE 7.82928 7.85225 0.29%
AirPassengers Loss 0.00063 0.00065 2.72%
AirPassengers time 11.2177 8.29 -26.1% 🎉
Model training plots

Model Training

PeytonManning

YosemiteTemps

AirPassengers

EnergyPriceDaily

Copy link

codecov bot commented Feb 14, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (587b374) 88.40% compared to head (8666ae6) 88.40%.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #1533   +/-   ##
=======================================
  Coverage   88.40%   88.40%           
=======================================
  Files          38       38           
  Lines        5105     5105           
=======================================
  Hits         4513     4513           
  Misses        592      592           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@ourownstory ourownstory changed the title [Minor] reduce minimum batch size from 32 to 8 [Minor] reduce batch size for small datasets, reduce overall epochs for most datasets Feb 14, 2024
@ourownstory ourownstory merged commit e0c95bf into main Feb 14, 2024
10 of 12 checks passed
@ourownstory ourownstory deleted the reduce-min-batch-size branch February 14, 2024 22:41
@ourownstory ourownstory changed the title [Minor] reduce batch size for small datasets, reduce overall epochs for most datasets [Major] reduce batch size for small datasets, reduce overall epochs for most datasets Feb 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant