-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix some caching issues in the CMS #6697
Merged
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
anathomical
approved these changes
Sep 3, 2020
emilia-friedberg
approved these changes
Sep 4, 2020
cissyxyu
approved these changes
Sep 4, 2020
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the comments!
dandrabik
added a commit
that referenced
this pull request
Sep 4, 2020
Fix some caching issues in the CMS (#6697)
emilia-friedberg
added a commit
that referenced
this pull request
Sep 9, 2020
* Remove references to prefilledText in all LMS apps (#6693) * remove prefill question * new test snapshot * Remove leftover unused write to Firebase (#6695) * try committing everything but yarn lock * put expose loader back because it turns out we do need that * minor c hange so I can deploy again * Add a "last_active" trait to Schools when syncing Vitally This trait is calculated by the last time a student completed an activity assigned by a teacher at this school * Remove an extraneous leftover line * dumb * add check for empty questions array (#6694) * Fix some caching issues in the CMS (#6697) * Fix some caching issues in the CMS * Break out of module to ensure Response called. * Be more specific with our `maximum` call to disambiguate * remove commented out loaders * Add analytics.group calls if current_user.school exists * Tweak tests to account for in-memory vs in-db time precision * Fix the two most common LessonsServer errors and add tests. (#6707) * Install jest. * Add tests for createSession * Fix error with teacher_ids (#6710) Co-authored-by: cissyxyu <57366100+cissyxyu@users.noreply.github.com> Co-authored-by: Anathomical <thomas.robertson@quill.org> Co-authored-by: Eric Adams <erictayloradams@gmail.com> Co-authored-by: dandrabik <dandrabik@users.noreply.github.com>
emilia-friedberg
added a commit
that referenced
this pull request
Sep 9, 2020
* Remove references to prefilledText in all LMS apps (#6693) * remove prefill question * new test snapshot * Remove leftover unused write to Firebase (#6695) * try committing everything but yarn lock * put expose loader back because it turns out we do need that * minor c hange so I can deploy again * Add a "last_active" trait to Schools when syncing Vitally This trait is calculated by the last time a student completed an activity assigned by a teacher at this school * Remove an extraneous leftover line * dumb * add check for empty questions array (#6694) * Fix some caching issues in the CMS (#6697) * Fix some caching issues in the CMS * Break out of module to ensure Response called. * Be more specific with our `maximum` call to disambiguate * remove commented out loaders * Add analytics.group calls if current_user.school exists * Tweak tests to account for in-memory vs in-db time precision * bunch of clean up in the webpack files * run terser plugin in parallel * start using the cache-loader for jsx and tsx files * tiny change to deploy again * get rid of cache-loader * Fix the two most common LessonsServer errors and add tests. (#6707) * Install jest. * Add tests for createSession * just remove sass-loader from evaluating .css files * Fix error with teacher_ids (#6710) * add the hard source webpack plugin * re-install terser webpack plugin * whitespace change to redeploy * get rid of stuff that really isn't helping Co-authored-by: cissyxyu <57366100+cissyxyu@users.noreply.github.com> Co-authored-by: Anathomical <thomas.robertson@quill.org> Co-authored-by: Eric Adams <erictayloradams@gmail.com> Co-authored-by: dandrabik <dandrabik@users.noreply.github.com>
emilia-friedberg
added a commit
that referenced
this pull request
Sep 9, 2020
* try committing changes * fix memory issue * memory update for prod-cms call * additional speed improvements for webpack (#6702) * Remove references to prefilledText in all LMS apps (#6693) * remove prefill question * new test snapshot * Remove leftover unused write to Firebase (#6695) * try committing everything but yarn lock * put expose loader back because it turns out we do need that * minor c hange so I can deploy again * Add a "last_active" trait to Schools when syncing Vitally This trait is calculated by the last time a student completed an activity assigned by a teacher at this school * Remove an extraneous leftover line * dumb * add check for empty questions array (#6694) * Fix some caching issues in the CMS (#6697) * Fix some caching issues in the CMS * Break out of module to ensure Response called. * Be more specific with our `maximum` call to disambiguate * remove commented out loaders * Add analytics.group calls if current_user.school exists * Tweak tests to account for in-memory vs in-db time precision * Fix the two most common LessonsServer errors and add tests. (#6707) * Install jest. * Add tests for createSession * Fix error with teacher_ids (#6710) Co-authored-by: cissyxyu <57366100+cissyxyu@users.noreply.github.com> Co-authored-by: Anathomical <thomas.robertson@quill.org> Co-authored-by: Eric Adams <erictayloradams@gmail.com> Co-authored-by: dandrabik <dandrabik@users.noreply.github.com> * final round of improvements to our current prod webpack build (#6713) * Remove references to prefilledText in all LMS apps (#6693) * remove prefill question * new test snapshot * Remove leftover unused write to Firebase (#6695) * try committing everything but yarn lock * put expose loader back because it turns out we do need that * minor c hange so I can deploy again * Add a "last_active" trait to Schools when syncing Vitally This trait is calculated by the last time a student completed an activity assigned by a teacher at this school * Remove an extraneous leftover line * dumb * add check for empty questions array (#6694) * Fix some caching issues in the CMS (#6697) * Fix some caching issues in the CMS * Break out of module to ensure Response called. * Be more specific with our `maximum` call to disambiguate * remove commented out loaders * Add analytics.group calls if current_user.school exists * Tweak tests to account for in-memory vs in-db time precision * bunch of clean up in the webpack files * run terser plugin in parallel * start using the cache-loader for jsx and tsx files * tiny change to deploy again * get rid of cache-loader * Fix the two most common LessonsServer errors and add tests. (#6707) * Install jest. * Add tests for createSession * just remove sass-loader from evaluating .css files * Fix error with teacher_ids (#6710) * add the hard source webpack plugin * re-install terser webpack plugin * whitespace change to redeploy * get rid of stuff that really isn't helping Co-authored-by: cissyxyu <57366100+cissyxyu@users.noreply.github.com> Co-authored-by: Anathomical <thomas.robertson@quill.org> Co-authored-by: Eric Adams <erictayloradams@gmail.com> Co-authored-by: dandrabik <dandrabik@users.noreply.github.com> Co-authored-by: cissyxyu <57366100+cissyxyu@users.noreply.github.com> Co-authored-by: Anathomical <thomas.robertson@quill.org> Co-authored-by: Eric Adams <erictayloradams@gmail.com> Co-authored-by: dandrabik <dandrabik@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
WHAT
In the CMS, we have some queries that are taking a very long time and some caches that are never getting set because the payload is too large.
WHY
Generally, fast, cached things are good.
Also, multiple long-running queries at once that miss a cache and take longer than 5 seconds could cause the wave of
ActiveRecord - could not obtain a connection from the pool within 5.000 seconds (waited 5.000 seconds); all pooled connections were in use
that we saw earlier in the day. A class full of students starting the same activity at the same time would create the conditions to make this possible. Trying this fix before adjusting the connection pool size.HOW
responses_for_questions
cache theids
instead of the results, since the results are too large for some questionsmultiple_choice_options
optimize the queries.Screenshots
Memcache error