Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

register teal.logger handlers #175

Merged
merged 5 commits into from
Mar 20, 2024
Merged

register teal.logger handlers #175

merged 5 commits into from
Mar 20, 2024

Conversation

pawelru
Copy link
Contributor

@pawelru pawelru commented Feb 1, 2024

@pawelru pawelru changed the title silent logger in tests register teal.logger handlers Feb 1, 2024
Signed-off-by: Pawel Rucki <12943682+pawelru@users.noreply.github.com>
R/zzz.R Show resolved Hide resolved
Signed-off-by: Pawel Rucki <12943682+pawelru@users.noreply.github.com>
@pawelru pawelru marked this pull request as ready for review March 11, 2024 17:01
Copy link
Contributor

github-actions bot commented Mar 11, 2024

badge

Code Coverage Summary

Filename                          Stmts    Miss  Cover    Missing
------------------------------  -------  ------  -------  ------------------------------------------------------------------------------
R/all_choices.R                       1       0  100.00%
R/call_utils.R                      156     124  20.51%   19-28, 65, 67, 69, 102-345
R/check_selector.R                   33       0  100.00%
R/choices_labeled.R                 153      27  82.35%   68, 74, 79, 86, 102, 221-225, 229-234, 354-355, 357, 363, 390-397
R/choices_selected.R                 81      11  86.42%   210-238, 275
R/column_functions.R                  3       3  0.00%    15-18
R/data_extract_datanames.R           30       8  73.33%   16-20, 83-85
R/data_extract_filter_module.R      102      47  53.92%   91-104, 106-107, 109-126, 142-161
R/data_extract_module.R             298      67  77.52%   128, 133, 150, 153-158, 160, 179-182, 212-258, 497, 502, 679, 690-691, 769-774
R/data_extract_read_module.R        137       7  94.89%   34, 39-41, 43, 138, 155
R/data_extract_select_module.R       32      18  43.75%   29-46
R/data_extract_single_module.R       60       2  96.67%   30, 43
R/data_extract_spec.R                32       0  100.00%
R/filter_spec.R                     186       1  99.46%   280
R/format_data_extract.R              16       1  93.75%   48
R/get_dplyr_call.R                  297       0  100.00%
R/get_merge_call.R                  278      29  89.57%   32-38, 49, 215-224, 391, 407-419
R/include_css_js.R                    5       0  100.00%
R/input_checks.R                     11       2  81.82%   17-18
R/merge_data_utils.R                  2       0  100.00%
R/merge_datasets.R                  134       6  95.52%   123, 249-253
R/merge_expression_module.R          60      11  81.67%   161-166, 184, 362-367
R/Queue.R                            23       0  100.00%
R/resolve_delayed.R                  16       4  75.00%   78-81
R/resolve.R                         113      44  61.06%   179-285
R/select_spec.R                      64       8  87.50%   99, 179-186
R/utils.R                            37      24  35.14%   33-46, 174-187
R/zzz.R                               3       3  0.00%    2-4
TOTAL                              2363     447  81.08%

Diff against main

Filename      Stmts    Miss  Cover
----------  -------  ------  --------
R/zzz.R          +1      +1  +100.00%
TOTAL            +1      +1  -0.03%

Results for commit: 499273a

Minimum allowed coverage is 80%

♻️ This comment has been updated with latest results

Copy link
Contributor

github-actions bot commented Mar 11, 2024

Unit Tests Summary

  1 files   24 suites   6s ⏱️
189 tests 189 ✅ 0 💤 0 ❌
659 runs  659 ✅ 0 💤 0 ❌

Results for commit 499273a.

♻️ This comment has been updated with latest results.

@pawelru pawelru added the core label Mar 14, 2024
Copy link
Contributor

@gogonzo gogonzo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Woop woop 🙌

pawelru added a commit to insightsengineering/teal.logger that referenced this pull request Mar 20, 2024
close insightsengineering/coredev-tasks#502
#69

I tried to use `logger::log_messages()` (and similar functions for
warnings and errors) but I have encounter following problems:
- this is logging into the global logger namespace whereas we want
particular (package) namespace instead - created an issue
- I cloned logger locally and fixed / enhanced the above but then I
realized that the (global) message / warning / stop calls from the
outside of a package will also log to that package logger namespace. In
other words, these are _global_ handlers for all the warnings and not
only warnings created inside `teal` e.g.
```
r$> warning(1)
[WARN] 2024-01-26 15:58:17.0061 pid:83248 token:[] teal 1
Warning message:
1
```

Therefore I have decided to implement own register handlers mechanism. I
initially started doing this separately inside each package but then I
realised that it's not so DRY and decided to extend core `teal.logger`
functionality.

This is not a reprex as I modified `teal` and `teal.slice` namespaces in
a following way:
- added `register_handlers(<pkg>)` in both packages
- For debugging: added following definitions:
  - `teal.slice`:
    - `teal_s_message` calling `message()`
    - `teal_s_warning` calling `warning()`
    - `teal_s_stop` calling `stop()`
  - in `teal`:
    - `teal_message` calling `message()`
    - `teal_warning` calling `warning()`
    - `teal_stop` calling `stop()`
- `teal_message_nested` calling `teal_s_message()` (so as to simulate
`teal` calling `teal.slice`)
    - `teal_warning_nested` calling `teal_s_warning()`
    - `teal_stop_nested` calling `teal_s_stop()`

The outcome:

```
r$> devtools::load_all("teal.logger")
r$> devtools::load_all("teal.slice")
r$> devtools::load_all("teal")

r$> message(1)
1
r$> teal_message(1)
[INFO] 2024-01-26 15:57:40.8901 pid:83248 token:[] teal 1
1
r$> teal_s_message(1)
[INFO] 2024-01-26 15:57:42.1464 pid:83248 token:[] teal.slice 1
1
r$> teal_message_nested(1)
[INFO] 2024-01-26 15:57:50.9231 pid:83248 token:[] teal 1
[INFO] 2024-01-26 15:57:50.9257 pid:83248 token:[] teal.slice 1
1

r$> warning(2)
Warning message:
2 
r$> teal_s_warning(2)
[WARN] 2024-01-26 15:58:17.0061 pid:83248 token:[] teal.slice In ‘teal_s_warning(2)’: 2
Warning message:
In teal_s_warning(2) : 2
r$> teal_warning(2)
[WARN] 2024-01-26 15:58:18.4165 pid:83248 token:[] teal In ‘teal_warning(2)’: 2
Warning message:
In teal_warning(2) : 2
r$> teal_warning_nested(2)
[WARN] 2024-01-26 15:58:20.8666 pid:83248 token:[] teal In ‘teal.slice:::teal_s_warning(message)’: 2
[WARN] 2024-01-26 15:58:20.8685 pid:83248 token:[] teal.slice In ‘teal.slice:::teal_s_warning(message)’: 2
Warning message:
In teal.slice:::teal_s_warning(message) : 2

r$> stop(3)
Error: 3
r$> teal_s_stop(3)
[ERROR] 2024-01-26 15:58:32.9558 pid:83248 token:[] teal.slice In ‘teal_s_stop(3)’: 3
Error in teal_s_stop(3) : 3
r$> teal_stop(3)
[ERROR] 2024-01-26 15:58:33.5246 pid:83248 token:[] teal In ‘teal_stop(3)’: 3
Error in teal_stop(3) : 3
r$> teal_stop_nested(3)
[ERROR] 2024-01-26 15:58:34.0213 pid:83248 token:[] teal In ‘teal.slice:::teal_s_stop(message)’: 3
[ERROR] 2024-01-26 15:58:34.0226 pid:83248 token:[] teal.slice In ‘teal.slice:::teal_s_stop(message)’: 3
Error in teal.slice:::teal_s_stop(message) : 3
```

Interpretation (where "m/w/s" stands for "message / warning / stop"):
- global m/w/s is not impacted - we only capture m/w/s called from
inside the package
- capturing m/w/s in the appropriate logger namespace - see it as a part
of logger produced string - second last part
- the case of nested calls looks odd at the very first glance but I
think it's correct. Each (package) logger instance might have its own
log threshold, appender function, layout etc. It's expected to have
duplicated logs for each of the registered package namespace found on
the stack of calls. I'm interested in hearing your thoughts on this


PRs:

- [ ] insightsengineering/teal#1081
- [ ] insightsengineering/teal.goshawk#258
- [ ]
insightsengineering/teal.modules.clinical#1010
- [ ]
insightsengineering/teal.modules.general#628
- [ ]
insightsengineering/teal.modules.hermes#354
- [ ] insightsengineering/teal.osprey#252
- [ ] insightsengineering/teal.slice#551
- [ ] insightsengineering/teal.transform#175

(I'll keep them as draft as this is conflicting with release plans
because teal.logger would have to be released first)

TODO: tests - however I'm not yet sure how to make them "clean"

---------

Signed-off-by: Pawel Rucki <12943682+pawelru@users.noreply.github.com>
Co-authored-by: Dawid Kałędkowski <6959016+gogonzo@users.noreply.github.com>
DESCRIPTION Outdated Show resolved Hide resolved
pawelru added 2 commits March 20, 2024 15:23
Signed-off-by: Pawel Rucki <12943682+pawelru@users.noreply.github.com>
@pawelru pawelru enabled auto-merge (squash) March 20, 2024 14:24
@pawelru pawelru merged commit a5cb3f5 into main Mar 20, 2024
24 checks passed
@pawelru pawelru deleted the register_handlers branch March 20, 2024 14:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants