Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

== Not working for Runset filters? #34

Open
dnievesacaro2018 opened this issue Oct 7, 2024 · 2 comments
Open

== Not working for Runset filters? #34

dnievesacaro2018 opened this issue Oct 7, 2024 · 2 comments

Comments

@dnievesacaro2018
Copy link

Good morning. It seems that using the == operator in the runsets isn't working for me. In contrast, I can get the filters I want by using the in [ ] operator. Other filters such as the != operator seem to work. Does anyone know why this is?

Working

Image

Working

Image

Not Working

Image

@DavidEnriqueNieves
Copy link

Update: my workaround of checking using in some_list isn't working when using multiple filters. I attached an example here:

Image
This was after I had inspected the format of a previous report by using from_url() to load in the report object and print out each block. I noticed that the filters for that report's outputs could be found like so:

PanelGrid(runsets=[Runset(name='Run set', filters='((Config("dataset.value.name") in [I.6.2] and Config("module.value.model.hidden_layer_widths") in [[2, 2]]) and Config("module.value.model.hidden_layer_widths") == [2, 2])', order=[OrderBy(name=Metric(name='CreatedTimestamp'), ascending=False)])], panels=[ ... ], active_runset=0, custom_run_colors={'ref': {'type': 'run-colors', 'viewID': '8p9jw15lw', 'id': '6g1baxfzl'}})

PanelGrid(runsets=[Runset(name='Run set', filters='(Metric("group") == \'feynman_sweeps\' and Config("dataset.value.name") == \'I.6.2\' and Config("module.value.model.kan_k") == 10 and Config("module.value.model.hidden_layer_widths") == [2, 2])', order=[...], panels=[...], active_runset=0, custom_run_colors={'ref': {'type': 'run-colors', 'viewID': 'tch7w0rdw', 'id': 'ugiko91ab'}})

.. where the output above was obtained by using this code and specifically copying the output from the panel grid section:

report_thing = wr.Report.from_url(my_reports_url)
for block in report_thing.blocks:
    print("\n")
    print(block)
    print(dir(block))
    if isinstance(block, wr.PanelGrid):
        print("Panel Grid detected")
        break

Could anyone explain how the filtering of the runsets works should be formatted for joint filters to work?

Based off the documentation here, and here, I'm noticing that the filters have to get parsed into a "mongo-ish" format, but I still don't understand why my joint filters aren't working.

@DavidEnriqueNieves
Copy link

Any updates?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants