Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add grandma substance synth probe, update docs and var names #763

Merged
merged 4 commits into from
Jul 1, 2024
Merged

add grandma substance synth probe, update docs and var names #763

merged 4 commits into from
Jul 1, 2024

Conversation

leondz
Copy link
Owner

@leondz leondz commented Jun 28, 2024

No description provided.

@leondz leondz added the probes Content & activity of LLM probes label Jun 28, 2024
jmartin-tech
jmartin-tech reviewed Jun 28, 2024
View reviewed changes
Copy link
Collaborator

@jmartin-tech jmartin-tech left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I see some opportunity to make this more flexible, accepting prompt values to test for via config could be error prone however since the yaml would only support basic class types this seems like a nice power user option.

garak/probes/grandma.py Outdated Show resolved Hide resolved
garak/probes/grandma.py Outdated Show resolved Hide resolved
garak/probes/grandma.py Outdated Show resolved Hide resolved
@leondz leondz merged commit 4177f90 into main Jul 1, 2024
6 checks passed
@leondz leondz deleted the update/grandma_napalm branch July 1, 2024 04:16
@github-actions github-actions bot locked and limited conversation to collaborators Jul 1, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@jmartin-tech jmartin-tech jmartin-tech left review comments

Assignees
No one assigned
Labels
probes Content & activity of LLM probes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@leondz @jmartin-tech