Fix install error from latest version of repo

[AndrewJGaut]

Fixes issue #1616.

This PR does the following:

1. Fix an error that would prevent users from being able to correctly install new releases of crfm-helm
2. Update Github Actions so that install errors are tested for.
3. Update setup.cfg so that pip install -e . works again. (It was missing simple-slurm and an update to the tokenizers version.)

Note on 1): The issue found in #1616 is documented on spaCy's repo here. In short, they have a temporary workaround to use typing-extensions<4.6.0, which is what I use here.

[AndrewJGaut]

Also, I see an Install test here, but it doesn't seem to me that it's actually doing the installation? (e.g. Codalab's test.yml includes a few lines to install the library and test that the command runs.)

[AndrewJGaut]

I also noted that sometimes the setup.cfg isn't updated to reflect changes to requirements.txt (e.g., simple-slurm wasn't added and the tokenizer update was not reflected there).

[yifanmai]

The upstream issue was updated with a note that we can instead pin pydantic~=v1.10.8; could you check if this works?

[AndrewJGaut]

The upstream issue was updated with a note that we can instead pin pydantic~=v1.10.8; could you check if this works?

That does not work for spacy 3.2.4. It mentions in that issue that the fix is forspacy v3.4 and v3.5 and that For spacy v3.2 and v3.3, we have published patch releases with fixes for the typing_extension requirement, so the typing-extensions fix appears to be the correct here.

Moreover, when I try to fix pydantic~=1.10.8 locally and pip install -e ., it fails with:

ERROR: Cannot install crfm-helm, crfm-helm==0.2.2 and spacy==3.2.6 because these package versions have conflicting dependencies.

The conflict is caused by:
    crfm-helm 0.2.2 depends on pydantic~=1.10.8
    spacy 3.2.6 depends on pydantic!=1.8, !=1.8.1, <1.9.0 and >=1.7.4
    crfm-helm 0.2.2 depends on pydantic~=1.10.8
    spacy 3.2.5 depends on pydantic!=1.8, !=1.8.1, <1.9.0 and >=1.7.4
    crfm-helm 0.2.2 depends on pydantic~=1.10.8
    spacy 3.2.4 depends on pydantic!=1.8, !=1.8.1, <1.9.0 and >=1.7.4

So, spacy 3.2.4 depends on pydantic!=1.8, !=1.8.1, <1.9.0 and >=1.7.4. Thus, unless we want to upgrade spacy in addition to pydantic, I don't think that fix will work, sorry!

[yifanmai]

Can we also upgrade Spacy to v3.4? Are there any breaking changes?

[AndrewJGaut]

Can we also upgrade Spacy to v3.4? Are there any breaking changes?

Ah, yes, we can! That works. We don't even need to pin the pydantic version since those versions of spacy automatically install a high enough version. Sorry, I didn't know if updating spacy was an option.

[yifanmai]

Looking at the upgrade notes, I think this should be safe.

• 3.3
• 3.4
• 3.5