Issue with workaround: [E002] Can't find factory for 'curated_transformer' for language English (en).

[CaelanBistro]

I started receiving the error below on a script that previously worked:

ERROR:
[E002] Can't find factory for 'curated_transformer' for language English (en). This usually happens when spaCy calls `nlp.create_pipe` with a custom component name that's not registered on the current language class. If you're using a Transformer, make sure to install 'spacy-transformers'. If you're using a custom component, make sure you've added the decorator `@Language.component` (for function components) or `@Language.factory` (for class components).

SOLUTION:
I believe the error is occurring due a change in spacy-transformer dependency. The workaround to this error is to use specific the old version of the library.

pip install scrubadub_spacy "scrubadub==2.0.0" "spacy==3.6.1" "spacy-transformers==1.2.5"

SETUP:
Databricks cluster

Hopefully someone else finds this helpful 😀

[dbusteed]

I had to install scrubadub==2.0.1 to avoid an install error (see this issue), but otherwise this worked for me!