Add support for other spaCy models for PII detection

[einarbmag]

Is your feature request related to a problem? Please describe.

We want to install NB Defense in resource-constrained environments. The hard-coded en_core_web_trf requirement for PII detection takes up significant amount of memory, and ideally requires a GPU to run reasonably fast.

Describe the solution you'd like

I would like to be able to install any spaCy model I want (e.g. en_core_web_md) and specify which model to use for PII detection using an environment variable or CLI argument.

[badarahmed]

Thanks for filing the issue. We tested with different spacy models and found the results with the non-transformer models disappointing. Transformer model is definitely more resource hungry so it makes sense to try to use smaller models in a resource constrained environment (if you have to).

Please feel free to file a PR. The spacy model is being set in:

nbdefense/nbdefense/plugins/pii.py

Line 394 in d62274e

analyzer = AnalyzerEngine(nlp_engine=SpacyNlpEngine({"en": "en_core_web_trf"}))

and settings can be changed in following places:

nbdefense/nbdefense/constants.py

Line 19 in d62274e

DEFAULT_SETTINGS = {

nbdefense/nbdefense/settings.py

Line 9 in d62274e

class Settings(abc.ABC):