This allows one to later cherry-pick the feature via pip install gnes. We already know that setuptools provides a extras_require field that allows you to define those plugin-like dependencies as following:
Apparently, these optional dependencies are not required for all uses of GNES: people who use GPT2 as text encoder may require pytorch-transformer but not opencv and Tensorflow. As GNES aims to provide a generic solution for multi-modality semantic search, it often requires extra packages from different domains, such as NLP and CV.
But this only runs a vanilla GNES with no fancy deep learning models nor preprocessors. The main dependencies of GNES is very simple: numpy, grpcio, pyzmq and a YAML parser. One problem I was facing when building GNES: Generic Neural Elastic Search is how to effectively control the dependencies in Python.
0 kommentar(er)
