Transformers Models from HuggingFace When
specifying and running a language model for the first time in
textEmbed()
, the python package transformers will
automatically download it from HuggingFace. These models can be rather
large (a few GB), so you might want to remove models that you have no
use for anymore.
library(text)
# Check downloaded, available models.
textModels()
# Delete a specified model and model associated files.
textModelsRemove("name_of_model_to_be_removed")
Advanced By default the files necessary to run the model are
downloaded to the .cache folder. To see the hidden .cache folder on a
Mac go to /Users/USER_NAME/
in Finder and press:
CMD + SHIFT + .
This reveals the .cache folder and its
enclosed folders and files. Go to:
/Users/USER_NAME/.cache/torch/transformers/
to find those
files that have been downloaded by transformers.
Note that these files are awkwardly named (e.g.,
c146cc96724f27295a0c3ada1fbb3632074adf87…
); but you might
want to remove the larger files and then just re-run the
textEmbed()
again to download the models you want to use
again.