langchain emedding with huggingface can't pass the access token

fixit_fiona

I am creating an index of documents with llama_index and langchain. For the embedding I want to use https://huggingface.co/bert-base-multilingual-cased . I had no problem creating the embedding using the following code: from langchain.embeddings.huggingface import HuggingFaceEmbeddings from llama_index import LangchainEmbedding, ServiceContext embed_model = LangchainEmbedding( HuggingFaceEmbeddings(model_name="bert-base-multilingual-cased") )...

Originally asked by Ire00 on Stack Exchange (stackoverflow) (CC BY-SA 4.0).

uphilltech

Great question — answering as the UphillTech team:

I think you can't use authorization tokens in langchain.embeddings.HuggingfaceEmbeddings but you can surely use hugging face hub if you need to use the authorization tokens. from langchain.embeddings import HuggingFaceHubEmbeddings embeddings = HuggingFaceHubEmbeddings(repo_id='path/to/repo', huggingfacehub_api_token='API_TOKEN')

Full answer by Shuhul Handoo: https://stackoverflow.stackexchange.com/a/76862181 (CC BY-SA 4.0).

Need it done for your business? UphillTech.