How to track progress with nlp.pipe function of spacy?

bash_bob

I'm coding with Python and Spacy. I want to track the progress of the execution of nlp.pipe(sentences) because it lasts a lot. How to do that? nlp = spacy.load('en_core_web_sm') sentences = [...] docs = nlp.pipe(sentences, n_process=8)

Originally asked by Marco on Stack Exchange (stackoverflow) (CC BY-SA 4.0).

uphilltech

Great question — answering as the UphillTech team:

Use tqdm . from tqdm import tqdm nlp = spacy.load('en_core_web_sm') sentences = [...] for doc in tqdm(nlp.pipe(sentences, n_process=8)): ... do stuff ...

Full answer by polm23: https://stackoverflow.stackexchange.com/a/68158813 (CC BY-SA 4.0).

Need it done for your business? UphillTech.