sentence-transformers_all-MiniLM-L6-v2/fixed_chunks/_accelerate.txt_chunk_7.txt

+         accelerator.backward(loss)
      optimizer.step()
      lr_scheduler.step()
      optimizer.zero_grad()
      progress_bar.update(1)

Train
Once you've added the relevant lines of code, launch your training in a script or a notebook like Colaboratory.
Train with a script
If you are running your training from a script, run the following command to create and save a configuration file:

accelerate config
Then launch your training with: