A batch is a group of instances from the dataset. Batches are fed into the different phases of the MLOps pipeline, like the training phase, for processing. Batches are used for use cases that do not require real-time or online data, which makes it more resource efficient and simple to use.
You can practice how to run batch inference with MLRun with this tutorial.