Pre-fetching your data can help your data pre-processing pipeline more smoother.
Without pre-fetching, the cpu would wait for the process in the GPU to end, and then start to prepare the next data. You can do this process in parallel if you use pre-fetching. You can apply multiple-thread processing for even more efficient pipeline workflow.