The Dataset
You need at least 90 minutes of high-quality data.
Prepare the Dataset
Transcribe the audio with WhisperX. For example, you can use the dataset maker from https://huggingface.co/Jmica/dataset_maker/tree/main.
Use a smaller segment length for transcription.