fix the case when segments has different #lines from wav.scp (#413) #901

Job	Run time
linter_and_test (3.7, 1.4)	5m 33s
linter_and_test (3.7, 1.5.1)	4m 28s
linter_and_test (3.7, 1.7.1)	6m 8s
linter_and_test (3.7, 1.8.1)	3m 36s
linter_and_test (3.7, 1.9)	5m 25s
linter_and_test (3.7, 1.10.2)	3m 39s
linter_and_test (3.7, 1.11.0)	3m 35s
linter_and_test (3.7, 1.12.1)	4m 45s
linter_and_test (3.7, 1.13.1)	6m 17s
integration_vq (3.8, 1.13.1, melgan_vae.v3.debug.yaml)	2m 31s
integration_vq (3.8, 1.13.1, conditioned_melgan_vae.v3.debug.yaml)	3m 23s
integration_vq (3.8, 1.13.1, local_conditioned_melgan_vae.v3.debug.yaml)	4m 31s
integration_segments (3.9, 1.13.1)	4m 3s
integration (3.9, 1.13.1, parallel_wavegan.v1.debug.yaml)	3m 27s
integration (3.9, 1.13.1, melgan.v1.debug.yaml)	3m 30s
integration (3.9, 1.13.1, melgan.v3.debug.yaml)	2m 58s
integration (3.9, 1.13.1, multi_band_melgan.v1.debug.yaml)	3m 4s
integration (3.9, 1.13.1, parallel_wavegan.v1.debug.npy.yaml)	3m 50s
integration (3.9, 1.13.1, parallel_wavegan.v1.debug.diff_fs.yaml)	3m 59s
integration (3.9, 1.13.1, hifigan.v1.debug.yaml)	3m 19s
integration (3.9, 1.13.1, style_melgan.v1.debug.yaml)	3m 44s
integration (3.9, 1.13.1, uhifigan.v1.debug.yaml)	3m 59s
	1h 29m 44s

Provide feedback