DFN3, the most prevalent X-linked hearing loss, is caused by mutations in the POU3F4 gene. Previous studies in Pou3f4 knockout mice suggest that defective otic fibrocytes in the spiral ligament of the cochlear lateral wall may underlie the hearing loss in DFN3. To better understand the pathological mechanisms of the DFN3 hearing loss, we analyzed inner ears of Pou3f4-deficient mice during development. Our results indicate that compartmentalization of the spiral ligament mesenchyme setting up boundaries for specific otic fibrocytes occurs normally in Pou3f4-deficient cochlea. However, differentiation of the compartmentalized mesenchyme into specific otic fibrocytes was blocked in the absence of Pou3f4 function. In addition, we found that stria vascularis in the cochlear lateral wall was also affected in Pou3f4-deficient cochlea. Unlike the otic fibrocytes, differentiation of stria vascularis was completed in the absence of Pou3f4 function, yet expression of Kir4.1 channels in the strial intermediate cells, essential for the sound transduction, was lost afterwards. These results suggest that Pou3f4 deficiency causes defects in both otic fibrocytes and stria vascularis at different developmental stages and by different pathological mechanisms, which may account for the progressive nature of DFN3 hearing loss.