Sharp Goss texture is crucial for superior magnetic properties of grain oriented silicon steel. The strong initial Goss texture in hot rolled plate will markedly favor the final strong Goss texture. In this paper, different initial textures and microstructures in the surface and center layers of hot rolled plates were established by changing cold rolling direction and their influences on the further evolution of textures and microstructures during first cold rolling, intermediate annealing, secondary cold rolling, decarburizing annealing and secondary recrystallization were investigated. The formation of Goss texture in these specially prepared samples is discussed in details. The results show that the strong differences in initial microstructures and textures vanished gradually as increased times of rolling and annealing, and secondary recrystallization progressed smoothly and nearly independent on rolling directions. The discrepancies of the sharpness of Goss texture and magnetic properties between different samples exhibited minor. The insufficient Goss grains can be compensated through the relatively stronger {111}<112> texture formed in all processing stages, although Goss textures in initial samples show different intensities, therefore the rolling direction and initial structure show little influence on secondary recrystallization. Furthermore, results demonstrate the heritage of cube texture and effective elimination of  {112}<110> texture by 90^o rotation of sheet around normal direction (ND).