Columnar grains show their special characteristics of morphological and crystallographic anisotropies, and thus markedly influence the microstructure and texture evolution during rolling and annealing process in electrical steel. The rolling and annealing microstructure and texture of three columnar grained samples with the long axes arranged along different directions were investigated by means of XRD and EBSD techniques, and the effects of columnar grain boundaries were analyzed from the view point of geometry-induced interaction and orientation-induced interaction. The results indicated that, prominent microstructure and texture gradients caused by the surface shearing during hot rolling inherited to subsequent cold rolling and annealing in columnar grained samples. The difference in morphological anisotropy of initial columnar grain boundaries in the three samples were eliminated after hot rolling, while a same type structure of anisotropic grain boundaries was formed. However, the crystallographic anisotropies of the samples were changed before cold rolling, and it caused that the evolution of the microstructure and texture during subsequent cold rolling and annealing was different with directly cold rolling process in previous work. This feature produced a graded microstructure and texture relationship between hot rolled samples and finally annealed samples. In this work, it mainly focused on the {100}-oriented regions at grain boundaries, because the {100} texture was most beneficial to the magnetic property of electrical steel.