In the automotive industry, structural components are often produced via press hardening, enabling rapid production and the use of ultra-high-strength steels. In this process, steels are heated to an austenitic state and are then formed and quenched in rapid succession. The initial steel that enters the press-hardening production line varies, where the microstructure is a result of previous production steps. This work was performed to investigate the possible effects of the initial microstructure on the final mechanical properties for rapidly quenched samples. Although the initial microstructure is transformed during austenitization, the steel can still be affected by its prior history. Steels with three different initial microstructures were evaluated, with only minor variations in chemical composition and thicknesses. The Lankford coefficients and the failure strains were dependent on the orientation of the samples. However, for a given orientation, there were only minor variations between the different steels with respect to anisotropy, strength, and ductility. The anisotropy could be correlated with the microstructure through the calculation of Taylor factors based on measurements using electron backscatter diffraction. The minor influence from the initial steel microstructure on the final mechanical properties indicates robustness suitable for mass production.