We used laboratory experiments to simulate the early evolution of rift systems, and the influence of structural weaknesses left over from previous tectonic events that can localize new deformation. We find that the orientation and type of such weaknesses can induce complex structures with different orientations during a single phase of rifting, instead of requiring multiple rifting phases. These findings provide a strong incentive to reassess the tectonic history of various natural examples.