The continuous northward movement of the Indian Plate lead to the extrusion of the Qinghai-Tibet Plateau, finally leading to an eastward extrusion of the North China block（NCB）at end Miocene. At about 7.3 Ma, the breakup of the Tangxian planation surface first took place in the Weihe Basin, then propagating eastward and northward. At about 5 Ma, the eastern Taihang Mountain fault zone began to right-laterally slip, resulting in regional breakup of the Tangxian planation surface, the development of the intermontane basins inside the Taihang Mountains and the Shanxi graben system to the west of the Taihang Mountains. The amplitudes of downfaulting of these basins are different, which are larger in the Shanxi Graben System than in the intermontane basins within the Taihang Mountains. With the formation of the basins, the Taihang Mountains began to uplift rapidly. Field investigation shows that the eastern Taihang Mountain fault zone is still active, cutting and controlling the deposition of the Quaternary, and resulting in ground fissures. The study of paleostress field and deep structures of the central NCB reveals that deep mantle upwelling played an important role in the formation of surface basins. Deep tectonics and shallow structures have a good or highly concordance and coupling. The Bohai Bay Basin on the east of the Taihang Mountains entered a stage of depression since the Miocene with weak fault activities, which show large difference with the west counterpart, implying the dynamics derived from the west, rather than the east. The eastern Taihang Mountain fault is a boundary of the two parts, adjusting the different tectonic activities between them.