Taking Gaxigou Village, Mizhi County, Yulin City, a typical village in northern Shaanxi Province, as an example, the changes of land use landscape pattern and its driving factors under soil and water conservation measures were explored, and it had guiding significance for soil and water conservation, landscape pattern optimization, beautiful countryside construction and ecological sustainable development in the loess hilly region. Based on the remote sensing images of Gaoxigou in 1986, 2004 and 2022, with the help of ArcGIS, ERDAS and FRAGSTATS software, the land use change was analyzed by using the dynamic degree, transfer matrix and landscape pattern index, and the driving factors were discussed. The results showed that: (1) Forestland and grassland were the dominant land types, accounting for about 80% of the total area of Gaoxigou. Arable land and unused land showed a decreasing trend, while water area and construction land had no significant change. The comprehensive dynamic degree of land use gradually decreased and the change of land use tended to be stable. (2) The change area of forestland in the study area was the most significant, mainly change from arable land, and the overall increase area of forestland was 112 hm². The arable land was mainly changed from grassland, while the unused land changed to grassland. (3) Forestland was the most dominant patch in Gaoxigou land use landscape pattern, with the highest degree of fragmentation, and the patches of various landscape types in the study area formed a relatively stable connection with good landscape connectivity. The overall landscape pattern evolved dispersedly, and the area gap of each landscape type was becoming larger and larger. The dominant landscape was obvious, and the overall fragmentation degree was high. (4) Land use change in Gaoxigou was affected by soil and water conservation, industrial structure and related policies. Soil and water conservation was the main driving factor for the reduction of cultivated land, the development of unused land and the increasing of forest and grass area in Gaoxigou. The adjustment of industrial structure and national policy and financial support were the auxiliary influencing factors for the optimization of land use landscape pattern in Gaoxigou.