The experimental results showed that the restoration of main fertility factors of degraded red soils was significantly related to matter input and soil physical and chemical properties. With increase of matter input, the restoration of soil fertility quality was accelerated gradually. Under the natural condition, the restoration of soil fertility factors was mainly controlled by soil properties. In the process of soil fertility restoration, the increase rate of organic matter was affected by the content of soil organic matter. There is a curve relation between the increase rate of organic matter and organic matter contents in the soils. The maximum increase rate of organic matter could be obtained when soil organic matter was about 20 g/kg. The nitrogen increase rate was positively related to soil total nitrogen for soils with nitrogen below 1.0g/kg. However, the increase rate of available potassium was negatively related to available potassium level in soils. The restoration of soil water stable aggregates was related to clay and organic matter contents. It was suggested that the restoration of fertility quality of degraded red soils was possible under reasonable management.