The organic connection between small farmers and modern agriculture is a necessary step for rural revitalization and an effective way to promote agricultural modernization. However，an analysis of relevant data of the third national agricultural survey in Anhui reveals a year-by-year declining of the number of small farmers operating in agriculture，a generally low level of education，a minority regarding the number of those receiving professional and technical trainings，persistent weakness in production and cooperation capabilities，prominent problems regarding the aging of small farmers，and increasingly apparent weakening of market management capabilities. The core factor is that grassroots cadres do not understand well，and small farmers are weak in understanding and accepting new technologies and policies. And the solution？The key is to strengthen top-level design and cultivate the spirit of responsibility for rural cadres；strengthen policy support to boost the confidence of small farmers in organic connection with modern agriculture；constantly improve the operation and management capabilities of small farmers and the organization of agricultural modernization through needs-based trainings；and implement risk prevention and control to enhance the ability of small farmers to accommodate the market.