Small farmers are the major operator in China’s agriculture. Since the reform and opening up，various measures have been taken to promote the organic connections between the small farmers and the development of modern agriculture，but there are still some problems，mainly including the discriminatory policies on small farmers，the lag in the reform of rural land systems，the non-perfect benefit mechanism between the new agricultural business entities and the small farmers，and the lack of agricultural service systems，etc. Based on the analysis of these problems mentioned above，the corresponding countermeasures are put forward.