Rural governance is the cornerstone of national governance，and it is necessary to consolidate the foundation at the grassroots level. Effective rural governance not only helps poverty alleviation，but also effectively supports rural revitalization. Taking Linyi city of Shandong Province as a typical study area，this paper firstly analyzes the characteristics and advantages of poverty under the background of poverty alleviation in Yimeng mountain area. Secondly，from the perspective of rural governance，the practice and effectiveness of rural communities in poverty alleviation are analyzed in terms of optimizing industries，strengthening support，village upgrading，multi-participation，and mechanism construction. Finally，the research enlightenment is proposed in order to provide practical reference for other regions.