皮书内容评价是对皮书的内容质量进行考察,皮书内容评价指标体系,既包括研究主题的价值与意义、科学性、前沿性、规范性、时效性、应用性等主观性指标,实证性、出版时间、书稿要件等客观性指标,又根据皮书的特点和要求设置了加分项和减分项。报告分析了2014~2018年皮书内容评价的总体情况、各指标的得分率,特别是前100名皮书的类别分布、研创机构分布、主题分布等。通过皮书评价,发现皮书内容质量存在以下几个问题:数据再加工不足;报告名、摘要、关键词撰写不规范;内容框架逻辑性不强;出版时间不规律,数据时间表述不清;内容重复率较高。未来皮书评价和研创应设置针对不同类别皮书的内容评价指标体系;吸纳更多相关领域的评审专家,进一步完善同行评审制度;扩大《皮书手册:写作、编辑出版与评价指南》的使用范围;严格执行准入退出机制;探索皮书选题指导制度。
<<Pishu publications are subject to evaluation of the merit of their contents. A Pishu evaluation index system in working order is now in place that allows evaluators to rate individual Pishu publication in the following respects:the significance of the subject matter,its scientific import,impact of the research on the wider academic community,how appropriately timed its publication was and its practical implications. These are in addition to basic requirements included in any industry guidelines governing the publication of research reports such as the yearbooks. Items have also been identified that correspond to indicators on which points can be either added or deducted. This chapter is a meta-analysis of Pishu evaluation reports compiled in 2014~2018. On the basis of how the different Pishu titles were graded in these reports,the 100 top-ranked Pishus were identified,and analyzed in terms of the topics they cover and the research teams responsible for them. The meta-analysis shows that many Pishu publications fall short with respect to statistical analysis,consistency in style,structural soundness,timing regularity,and content originality. Improving Pishu evaluation calls for more rigorous peer review,subject area-specific evaluation,stronger enforcement of Pishu style guide,and publication-worthiness requirements.
<<Keywords: | Academic EvaluationPishuPeer Review |