The main objective of this study is to examine the effects of fragmentation on farm productivity in China and to discuss policy implications. Some earlier work has questioned the importance of the economic costs of land fragmentation in developing economies. It has been argued that policymakers should focus instead on reducing the root causes of fragmentation: inefficiencies in land, labour, credit, and food markets. Our results, using a more recent and larger dataset from a household survey in China, find that fragmentation does have an economic cost in China. Production functions are estimated for each of the major grain crops in the sample provinces. We also argue that to reduce the economic costs, land consolidation in China should be undertaken with less government intervention. More attention should be given to the establishment of markets for land (or land use rights) and improvements in rural credit and grain markets.