The House of Commons Library has produced a very useful document on sources of statistics for 27 subject areas covered by the Economic Policy & Statistics and Social & General Statistics sections of the House of Commons Library.

You can download the document as a PDF.