Readability formulas are extremely useful for assessing the difficulty of texts for long-form exam questions.However, most are aimed at L1 readers and do not specifi cally examine the text from an L2 viewpoint. The CEFRproject of the Council of Europe has gone a long way to redressing this problem. This paper looks at a range of thedifferent formulas and vocabulary lists, and adds a further list, the level at which the vocabulary is introduced toJapanese school students. The paper outlines the construction of a spreadsheet to apply this list plus other lists andformulas to texts. The results are then compared with those provided by online readability formulas.