Esl Textbook Evaluation: a Composite Framework

The writer developed an alternative to traditional checklist-based textbook evaluation by assembling a composite framework. A 4-phase procedure was used in the development of the framework. Phase 1 tested the Skierso Evaluation Checklist (SEC) for reliability and item difficulty. Phase 2 tested the capabilities of the concordance software (WordSmith Tools 3.0) to provide data on the patterns of presentation of vocabulary and structures in textbooks; to determine the extent to which the software would help discriminate between the books; and to determine to what extent the analysis would provide greater illustration to responses to items in Section D of the SEC. Phase 3 tested the capabilities of the reflective journal in providing greater illustration to responses to items in Section E (Exercises and Activities) of the SEC. Finally, in Phase 4 the writer assembled aspects of the two complementary components into a framework which had the checklist as the main instrument. The framework was tested for reliability and item difficulty. It was found to be higher in reliability than the checklist. This book can be a useful reference for materials evaluators and post-graduate students.