The Earth System Science Community Curriculum Testbed

Evaluation and Planning

Evaluation is an essential part of scientific inquiry as well as the design process. The evaluation effort proposed for this project aims to guide the ongoing development of the ESS curriculum, technological infrastructure, and the ESS community. This effort will be primarily formative and iterative (Flagg, 1990), however, specific summative outcomes that accrue as a result of student and faculty experience will be generalizable to other educational settings. Evaluation in the form of hypothesis testing and revision is a part of the process of inquiry taught in the ESS curriculum.

This evaluation plan is unique involving all participants in constructing and revising the curriculum and electronic tools as an integral part of the learning process; thus, an object of instruction is extended and exemplified through the evaluation itself. The evaluation becomes a means to learn about scientific inquiry as well as a means to assess and revise the curriculum and tools. The approach is multi-faceted in terms of criteria, participants, and instrumentation and depends on triangulation of results to reach conclusions (Marchionini, 1989). The plan will be implemented in three phases that correspond to the development of curricula, electronic tools, and the ESS community during the first year of the project; expansion of the curriculum and community during the second year; and sustainability actions during the third year. Because the ESS depends on communication and collaboration made possible by Internet, the evaluation will provide evidence for similar educational efforts that take advantage of the national information infrastructure. Furthermore, the tools and methods developed for assessing communication and collaboration will themselves become part of the national information infrastructure.

The evaluation will focus on criteria related to five goals of the project, 1) producing and aggregating valid and accurate content and activities related to ESS; 2) learning outcomes for individual students, teams of students, mentors, and faculty, and the ESS community as a whole; 3) development of electronic systems and interfaces; 4) creating a communication environment through networking that allows diverse groups of students and scientists to exchange ideas and collaborate on science problems; and 5) using this environment to foster collaboration skills as a form of critical thinking and professional work. Each of these goals generate questions that will serve to guide the evaluation. Drawing upon the information in the formative evaluation of participating faculty, we propose to assess and document requirements of students and faculty in their implementation of the curriculum. By recording requests for support and advice, we can identify and prioritize needs. We seek to identify the minimal and optimal requirements for carrying out the curriculum.



Forward to Technical Support and Technology Development

The Earth System Science Community Curriculum Testbed

keeler@jacks.gsfc.nasa.gov