Non-Experimental Evaluation of Curriculum Effectiveness in Math, A

Education and Literacy

Non-Experimental Evaluation of Curriculum Effectiveness in Math, A

We use non-experimental data from a large panel of schools and districts in Indiana to evaluate the impacts of math curricula on student achievement. Using matching methods, we obtain causal estimates of curriculum effects at just a fraction of what it would cost to produce experimental estimates. Furthermore, external validity concerns that are particularly cogent in experimental curricular evaluations suggest that our non-experimental estimates may be preferred. In the short term, we find large differences in effectiveness across some math curricula. However, as with many other educational inputs, the effects of math curricula do not persist over time. Across curriculum adoption cycles, publishers that produce less effective curricula in one cycle do not lose market share in the next cycle. One explanation for this result is the dearth of information available to administrators about curricular effectiveness.

August 1970

Geographic Focus: North America-United States (Midwestern)-Indiana

Teach For America: A Review of the Evidence

Education and Literacy

Teach For America: A Review of the Evidence

Teach For America has generated glowing press reports, but the evidence regarding whether this alternative teacher-training program works is very unclear, according to a policy brief released today by the Great Lakes Center for Education Research and Practice. The brief, Teach For America: A Review of the Evidence, is written by professor Julian Vasquez Heilig of the University of Texas at Austin, and professor Su Jin Jez of California State University, Sacramento. It offers a comprehensive overview of research on the Teach For America (TFA) program, which recruits graduates of elite colleges to teach for two years in hard-to-staff low-income rural and urban schools. Overall, Jez and Heilig argue, the impact of TFA teachers on student achievement is decidedly mixed and dependent upon the experience level of the TFA teachers and the group of teachers with whom they are compared. Studies show that TFA teachers perform fairly well when compared with one segment of the teaching population: other teachers in the same hard-to-staff schools, who are less likely to be certified or traditionally prepared. Compared with that specific group of teachers, TFA teachers "perform comparably in raising reading scores and a bit better in raising math scores," the brief's authors write. Conversely, studies which compare TFA teachers with credentialed non-TFA teachers find that "the students of novice TFA teachers perform significantly less well in reading and mathematics than those of credentialed beginning teachers," Heilig and Jez write. And in a large-scale Houston study, in which the researchers controlled for experience and teachers' certification status, standard certified teachers consistently outperformed uncertified TFA teachers of comparable experience levels in similar settings. The evidence suggests that TFA teachers do get better -- if they stay long enough to become fully credentialed. Those experienced, fully credentialed TFA teachers "appear to do about as well as other, similarly experienced, credentialed teachers in teaching reading ... [and] as well as, and sometimes better than, that comparison group in teaching mathematics," Heilig and Jez write. However, more than half of TFA teachers leave after two years, and more than 80 percent after three. So it's impossible to know whether those who remain have improved because of additional training and experience -- or simply because of "selection bias:" they were more effective than the four out of five TFA teachers who left. The authors note that this high turnover of TFA teachers also results in significant recurring expenses for recruiting and training replacements. Heilig and Jez urge schools and districts to devote resources to a number of proven remedies for improving achievement, including mentoring programs that pair novice and expert teachers, universal pre-school and reduction in early grade class size. The authors conclude, "Policymakers and stakeholders should consider TFA teachers for what they are -- a slightly better alternative when the hiring pool is comprised primarily of uncertified and emergency teachers -- and continue to consider a broad range of solutions to reshape our system of education to ensure that all students are completing schools with the education they need to be successful."

This policy brief was produced by the Education and the Public Interest Center (EPIC) at the University of Colorado and the Education Policy Research Unit (EPRU) at Arizona State University with funding from the Great Lakes Center for Education Research and Practice. About The Great Lakes Center The mission of the Great Lakes Center is to improve public education for all students in the Great Lakes region through the support and dissemination of high quality, academically sound research on education policy and practices.

August 1970

Geographic Focus: North America / United States

Teacher Salaries and Teacher Unions: A Spatial Econometric Approach

Education and Literacy, Employment and Labor

Teacher Salaries and Teacher Unions: A Spatial Econometric Approach

This paper uses the Schools and Staffing Survey to examine the determinants of teacher salaries in the U.S. using a spatial econometric framework. These determinants include teacher salaries in nearby districts, union activity in the district, union activity in neighboring districts, and other school district characteristics. The results confirm that salaries for both experienced and beginning teachers are positively affected by salaries in nearby districts. Investigations of the determinants of teacher salaries that ignore this spatial relationship are likely to be mis-specified. Including the effects of union activity in neighboring districts, the study also finds that union activity increases salaries for experienced teachers by as much as 18-28 percent but increases salaries for beginning teachers by a considerably smaller amount.

August 1970

Geographic Focus:

Review of Expanding Choice in Elementary and Secondary Education: A Report on Rethinking the Federal Role in Education

Education and Literacy

Review of Expanding Choice in Elementary and Secondary Education: A Report on Rethinking the Federal Role in Education

Scott's review of this report finds that it lacks the evidence to support the call for an expansion of school choice. Scott identifies three major shortcomings in the report: it relies too heavily on research in progress and research produced by advocacy organizations; it neglects prior research concerning the nature of parental choice; and it fails to acknowledge that unconstrained school choice has segregative effects.

August 1970

Geographic Focus: North America-United States

Price of Quality: Estimating the cost of a higher quality earlychildhood care and education system for Southeast Wisconsin, The

Children and Youth, Education and Literacy, Parenting and Families

Price of Quality: Estimating the cost of a higher quality earlychildhood care and education system for Southeast Wisconsin, The

Throughout the United States, investments in high-quality early childhood education are seen by community leaders as a strategy for improving outcomes in areas such as K-12 education, workforce development, and economic development. Indeed, many research studies conclude that high quality early learning environments produce social, educational, and economic benefits for children and the communities in which they live. As a result, many state and local governments around the country are seeking to capture these benefits by investing in quality improvement efforts. Wisconsin is no different; the 2009-2010 state biennial budget calls for the Department of Children and Families to create a strategy for improving the quality of publicly-subsidized child care. While policymakers increasingly are looking to maximize the benefits of high-quality early childhood education, budget realities often dictate that they do so while minimizing the expenditure of public funds. Thus, this report seeks to inform these decisions in Wisconsin by estimating the costs of achieving improved quality in child care and early learning programs in southeast Wisconsin and analyzing policy options associated with quality improvement initiatives.

August 1970

Geographic Focus: North America-United States (Midwestern)-Wisconsin (Southeastern)

Preparing Tomorrow's Teachers: The Role of Practice-Based Teacher Preparation Programs in Massachusetts

Education and Literacy

Preparing Tomorrow's Teachers: The Role of Practice-Based Teacher Preparation Programs in Massachusetts

Over the past decade, alternative teacher preparation programs have proliferated across the nation -- and in Massachusetts -- in response to projected teacher shortages and in an effort to better prepare teachers for the challenges of today's classrooms. While the vast majority of Massachusetts teachers are trained through traditional teacher preparation programs, both the number of alternative route programs and the number of teachers completing them has grown significantly.

National research comparing alternative and traditional routes to teaching offers little empirical evidence to guide policy changes. Yet there has been a shift in teacher preparation programs toward: longer and more intense field-based experiences; closing the gap between theory and practice; partnerships between preparation programs and local school districts; and accountability in teacher preparation. It is within this context that the Rennie Center embarked upon a project to examine the role of alternative routes to teaching in Massachusetts. As part of this project, the Rennie Center convened a diverse working group, which examined the characteristics of alternative teacher preparation programs in the Commonwealth, including the type of candidates they attract, and examined issues associated with the expansion and sustainability of these programs. This report is the culmination of the Rennie Center's year-long project.

Preparing Tomorrow's Teachers: The Role of Practice-Based Teacher Preparation Programs in Massachusetts highlights gaps in knowledge and areas for improvement, and lays the groundwork necessary for a deeper look at issues associated with drawing exceptional candidates into the teaching profession; filling vacant positions; measuring teacher quality; and holding teacher preparation programs accountable.

The final section of the report puts forth considerations for policymakers, K-12 school and district leaders, and institutions of higher education. The report encourages the state to facilitate and encourage communication and collaboration between those that train teachers and those that hire them, and provide teacher preparation programs with access to the state data system so they may more easily evaluate their programs. The report also encourages K-12 district leaders and deans of college and university departments of education to create lend-lease programs that would allow expert teachers to work as adjunct professors in schools of education without forfeiting their role as K-12 teachers as a way to bring both the clinical and contextualized knowledge of schools and districts into teacher training.

The report was the subject of discussion at a public event on November 19, 2009.

August 1970

Geographic Focus: North America / United States (Northeastern) / Massachusetts

Harnessing Openness to Improve Research, Teaching and Learning in Higher Education

Community and Economic Development;Computers and Technology;Education and Literacy

Harnessing Openness to Improve Research, Teaching and Learning in Higher Education

Colleges and universities should embrace the concept of increased openness in the use and sharing of information to improve higher education. That is the core recommendation of this report. The report was produced by CED's Digital Connections Council (DCC), a group of information technology experts that advises CED's business leaders on cutting-edge technologies.

August 1970

Geographic Focus:

Comprehensive Induction or Add-on Induction: Impact on Teacher Practice and Student Engagement

Education and Literacy

Comprehensive Induction or Add-on Induction: Impact on Teacher Practice and Student Engagement

In recent years, we have seen a rapid expansion of policies and resources devoted to new teacher induction. Most of these policies are based on an assumption that induction programs have a positive influence on teacher quality and student learning. Yet there is little evidence to support claims for such policies regarding the distinct components of induction programs or their effectiveness (Wang, Odell & Schwille, 2008). Scholars have argued for targeted mentoring that addresses the learning needs of beginning teachers with regard to instructional practice (Feiman-Nemser, 2001). Some suggest that induction efforts may increase teacher knowledge, student achievement, teacher satisfaction, and retention (Darling-Hammond, 1999; Fletcher, Strong & Villar, 2008; Smith & Ingersoll, 2004).

There is, however, insufficient data to assist educators and policy makers in determining the most effective or critical components of induction programs. There is scant consensus around a number of induction issues, for example: the most effective mentoring condition (full-time or add-on mentoring); the amount of time required to enhance the development of beginning teachers; the amount of professional development mentors need to be effective; and the level of match (subject or grade level) required between mentor and beginning teacher. Furthermore, few studies explore the different components of induction and their effects on teacher and student outcomes.

Given such a dearth of evidence and the current state of induction policy, this study was developed to examine differences in student engagement and teacher instructional practice in two types of induction conditions: comprehensive full-time induction and add-on induction. These two conditions differed in

- the amount of mentor participation in professional development on induction;

- the amount of time mentors could spend on structured observations, reflection, and feedback focused on pedagogy;

- mentors' abilities to prioritize induction efforts;

- mentors' abilities to serve as liaisons between beginning teachers and administrators; and

- the amount of professional development mentors could offer beginning teachers.

The goal of this study was to examine the instructional practice of beginning teachers who were mentored in these two conditions and to explore differences in instructional practice and student engagement.

August 1970

Geographic Focus:

See More Reports

Go to IssueLab