CV Taut august 2011

Sandy Taut
Av. El Bosque 1123, dpto. 1001
Santiago, Chile
tel.: ++56 2 980 2815
email: staut @ uc.cl; staut @ ucla.edu
Professional Experience
Pontificia Universidad Católica de Chile, School of Psychology
Head of Research Unit, Measurement Center MIDE UC
Since April 2008
Responsibilities:
National teacher evaluation project of the Chilean Ministry of Education (validity
research agenda, including consequences); educational project consulting (e.g., pilot project on evaluation
of school principals, teacher professional development, initial teacher training certification testing,
accreditation of excellence in teaching, among others); collaboration in the standardized achievement
testing project SEPA; teacher distribution and teacher effects research; staff coordination (4-8
professionals); budget planning (base funding US $ 220,000/year). See http://www.mideuc.cl
Associate Researcher, Measurement Center MIDE UC
August 2005 – March 2008
Responsibilities:
National teacher evaluation project of the Chilean Ministry of Education (validity,
reliability, generalizability studies, technical support in instrument design and data analysis); Evaluation
of the communication products of the national student achievement testing system (SIMCE), Chilean
Ministry of Education; Value-added analysis and reporting pilot project for the national student
achievement testing system (SIMCE), Chilean Ministry of Education.
University of California Los Angeles, Graduate School of Education, Social Research Methodology
Division
UCLA SRM Evaluation Group, August 2001 – May 2005
Responsibilities:
Planning, conducting, analyzing and reporting of evaluations for the UCLA Early
Academic Outreach Program and Career-Based Outreach Program. Evaluation of the effectiveness of the
University of California All Campus Consortium on Research for Diversity in capacity building and
policy influence. Facilitating the self-evaluation of outcomes for UCLA Student-Initiated Outreach
projects. Team coordination and quality assurance tasks.
Western Michigan University, The Evaluation Center, Kalamazoo, USA
Project/Research Assistant, 1999 - 2000
Universität zu Köln, Department of Education, Evaluation Center Univation
Project Assistant, 1997-1999
1
Teaching Experience
Pontificia Universidad Católica de Chile; School of Psychology
Lecturer, since January 2011
Course title:
Continuing Education Course on Educational Assessment
Pontificia Universidad Católica de Chile; School of Psychology
Lecturer, since March 2008
Course title:
Design and Evaluation of Educational Programs
Deutsches Jugendinstitut, München, Germany
Invited trainer, January 2008
Course title:
Logic Models and Program Theory in Program Evaluation
Universität Bern, Switzerland; Center for Continuing Education; Post-Graduate Evaluation
Degree Program
Adjunct faculty, 2004-2009
Course title:
Logic Models and Program Theory in Program Evaluation
University of California Los Angeles, Department of Education, Social Research Methodology
Division
Teaching assistant, fall 2003 & winter 2004
Course titles:
Evaluation Procedures: Utilization-focused Evaluation
Evaluation Special Topics Seminar: Descriptive Theory
Post-secondary Education
09.2001 – 05.2005
Ph.D. in Education, University of California Los Angeles (UCLA), Graduate
School of Education & Information Studies
Dissertation:
Evaluation Use for Learning in an International Development Cooperation
Organization
10.1995 – 07.2001
Professional degree in Psychology (Diplom), Universität zu Köln, Germany
Final grade:
very good (highest grade)
Thesis:
Psychological Explanations for Resistance to Program Evaluation
[Psychologische Erklärungsansätze für Widerstand gegen Programmevaluation]
Consultancies
UNESCO, Paris, France
Internal Oversight Service (IOS), Evaluation Section
Consultant, April – September 2004; June – September 2003
UNICEF, New York City, USA
Internship Evaluation Unit, May – July 2000
2
Publications (peer reviewed)
Araya, C., Taut, S., Santelices, V. & Manzi, J. (in press). Validez consecuencial del programa de
asignación de excelencia pedagógica en Chile [Consequential Validity of the Certification of Teaching
Excellence Program in Chile]. Revista Estudios Pedagógicos.
Araya, C., Taut, S., Santelices, V., Manzi, J. & Miño, F. (in press). Teoría de Acción del Programa de
Asignación de Excelencia Pedagógica en Chile [Theory of Action of the Certification of Teaching
Excellence Program in Chile]. Revista en Educación.
Santelices, V. & Taut, S. (2011). Convergent validity evidence regarding the Chilean standards-based
teacher evaluation system. Assessment in Education: Principles, Policy & Practice, 18(1), 73-93.
http://dx.doi.org/10.1080/0969594X.2011.534948
Tornero, B. & Taut, S. (2010). A mandatory, high-stakes national teacher evaluation system: Perceptions
and attributions of teachers who actively refuse to participate. Studies in Educational Evaluation, 36, 132142.
Hein, A. & Taut, S. (2010). El uso de información evaluativa externa con fines formativos en
establecimientos educacionales chilenos [The use of formative evaluative information in Chilean schools].
Revista Iberoamericana de Evaluación Educativa, 3(2), pp. 160-181. http://rinace.net/riee/numeros/vol3num2/art9.html
Taut, S., Santelices, V., Araya, C. & Manzi, J. (2010). Theory underlying a national teacher evaluation
program. Evaluation and Program Planning, 33, 477-489.
http://dx.doi.org/10.1016/j.evalprogplan.2010.01.002
Taut, S., Cortés, F., Sebastian, C. & Preiss, D. (2009). Evaluating school and parent reports of the
national student achievement testing system (SIMCE) in Chile: Access, comprehension, and use.
Evaluation and Program Planning, 32, 129-137.
Taut, S. (2008). What have we learned about stakeholder involvement in program evaluation? Studies in
Educational Evaluation, 34(4), 224-230.
Taut, S. (2007). Methodological and conceptual challenges in studying evaluation process use. Canadian
Journal of Program Evaluation, 22(2), 1-19.
Taut, S. (2007). Studying self-evaluation capacity building in a large international development
organization. American Journal of Evaluation, 28(1), 45-59.
Taut, S. (2007). Defining evaluation capacity building: Utility considerations. American Journal of
Evaluation, 28(1), 120.
Forss, K., Kruse, S., Taut, S. & Tenden, E. (2006). Chasing a Ghost? An Essay on Participatory
Evaluation and Capacity Development. Evaluation, 12(1), 131-147.
Taut, S. & Alkin, M. (2003). Program Staff Perceptions of Barriers to Evaluation Implementation.
American Journal of Evaluation, 24 (2), 213-226.
Alkin, M. & Taut, S. (2003). Unbundling Evaluation Use. Studies in Educational Evaluation, 29, 1-12.
3
Taut, S. & Brauns, D. (2003). Resistance to Evaluation: A Psychological Perspective. Evaluation, 9 (3),
247-269.
Beywl, W. & Taut, S. (2000). Standards: Aktuelle Strategie zur Qualitätsentwicklung in der Evaluation
[Standards: A Strategy For Improving Quality in Evaluation]. Vierteljahreshefte zur Wirtschaftsforschung
3/2000, 446-461.
Publications (submitted for peer review)
Taut, S., Santelices, V., Araya, C. & Manzi, J. Effects And Uses Of A National Teacher Performance
Assessment At School Level. Submitted to a special issue of Studies in Educational Evaluation.
Book Chapters
Taut, S., Santelices, V. & Manzi, J. (2011). Estudios de validez de la Evaluación Docente [Validation
studies of the Chilean National Teacher Evaluation]. In: Jorge Manzi, Roberto Gonzalez, Yulan Sun
(Eds.), La Evaluación Docente en Chile [The Chilean national teacher evaluation system], pp. 157-175.
Pontificia Universidad Católica de Chile, Santiago, Chile.
Taut, S. & Alkin, M. (2010). The Role of Stakeholders in Educational Evaluation. In: Penelope Peterson,
Eva Baker, Barry McGaw, (Eds.), International Encyclopedia of Education. Volume 3, pp. 629-635.
Oxford: Elsevier.
Book Reviews
Taut, S. (2008). Book review of “Logic Modeling Methods in Program Evaluation” by Joy Frechtling,
2007. American Journal of Evaluation, 29(2), 217-218.
Research Grants and Project Acquisition
Title:
Role:
Description:
Amount:
Title:
Role:
Description:
Estudio de validez consecuencial de los sistemas de evaluación de desempeño y
excelencia docente [Consequential validity of the national teacher evaluation program
and the national teacher certification program].
Principal Investigator
Three-year research grant (2008-2011) from the Comisión Nacional de Investigación
Científica y Tecnológica [Chilean National Science Foundation], Fondo Nacional de
Desarrollo Científico y Tecnológico (FONDECYT Regular No. 1080135).
US $ 144,000,Desarrollo de Pruebas Estandarizadas y de una Metodología de Valor Agregado para
Evaluar el Progreso de los Aprendizajes en Matemática y Lenguaje de Estudiantes de
Segundo Ciclo de Enseñanza Básica (5º a 8º) [Development of Math and Language
Standardized Tests and a Value-added Methodology to Evaluate the Learning Progress
of Students in 5th to 8th grade].
Co-Investigator
Two-year research grant (2008-2010) from the Fondo de Desarrollo e Innovación
(INNOVA), Gobierno de Chile [Development and Innovation Fund].
4
Title:
Role:
Description:
Title:
Role:
Description:
Estudio Piloto de Valor Agregado SIMCE 2006-2008 [SIMCE Value Added Pilot Study
2006-2008].
Co-Investigator
Research study for the national student achievement testing system (SIMCE), Ministry of
Education, Chile.
Evaluación de Productos Comunicacionales SIMCE 2005/2006 [Evaluation of SIMCE
Communication Products 2005/2006].
Co-Investigator
Evaluation for the national student achievement testing system (SIMCE), Ministry of
Education, Chile.
Professional Conference Presentations
Jimenez, D. & Taut, S. (2011, August). Classroom assessment in Chile: A diagnosis of policies and
practices. Paper presented at the biannual meeting of the European Association for Research on Learning
and Instruction (EARLI), September 1, 2011, Exeter, UK.
Taut, S., Santelices, V., Araya, C. & Manzi, J. (2011, April). Effects And Uses Of A National Teacher
Performance Assessment At School Level. Paper presented at the Annual Meeting of the American
Educational Research Association, New Orleans, USA.
Cortés, F., Taut, S., Santelices, V. & Lagos, M.J. (2011, January). Formación continua en professors y la
experiencia de los Planes de Superación Profesional (PSP) en Chile: Fortalezas y debilidades a la luz de la
evidence international [Teacher professional development and the experience with the program Planes de
Superación Profesional (PSP) in Chile: Strengths and weaknesses in light of the international evidence].
Paper presented at the second meeting of the Sociedad Chilena de Políticas Públicas, January 19, 2011,
Santiago, Chile.
Araya, C., Taut, S., Santelices, V. & Manzi, J. (2010, August). Studying the effects of the certification of
teaching excellence program in Chile. Paper presented at the annual meeting of the European Educational
Research Association (EERA-ECER), August 25-27, 2010 in Helsinki, Finland.
Santelices, V., Valencia, E., Taut, S. & Manzi, J. (2010, April). The Importance of Contextual and
Personal Variables in Explaining Teacher Quality: Evidence Using a Standards-based, Standardized
Measure of Teacher Performance. Poster presented at the Annual Meeting of the American Educational
Research Association, Denver, USA.
Tornero, B., & Taut, S. (2009). Sistema de Evaluación del Desempeño Docente en Chile: Significados y
Percepciones de Profesores Rebeldes [The teacher performance evaluation system in Chile: Meanings and
perceptions of teachers who actively refuse to participate]. Paper presented at the IX Jornada
Internacional de Psicología Educacional, Valparaiso, Chile.
Taut, S. & Santelices, V. (2009). Validity issues in assessing teacher competencies. Paper presented at the
annual meeting of the European Educational Research Association (EERA-ECER), September 27-30,
2009 in Vienna, Austria.
Taut, S. & Santelices, V. (2009). Comprehension and use of value-added school performance indicators
reported to teachers and parents. Paper presented at the annual meeting of the European Educational
Research Association (EERA-ECER), September 27-30, 2009 in Vienna, Austria.
5
Santelices, V., Taut, S., Araya, C., & Manzi, J. (2009). Consequential Validity of Chile’s Teacher
Evaluation System: Consequences at the Municipal (Local) Level. Paper presented at the Annual Meeting
of the American Educational Research Association, April 13-19, 2009, in San Diego, USA.
Taut, S., Santelices, V. & Thibaut, P. (2008). Explicating Expected Consequences and Underlying
Assumptions of a National Teacher Evaluation System. Paper presented at the Annual Meeting of the
American Evaluation Association, November 5-8, 2008, in Denver, USA.
Taut, S. & Santelices, V. (2007). Validating the Chilean National Teacher Evaluation System: A
comprehensive research agenda. Paper presented at the Annual Meeting of the American Educational
Research Association, April 9-13, 2007, in Chicago, USA.
Taut, S. (2005). A real-time case study of evaluation process use: Methodological and conceptual
challenges. Paper presented at the Joint Meeting of the American Evaluation Association and the
Canadian Evaluation Society, October 26-29, 2005, in Toronto, CA.
Taut, S. (2005). Strengthening the learning function of evaluation: Capacity building in self-evaluation.
Paper presented at the Joint Meeting of the American Evaluation Association and the Canadian
Evaluation Society, October 26-29, 2005, in Toronto, CA.
Forss, K., Kruse, S., Taut, S. & Tenden, E. (2004). Reflecting on process use of external evaluations: The
case of a large-scale evaluation of UNESCO’s HIV/AIDS activities. Paper presented at the European
Evaluation Society Conference, September 30 – October 2, 2004, in Berlin, Germany.
Taut, S. (2004). Self-conducted evaluation at UNESCO: An empirical study on fostering staff learning
from evaluation. Paper presented at the European Evaluation Society Conference, September 30 –
October 2, 2004, in Berlin, Germany.
Taut, S. (2003). How useful is the evaluation use concept? Paper presented at the Annual Meeting of the
American Evaluation Association, November 5-8, 2003, in Reno, NV.
Eisenberg, N. & Taut, S. (2003). Evaluation Utilization: Theoretical Perspective on the Lynwood/UCLA
Partnership. Paper presented at the Annual Meeting of the American Evaluation Association, November
5-8, 2003, in Reno, NV.
Taut, S. (2002). Barriers to Program Evaluation: Explanatory Factors and Solutions. Presentation at the
Euro-Conference on European Union Evaluation Policy, December 2-3, 2002, in Barcelona, Spain.
Taut, S. (2002). Barriers to Evaluation: Program Staff Perspectives. Paper presented at the Annual
Meeting of the American Evaluation Association, November 6-9, 2002, in Washington, D.C.
Taut, S. (2001). Resistance to Program Evaluation. Paper presented at the Annual Meeting of the
American Evaluation Association, November 8-10, 2001, in St. Louis, MO.
Taut, S. & Brauns, D. (2000). Widerstand gegen Evaluation: Sozialpsychologische Erklärungen und
Gegenmaßnahmen [Resistance to Evaluation: Social Psychological Explanations and Measures].
Presentation at the Third Annual Meeting of the German Evaluation Society, November 23-24, 2000,
Berlin, Germany.
6
Invited Talks
Sächsisches Bildungsinstitut [Educational Institute of Saxony], Dresden, Germany, October 1, 2009. Das
chilenische nationale Lehrerevaluationssystem und empirische Befunde zu seiner Validität und Wirkung
[The Chilean national teacher evaluation system and empirical evidence regarding its validity and effects].
Pontificia Universida Católica de Chile, Coloquio MIDE UC, Santiago, Chile, August 25, 2009. Las
consecuencias de los programas nacionales de evaluación de desempeño y excelencia docente
(Docentemás y AEP) [The consequences of the national teacher performance evaluation program and the
certification of teaching excellence program].
Deutsches Institut für Internationale Pädagogische Forschung [German Institute for International
Educational Research] (DIPF), Frankfurt, Germany, February 18, 2009. Validity Research on the Chilean
National Teacher Evaluation System.
Technical Reports
Taut, S., Santelices, V., & Valencia, E. (2010). Resultado de re-evaluaciones y situación laboral de los
docentes evaluados por la Evaluación Docente entre 2003 y 2008 [Results in subsequent evaluations and
job situation of teachers evaluated by the national teacher evaluation program between 2003 and 2008].
Technical Report MIDE UC IT 1007.
Hein, A. & Taut, S. (2009). El uso de información evaluativa externa con fines formativos en
establecimientos educacionales chilenos [The use of formative evaluative information in Chilean schools].
Technical Report MIDE UC IT 1001.
Santelices, V., Taut, S. & Valencia, E. (2009). Relación entre los resultados de la Evaluación Docente y
los Planes de Superación Profesional: Estudio descriptivo. Internal document MIDE UC.
Taut, S., Santelices, V. & Valencia, E. (2009). Situación laboral y desempeño en evaluaciones posteriores
de los docentes calificados como insatisfactorio en el Sistema Nacional de Evaluación de Desempeño
Docente [Job situation and performance on subsequent evaluations of teachers categorized as
“unsatisfactory” by the national teacher evaluation program]. Internal document MIDE UC.
Alkin, M., Braden, J., Frechtling, J., Stevens, F., Taut, S., Welner, K., & Vo, A. (2008). Validation Panel
Report, The Program Evaluation Standards, 3rd ed. Commissioned by the Revision Task Force of the
Joint Committee on Standards for Educational Evaluation.
Santelices, V., Taut, S. & Valencia, E. (2008). Estudio exploratorio-comparativo de los resultados de los
programas AVDI, AEP y Docentemás entre 2002 y 2006 [Exploratory comparative quantitative analysis
of the results of the national teacher evaluation program, the individual teacher incentive program and the
accreditation of excellence in teaching program between 2002 and 2006]. Internal document MIDE UC.
Valencia, E. & Taut, S. (2007, 2008). Análisis factorial exploratorio del portafolio Docentemás 2006 y
2007 [Exploratory Factor Analysis of the Portfolio Instrument of the Chilean national teacher evaluation
program (Docentemás)]. Internal document MIDE UC.
Taut, S. (2005). UCLA Student-Initiated Outreach Projects: Facilitating the Self-evaluation of Outcomes.
UCLA Outreach Evaluation Occasional Report Series, No. 22. Los Angeles: UCLA.
7
Taut, S. (2004). Experiences with Self-evaluation in the United Nations Evaluation Group. Paris:
UNESCO, Internal Oversight Service, Evaluation Unit.
Taut, S. (2004). ACCORD Evaluation 2003/2004. UCLA Outreach Evaluation Occasional Report Series,
No. 18. Los Angeles: UCLA.
Taut, S. & Loiseau, F. (2003). Preparatory Study for Evaluations of UNESCO Capacity Building
Activities. Paris: UNESCO, Internal Oversight Service, Evaluation Unit.
Taut, S. (2003). Evaluation of the Early Academic Outreach Program (EAOP): Parent Component. UCLA
Outreach Evaluation Occasional Report Series, No. 17. Los Angeles: UCLA.
Taut, S. (2003). Evaluation of the Career-Based Outreach Program (CBOP): Scholar Outcomes. UCLA
Outreach Evaluation Occasional Report Series, No. 16. Los Angeles: UCLA.
Taut, S. & Alkin, M. (2003). Barriers to Program Evaluation: UCLA Outreach Program Staff
Perspectives. UCLA Outreach Evaluation Occasional Report Series, No. 10. Los Angeles: UCLA.
Taut, S. & Alkin, M. (2002). An Overview of UCLA and Non-UCLA Outreach Programs: Case Studies
of Roosevelt HS, South Gate HS, and Monroe HS. UCLA Outreach Evaluation Occasional Report Series,
No. 9 (& 9a, 9b, 9c). Los Angeles: UCLA.
Taut, S. (2000). The Cross-Cultural Transferability of the Program Evaluation Standards. In: Russon,
Craig (Ed.): The Program Evaluation Standards in International Settings. The Evaluation Center
Occasional Papers Series, No. 17. Western Michigan University, Kalamazoo, MI.
Honors and Awards
2011
2004 – 2005
2001 – 2004
2004
2001
1999 – 2000
German Scholars Association (GSO) International Travel Scholarship
UCLA Graduate Division Dissertation Year Merit Fellowship
UCLA Departmental Fellowship
UCLA Leigh Burstein Award for Excellence in Social Research Methodology
Best Student Paper Travel Award, American Evaluation Association
Fulbright Scholarship
Professional Affiliations
American Educational Research Association (AERA); National Council on Measurement in Education
(NCME); American Evaluation Association (AEA); German Evaluation Society (DeGEval)
Additional Professional Activities
•
•
•
•
•
•
Member of the review committee for the field of Education, Chilean governmental research
funding agency Conicyt
Member of the validation panel of the 3rd edition of the “Program Evaluation Standards”
Member of the editorial board of the international journal “Studies in Educational Evaluation”
Member of the review board of the German Academic Exchange Agency (DAAD) in Chile
Member of the executive committee of the Topical Interest Group “Evaluation Use” of AEA
Reviewer for “American Journal of Evaluation”, “Canadian Journal of Program Evaluation”,
“Evaluation and Program Planning”, “Studies in Educational Evaluation”
8
Tenure Track Application Results
1. Universität Tübingen, Germany, 2009 (W1/W2): Job talk
2. University of California Los Angeles, USA, 2008 (Assistant Professor): Job talk (ranked no.2)
Advanced Software Skills
Statistical software packages SPSS, STATA, HLM
Qualitative data analysis software Atlas.ti
Language skills
German (mother tongue), English (fluent), Spanish (fluent), French (colloquial)
9