EDN 523. Research in Education

EDN 523  Open this and you will find LOTS of docs and ppt’s for YOU!

Fall, 2012

The last school reform  ppt        Efforts to explain (find blame for) low achievement focus on teachers.  This is couched as an issue of accountability, but it is revealing that the rest of the players in education (ed schools, curriculum organizations, ed school certifying organizations, “researchers,” “innovators,” and gurus) never include themselves as part of the problem.  In fact, they are the ones pushing hardest for teacher assessment.  [One can’t imagine why.]  Ironically, these same persons and groups (whose writings, programs, and reforms show that they know less than nothing about curriculum and instruction) are the ones designing and conducting teacher assessments.  What a good idea!   I wonder who thought of that?  Oh, right! THEY did.    I’m sure that the inventories developed be these geniuses will be comprehensive, the items will be well-defined, the measures will measure what they are supposed to measure, and the measurement process will be collaborative and will be connected directly to assistance. 

The presentation ends with the assertion that the very first step in assessing and improving teaching requires DEFINING teacher proficiency, and THIS requires a shared stock of knowledge, which is so far impossible to do because this field is dominated by ZOMBIES, meatheads, and New Zealanders---that is, persons and organizations that indoctrinate teachers with what they think is consistent with human development and social betterment, but which is really ill-designed and as such ensures that kids with the least background knowledge remain at the bottom.  Thanks, you rump fed cloth headed miscreant knave punks!

The last school reform  doc

 

The Road to Teaching Proficiency.  This doc rests on a stock of research-derived knowledge of effective curriculum and instruction.  I see it as a tentative, but brilliant, effort to (1) identify the main activities of teachers; (2)  identify the knowledge elements of each of these activities; and (3) suggest a logically progressive sequence that integrates the elements into wholes—namely, activities.

The doc COULD be the start of an inventory of teacher proficiency.

It could also help to develop teacher preparation programs everywhere in the world, except perhaps for New Zealand.

Short version of “The road.”

Glossary

 

Examples of teacher activities (end of the “road,” above) that integrate many knowledge elements regarding curriculum and instruction from here.

1.  Designing instruction from textbooks and other materials  BLANK TO FILL OUT for future use in schools.

2.  Form for Assessing and Improving  Curriculum Materials and Instruction  BLANK TO FILL OUT for future use in schools. Download, save, print, and put in a binder. 

3.  Designing curriculum and instruction in elementary school.

Project designing instruction on ecosystems.

 

BELOW are docs we’ll use to make an inventory.  Then we’ll use the inventory to make assessments.  Then we’ll use both inventory and assessments to plan research.  Research to do what?  (1) Validate and improve the assessment and inventory; (2) determine teacher proficiency right after graduation and later (cohort study); (3) determine relationships between aspects of teacher proficiency and aspects of schools (supervision; students; perceptions) and achievement; (4) ……………

 

Developing a teaching proficiency inventory.   DRAFT.

 

What we have so far: areas and items.

 

Possible format for item development.

 

Possible items on curriculum

 

Possible items on lessons.

 

Possible items in reinforcement

 

Possible items on engaged time

 

Possible items on diverse learners

 

Possible items on questioning

 

Possible assessment of lesson planning.

 

 

 

 

SOURCES for main strands of teacher proficiency (e.g., lesson plans, correcting errors, assessment), knowledge elements needed to do these (e.g., a teacher must know how to teach acquisition, generalization, fluency, retention, and integration of knowledge in order to plan a well-designed lesson).

Ed school objectives

Evaluating Instruction

Inside the black box of high performing high poverty schools

Kozloff.  Inventory of essential teaching skills.  http://people.uncw.edu/kozloffm/inventory.pdf

          Also  as doc.  http://people.uncw.edu/kozloffm/inventory.doc

Cotton, K. (1995). Effective school practices: A research synthesis 1995 Update.

http://people.uncw.edu/kozloffm/Effective Schooling Practices.doc

Kozloff, M.A. (2002). Sufficient Scaffolding, Organizing and Activating Knowledge, and Sustaining High Engaged Time.

         Also as doc.

Rosenshine, B. (1997). Advances in Research on Instruction.

http://people.uncw.edu/kozloffm/Rosenshine.doc

Ellis, E.S., & Worthington, L.A. (1994). Research Synthesis on Effective Teaching Principles and the Design of Quality Tools for Educators.

        Also as doc.

Anderson, J.R., Reder, L.M., & Simon, H.A. Applications and Misapplications of Cognitive Psychology to Mathematics Education. Department of Psychology. Carnegie Mellon University. Pittsburgh, PA 15213.

       Online at http://act.psy.cmu.edu/personal/ja/misapplied.html

Constructivism vs. explicit, systematic instruction.  http://www.cogtech.usc.edu/recent_publications.php

         http://mathexperts-qa.blogspot.com/2011/05/case-against-constructivism-and-for.html

         http://d-edreckoning.blogspot.com/2007/04/effective-mathematics-instruction.html

         http://www.cogtech.usc.edu/publications/kirschner_Sweller_Clark.pdf

Hattie.  Influences on student learning.

Hattie.  Summary of visible learning.

Hattie.  Teachers make a difference.

Inside the black box of high-performing, high-poverty schools.

Effective schools.

Effective secondary schools.

Effective vs. ineffective classrooms

Basics of validity

Vocabulary.

Telling the difference between baloney and serious claims

It’s all about validity

Guidelines for evaluating research and research claims

Cautionary tales

Evaluating Research ppt

Evaluating claims:  article on multiple intelligence

Evaluating claims:  article on synthetic phonics instruction

Guidelines for evaluating research and publications Powerpoint

Guidelines for evaluating research and publications document

Checklist of Guidelines for Evaluating Research.

Comprehensive Guidelines for Evaluating Research and Publications

What is a scientific theory?

Materials on all of the knowledge elements needed to do the three main teacher activities, above.

A. Basics.

Overview of Curriculum and Instruction

Knowledge Analysis

Instructional Objectives

Organizing Instruction Around Big Ideas

An Example of Most Elements of Well-designed Instruction  Reviews final performances, objectives, kinds of knowledge, phases of learning or mastery---all in a convenient and easy to use package approved by Ms. Betty Boop.

Clear comprehension and communication.  How to translate complex, muddy language into simple
declarative statements. 

Practice translating complex, muddy language into simple declarative statements 

Logical and illogical thinking.

Phases of Mastery 

Phases of Mastery Table      

Brief procedures for teaching the six kinds of knowledge  There are six kinds of knowledge.  Here’s a brief look at how to teach each one.

Phases of Mastery Table      Definition, objectives and procedures for teaching each of the four phases of mastery. 

Form for Describing and Assessing Lessons

Tightly-coupled knowledge systems and systematic, explicit, focused instruction

Overview of explicit instruction

Assessing teaching proficiency 

Table for Assessing and Improving Instruction 

Four-Level Procedure for Remediation  

Forms of Knowledge 

A simple, straightforward, and effective procedure for teaching each kind of knowledge

B.  Application to different forms of knowledge

How to teach sensory concepts.

 How to teach higher-order (abstract) concepts.

Teaching Facts

Teaching List. Panoply.

Teaching List. Phases of Mitosis

Teaching Sensory Concept. On

Teaching Higher-order Concepts with Synonyms

Teaching Higher-order Concept. Simile

Teaching Higher-order Concept. Granite

Teaching Rule-relationship: War

Teaching Rule-relationship. Temperature/pressure

Teaching Routine. Sounding Out Words

C.  Application to Lessons.  How to organize tasks into lessons: shows combination of explicit instruction and Socratic instruction.

Example of unit organization: plant life cycle 

Lesson: Teaching Routine. Analyzing Declaration of Independence 

How to introduce a unit on the Declaration of Independence.  PPT  

Unit on U.S. Constitution  

Persian War Presentation 

http://people.uncw.edu/kozloffm/lessononamericanhistory.doc 

Lesson: Teaching Routine. Slope

 

Spring 2012 project.  Teacher evaluation and school reform   ppt   doc

Fall 2011 project.  Reading improvement.  Outline of Steps in Planning Research---to fill out

Spring, 2012

Resource documents on research

Vocabulary.

Telling the difference between baloney and serious claims

It’s all about validity

Guidelines for evaluating research and research claims

Cautionary tales

Evaluating Research ppt

Evaluating claims:  article on multiple intelligence

Evaluating claims:  article on synthetic phonics instruction

Guidelines for evaluating research and publications Powerpoint

Guidelines for evaluating research and publications document

Checklist of Guidelines for Evaluating Research.

Comprehensive Guidelines for Evaluating Research and Publications

What is a scientific theory?

 Overview of important concepts

 Definitions of variables

 Propositions

 Measurement

 Drawing causal inferences.  

Theory, variables, and measurement

The logic of theory and research

Internal and external validity

How to read and interpret graphs

Three levels of research

Table of Levels of Research and Examples

Research Questions and Research Strategies PPT.

Experiments

Experiments PPT

Cross-sectional and longitudinal designs.

Identifying and challenging logical fallacies

Table of Guidelines for evaluating research and publications

Outline of steps in planning research

Examples of research topics and questions.

Examples of Research Questions

Outline of Steps in Planning Research

Steps in Planning Research  Fuller version of above

Evaluating Research ppt

Validity, or Telling the difference between baloney and credible claims

Checklist of Guidelines for Evaluating Research.

SOURCES FOR PROJECTS ON TEACHER EVALUATION

Teaching Proficiency Inventory

Model of development and implementation

Criteria for assessing state teacher assessments

A.  State Standards, Rubrics, Inventories, Instruments

California   Provided by Squadron Leader Parsons.

North Carolina  Form-ready rubric for teacher evaluation  http://www.dpi.state.nc.us/docs/profdev/training/teacher/individual/form-ready-rubric.pdf

Texas   Provided by Marine Ma Contraras.

Texas Appraisal Framework

Texas Appraisal Documentation Form

Texas Teacher Observation

Texas Appraisal Timeline

Wisconsin.   Provided by Knight Templar Hall

WI Teacher Evaluation

Teacher evaluation

WI Field study

WI CCP What WI Teachers evaluated

WI Trip Booklet

WI Powerpoint teacher evaluations

ASSESSMENT OF

Massachusetts   Provided by Spuds Fitzpatrick

MA Teacher Evaluation

ASSESSMENT

Critique by Fitz

New York  Provided by Rear Admiral Rhodes

NY Teaching standards  Overview

NY Teaching standards

NY Teacher evaluation and development handbook

ASSESSMENT

Oregon.  Provided by Colonel S. Musten, Victoria Cross

Overview of teacher evaluation

Evaluation report

Assistant evaluation

Teacher classroom observation

Teacher evaluation handbook  Important   See pages 15-

Framework for teaching    Important

Note-taking form

West Virginia  Provided by  the Marquise de Maykish

Professional teaching standards

ASSESSMENT

Florida and Colorado  Provided by le Chevalier de Geissler

Colorado Teaching Evaluation

Florida

ASSESSMENT OF FLORIDA

Australia.  Provided by Commander M. Mereyde, HMS Bladerunner

Teacher Evaluation Australia

Certification goals

Overview from Australia

How Australia developed standards

How Australia validated standards

ASSESSMENT

England  Provided by Gunnery Sergeant Contraras

Ofsted Evaluation Schedule for Schools

Ofsted Lesson Criteria

Ofsted Lesson Observation Checklist

Ofsted Presentation Primary

England school observation

Sources of Items for Inventory and/or Assessment/research Instruments

Items?

Validation of items and assessment?  Research?

Measurement.

1.  Danielson

http://www.danielsongroup.org/

http://www.whitebear.k12.mn.us/teachereval.html

http://usny.nysed.gov/rttt/teachers-leaders/practicerubrics/Docs/Teachscape_Rubric.pdf

2.  CLASS.

http://www.teachstone.org/about-the-class/

http://www.brookespublishing.com/store/books/pianta-class/index.htm

Critique by Hall

Critique by Musten

3.  Teaching Performance Assessment (TPA)

http://ed.fullerton.edu/SecEd/tpa/

http://www.ctc.ca.gov/educator-prep/TPA-files/CandidateHandbook.pdf

Critique by Maykish

4. Teach for America

http://www.teachingasleadership.org/sites/default/files/TAL.Comprehensive.Rubric.FINAL.pdf

Critique by Geissler

New stuff

Value Added.  Panacea?

Multiple measures any better?

Student outcome measures

MET (Measures of effective teaching)
http://www.metproject.org/

http://www.metproject.org/downloads/met-framing-paper.pdf

ACT Standards

From Stanford U.  ACT.  A quality teacher in every classroom.

http://nbrc.stanford.edu/sites/default/files/ACT-a%20quality%20teacher%20in%20every%20classroom_0.pdf

What states can do to improve teacher effectiveness

Ed school objectives

Evaluating Instruction

Inside the black box of high performing high poverty schools

Kozloff.  Inventory of essential teaching skills.  http://people.uncw.edu/kozloffm/inventory.pdf

          Also  as doc.  http://people.uncw.edu/kozloffm/inventory.doc

Cotton, K. (1995). Effective school practices: A research synthesis 1995 Update.

http://people.uncw.edu/kozloffm/Effective Schooling Practices.doc

Kozloff, M.A. (2002). Sufficient Scaffolding, Organizing and Activating Knowledge, and Sustaining High Engaged Time.

         Also as doc.

Rosenshine, B. (1997). Advances in Research on Instruction.

http://people.uncw.edu/kozloffm/Rosenshine.doc

Ellis, E.S., & Worthington, L.A. (1994). Research Synthesis on Effective Teaching Principles and the Design of Quality Tools for Educators.

        Also as doc.

Anderson, J.R., Reder, L.M., & Simon, H.A. Applications and Misapplications of Cognitive Psychology to Mathematics Education. Department of Psychology. Carnegie Mellon University. Pittsburgh, PA 15213.

       Online at http://act.psy.cmu.edu/personal/ja/misapplied.html

Constructivism vs. explicit, systematic instruction.  http://www.cogtech.usc.edu/recent_publications.php

         http://mathexperts-qa.blogspot.com/2011/05/case-against-constructivism-and-for.html

         http://d-edreckoning.blogspot.com/2007/04/effective-mathematics-instruction.html

         http://www.cogtech.usc.edu/publications/kirschner_Sweller_Clark.pdf

Fall, 2011

Literature for Reading Project

Outline of Steps in Planning Research---to fill out

Literature reviews for project

Citations in proper form

------------------------------------------------------------------------

Stuff to add to 100 Easy Lessons or Corrective Reading, and
classroom instruction in general

How to teach vocabulary

Sample format for teaching vocabulary by examples

Sample format for teaching vocabulary by synonyms

Sample format for teaching vocabulary by verbal definition

--------------------------------------------------------------------------

Description of Corrective Reading—to paste in

Corrective Reading Decoding Placement Test

Corrective Reading Comprehension Placement Test

Corrective Reading Decoding sample lesson

--------------------------------------------------------------------------

Entry test for 100 Easy Lessons

Mastery Test format for 100 easy lessons

---------------------------------------------------------------------------

Assessing teaching proficiency

Stuff left to do

Resource Documents on research

Identifying and challenging logical fallacies   

Telling the difference between baloney and serious claims

It’s all about validity

Theory, variables, and measurement

The logic of theory and research

Internal and external validity

What is a scientific theory?

 Overview of important concepts

 Definitions of variables

 Propositions

 Measurement

 Drawing causal inferences.  

How to read and interpret graphs

Three levels of research

Table of Levels of Research and Examples

Research Questions and Research Strategies PPT.

Experiments

Experiments PPT

Cross-sectional and longitudinal designs.

Guidelines for evaluating research and research claims

Cautionary tales

Evaluating Research ppt

Table of Guidelines for evaluating research and publications

Evaluating claims:  article on multiple intelligence

Evaluating claims:  article on synthetic phonics instruction

Guidelines for evaluating research and publications Powerpoint

Guidelines for evaluating research and publications document

Checklist of Guidelines for Evaluating Research.

Comprehensive Guidelines for Evaluating Research and Publications

Vocabulary.

Outline of steps in planning research

Examples of research topics and questions.