SlideShare uma empresa Scribd logo
1 de 72
Baixar para ler offline
John M. Norris University of Hawai´i Task-Based Language Teaching 2005
This Powerpoint presentation is copyrighted by John M. Norris ©  September 23, 2005 Citation information: Norris, J. M. (2005, September).  The essential roles of assessment, measurement, and evaluation in task-based language teaching . Plenary address presented at the First International Conference on Task-Based Language Teaching, University of Leuven, Belgium (September 23, 2005).
0:00 9:00 3:00 6:00 12:00 21:00 15:00 18:00 What time is it in  Leuven ? What time is it in  Hawaii ? “ Here and Now” condition “ There and…  ” condition Now
0:00 9:00 3:00 6:00 12:00 21:00 15:00 18:00 What is the time difference between Leuven & Hawaii? ,[object Object],[object Object],[object Object],Task condition for presentation =  “ Here _and There_ and Now”
measurement,  The essential roles of assessment, and evaluation in task-based language teaching
TBLT 2005: What’s at stake? ??? Language Education ??? Does it work?  for whom, when, why? What’s it worth?  to whom, when, why? How does it work?  for whom, when, why? Can it be improved?  by whom, when, why?
TBLT 2005: What’s at stake? … another L2 teaching method bandwagon… The critics say… … cognitive-interactionist SLA hegemony… … won’t work with _____ learners… … not possible in _____ program settings… … too much task, not enough language… … not happening in practice… T B L T
Setting the record straight: TBLT at work TARGET LANGUAGES English Dutch French Czech Chinese Arabic Ukranian Japanese Russian Spanish Korean German
Setting the record straight: TBLT at work PROGRAM TYPES Second Language Foreign Language Vocational Education General Education Local Innovation Small Classes National Ed. Policy Special Purposes Adult Child University Requirement Large Classes Beginning Learners Advanced Learners Face-to- Face Online
Setting the record straight: TBLT foundations “ All genuine education terminates in discipline, but it proceeds by engaging the mind in activities worthwhile for their own sake.” Dewey (1933), pp. 86-87
Setting the record straight: TBLT foundations “ This discussion rejects the doctrine that students should first learn passively, and then, having learned, should apply knowledge. […] In fact, the applications are part of the knowledge. For the very meaning of things known is wrapped up in their relationships beyond themselves. Thus, unapplied knowledge is knowledge shorn of its meaning.”   Whitehead, 1947, pp. 218-219
Setting the record straight: TBLT foundations “ For starters, this means having students do tasks, or at least meaningful simulations, that experts do in the various disciplines. Second, it means teaching them to think in ways that experts do when they perform these tasks.” Sternberg (2003), p. 5
Setting the record straight: Other task-based domains Medical school Nursing Curriculum by design Successful intelligence Environmental studies Social work Task-Based Practice Music education
Setting the record straight: So what is TBLT? Task-Based Language Teaching Rationales and Principles Education Philosophy Psychology SLA Language teaching Sociopolitical values L2 Education Programs Learner needs Assessment Curriculum Instruction Teacher development Evaluation Materials
The potential of task-based practice: One example William Reid Reid. W. J. (1992).  Task strategies: An empirical approach to social work practice . New York: Columbia University Press. Social work problems : truancy, aging, delinquency, substance abuse, family health
Task-Centered Practice Empirical Justification Empirical Implementation Theory Learning, behavior,  cognition  Research Psychosocial change, Problem solving   Evaluation Case work practice, Intervention outcomes Needs Identify, agree, prioritize Action Plan, rehearse, attempt, feedback   Assessment Task accomplishment,  Problem change Development Practitioner-friendly methods Improvement Field-tested findings The potential of task-based practice: One example
The potential of task-based practice: One example “ Assessment, process, and outcome data are systematically collected in each case by means of structured recording guidelines. Continuing research is used to improve the model.”  (Reid, 1992, p. 132). Development Improvement Field-testing
“ [Reid] was the single most significant figure in social work research”   Shaw (2004) p. 113 The potential of task-based practice: One example
Task-Based Language Teaching: A(nother) method for language teaching. The potential of task-based practice: TBLT
Task-Based Language Teaching: A(nother) method for language education practice. The potential of task-based practice: TBLT
Task-Based Language Teaching: An empirical approach to language education practice. The potential of task-based practice: TBLT Assessment Measurement Evaluation
The Role of Measurement in TBLT Interpreting research constructs… … to understand task-based learning
Measurement in TBLT: Responding to research purposes What is measurement? … trustworthy definition, elicitation, observation, analysis, and interpretation of research constructs…
Measurement in TBLT: Responding to research purposes Measurement should… Illuminate  task-based  learning… L2 dvlpmt. in task, over tasks Noticing, integrating, automatizing Proficiency, motivation, aptitude Timing, sequencing, embedding TBI FonF, modeling, feedback Reliable reporting of TBL variables Synthesis of how TBL works ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Measurement in TBLT: Responding to research purposes “ Perhaps the best recommendation would be that, with research in this area still developing techniques and understandings, the role of A/L work will be to offer suggestions for relevant variables and the standardization of operationalizations of variables…” Tavakoli & Skehan, 2005, p. 273
In short… TBLT ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Practice Empirical Measurement Measurement in TBLT: Responding to research purposes How does TBLT work, for whom, when, why?
Measurement in TBLT: Problems of practice Interpreting research constructs No construct definition Little standardization Missing measures No attention to reliability Impoverished analyses Insufficient reporting Understanding task-based learning ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Task influence on L2 performance (adapted from: Skehan, 2001) Measurement in TBLT: Problems of practice 0 + 0 Transformations (planning) 0 + 0 Outcomes + 0 + Structure - + + Dialogic v. Monologic + 0 + Familiarity Fluency Complexity Accuracy Task characteristic
Task influence on L2 performance (adapted from: Skehan, 2001) Measurement in TBLT: Problems of practice 0 + 0 Transformations (planning) 0 + 0 Outcomes + 0 + Structure - + + Dialogic v. Monologic + 0 + Familiarity Fluency Complexity Accuracy Task characteristic
“… giving learners the opportunity to plan before a task is done consistently produces greater complexity of language…”  (Skehan, 2003, pp. 395-96) Measurement in TBLT: Problems of practice “ To sum up, both modality and group condition affected complexity at the level of syntax…”  (Ellis & Yuan, 2005, p. 184)
Measurement in TBLT: Problems of practice Task condition Planning L2 performance outcome Complexification Modality? writing/speaking Complexity? Subordination Complexity? Other measures Scope of measure? duration/timing Planning? Focus, structure, pressure Learner proficiency? “ L-H”, “N-I-A”, “450-600” Task features?  Type, difficulty, form,  mono-dialogic, interlocutors ?
Measurement in TBLT: Problems of practice Task condition +  strategic planning L2 performance outcome Complexification Complexity? Clauses per C-Unit Learner proficiency? TOEFL: 427-670 Elder & Iwashita (2005) X X X
Measurement in TBLT: Problems of practice Task condition +  strategic planning L2 performance outcome Complexification Complexity? Words/T-Unit Clauses per T-Unit Total Subordination Learner proficiency? TOEFL: 420-480 TOEFL: 510-580 TOEFL: 560-610 Kawauichi (2005)
Measurement in TBLT: An empirical approach to practice In what ways are  what kinds  of planning associated with  what kinds  of L2 performance for  what kinds  of L2 users under what conditions…and why?
Measurement in TBLT: An empirical approach to practice “ ... descriptive longitudinal studies  which establish norms of performance for particular processes and phenomena in L2 acquisition…”  Norris & Ortega, 2003, p. 738   “… attempting to ‘measure’ acquisition without a sound descriptive basis for meaningful differences in particular acquisition-related behaviors would be akin to timing a runner’s performance over a mile without knowing how many times around the track a mile happens to be…”
Measurement in TBLT: An empirical approach to practice Georgetown University German Department: “ Syntactic complexity development in task-based writing” Longitudinal (23) +  Cross-sectional (329) Extended and extemporaneous writing tasks Multiple measures, including Multiple measures of SC End-of-curricular levels Across 4 years
Syntactic complexity in curriculum-embedded writing assessment: LONGITUDINAL Global compexification   Phrasal elaboration Subordination 
Syntactic complexity in curriculum-embedded writing assessment: CROSS-SECTIONAL Global compexification  Subordination   Phrasal elaboration
Measurement in TBLT: An empirical approach to practice Implications for measuring syntactic complexity in task-based research ,[object Object],[object Object],[object Object],Synthesis of research findings on syntactic complexity See: Ortega (2000, 2003)
In short… TBLT in situ ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Practice Empirical Measurement Measurement in TBLT: Responding to research purposes How does TBLT work, for whom, when, why?
The Role of Assessment in TBLT Informing decisions and actions… … to enable task-based learning
Assessment in TBLT: Responding to educative purposes What is assessment? … the use of tests and other procedures for gathering trustworthy information about learners and making decisions and taking actions on the basis of that information, in support of teaching and learning…
Assessment in TBLT: Responding to educative purposes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Educative assessment should… Enable  task-based  learning… Needs analysis, intake procedures  Feedback on TB pedagogy effects Interesting, meaningful tests Genre, task performance expectation Feedback on task performance Process-product articulation Internal TBA v. external mandate Language + content + task abilities Profile individual abilities in L2 use
Assessment in TBLT: Responding to educative purposes “ In other words, by focusing on task-based assessment—here writing—faculty faced their own assumptions about long-term development in instructed L2 learning and appropriate learning outcomes at particular stages in that sequence.” Byrnes (2002), p. 428
Assessment in TBLT: Responding to educative purposes “… the quality of task completion gave teachers a good understanding of what students did and did not know—often, a better understanding than most tests could provide.” Leaver & Kaplan (2004), p. 52
Assessment in TBLT: Responding to educative purposes “ Focusing on what one can do instead of the competencies one has yields a more direct link with language performance that can be observed in the real world.” Gysen & van Avermaet (2005), p. 51
Assessment in TBLT: Responding to educative purposes In short… TBLT ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Practice Empirical Assessment Does TBLT work, and how can we enable it?
Assessment in TBLT: Problems of practice Tensions in “how to” assess… L2 competence v. task ability Extrapolation v. prediction Construct v. consequence Control v. understand  Prescribe v. respond Enabling task-based learning ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Dichotomy v. multiplicity
Assessment in TBLT: Problems of practice “… the inferences we want to make are about underlying ‘language ability’ or ‘capacity for language use’ or ‘ability for use’…” Bachman (2002), p. 454 “…  assessments can have many different functions. What is appropriate for one assessment purpose may be inappropriate for another…” Council of Europe (2001), p. 180
Advanced intercultural evaluation: An online French course Starkey & Osler (2001) Common European  Framework: Language+ Pluriculturalism, Anti-racism ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Assessment in TBLT: Problems of practice
Assessment in TBLT: Problems of practice “…  is not for the test designer to decide or prescribe. Rather, it should be the test users and stakeholders who inform exactly what needs to be done in the name of language assessment, and it is up to us to enable them to do so.” Norris (2002), p. 344
“ 1. The  intended use(s)  for task-based assessment within the language programme must be specified…”  Long & Norris (2000), p. 600 Assessment in TBLT: An empirical approach to practice
Specifying intended assessment use From: Norris (2000)
Assessment in TBLT: Examples in practice, Specification process ,[object Object],[object Object],[object Object],[object Object]
Assessment in TBLT: Examples in practice, Specification products Intended assessment use specification Assessment policies Use specs for all tests Priorities for Development Assessment Constraints Quizzes Exams Performance Internal External Time Money Ethics Training Unknowns (Urgent!)  Placement Learning outcomes External Accountability Developing Implementing Articulating Communicating Evaluating
Assessment in TBLT: Examples in practice, Use specification Intended use Who : Teachers, curriculum developers, researchers What : Learner written task/genre performance abilities at the end of each curricular level Why : Understanding student achievement of targeted task abilities for improvement of C&I Impact : Feasible (revised?) curricular expectations supported by effective (improved?) pedagogy ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Task-based writing assessment
Task Content L   conventions L focus Assignment 1 Assignment 2 Process writing 4-6 tasks per semester Assignment 3 Assignment 4 Prototypical Performance Writing Task: Level I Level II Level III Level IV Curricular level/genre learning expectations Feedback loop Explicit criteria Assessment in TBLT: Examples in practice, Instruments
Assessment in TBLT: Examples in practice, Impact ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Assessment in TBLT: Responding to educative purposes In short… TBLT in situ ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Practice Empirical Assessment Does TBLT work, and how can we enable it?
The Role of Evaluation in TBLT Articulating empirical practice… … to improve task-based education … with practical value
Evaluation in TBLT: Responding to program purposes What is evaluation? … gathering trustworthy information about program elements in order to understand, demonstrate, and improve program value…
In short… TBLT in situ ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Practice Empirical Evaluation What is TBLT worth, and how can we improve it? Evaluation in TBLT: Responding to program purposes
Evaluation in TBLT: Responding to program purposes “ Given the checkered history of prescriptions for language teaching, the likelihood that all 10 TBLT MPs will turn out to have been well founded is minimal. Thus, designers … who draw upon these or other sources should build careful evaluation components into their delivery systems.”  Doughty & Long (2003), p. 68 “ In contrast to the extensive research into tasks…there have been no more than a handful of evaluations of task-based teaching” Ellis (2003), p. 323
Evaluation in TBLT: Problems of practice Nunan (1989) Crookes & Gass (1993) Willis (1996) Skehan (1998) Lee (2000) Bygate, Skehan, & Swain (2001) Ellis (2003) Leaver & Willis (2004) Nunan (2005) Overview books on TBLT… … with chapters on program evaluation… Ellis (2003)
Evaluation in TBLT: Problems of practice ,[object Object],[object Object],[object Object],[object Object],[object Object],(see Beretta, 1990a, 1990b; Beretta & Davies, 1985) Crisis of conscience Evaluation practice? Evaluation purpose? Evaluation impact? Theory v. practice???
Evaluation in TBLT: An empirical approach to practice Patton (1996) Utilization-focused Evaluation Intended uses Intended users Questions + Methods Understand Improve Educate Demonstrate worth Hold accountable Test theory Empower Teachers Administrators Curriculum writers Learners Parents/public Researchers Funders Values clarification Implementation Process-product Experimentation Synthesis
Evaluation in TBLT: Examples in practice Norris (2004) Evaluation of a US  college German FL  assessment program Van den Branden (to appear) Evaluation of task-based teacher development in Flanders
Assessment, measurement, and Evaluation in TBLT: Essential roles TBLT in situ Measurement Theory, Research Assessment Imple-mentation Evaluation Society, Value EMPIRICAL PRACTICE
http://www2.hawaii.edu/~jnorris [email_address] See link at:  www.tblt.org For more information: Contact me
See you in Hawaii for TBLT 2007!
http://www2.hawaii.edu/~jnorris [email_address] See link at:  www.tblt.org
REFERENCES Please see the following web site for a complete pdf file of references and resources from this presentation: http://www2.hawaii.edu/~jnorris/TBLT%20references.pdf

Mais conteúdo relacionado

Mais procurados

Task Based Language Teaching - TBLT
Task Based Language Teaching - TBLTTask Based Language Teaching - TBLT
Task Based Language Teaching - TBLTMüberra GÜLEK
 
Krashen's theory on Second Language Acquisition
Krashen's theory on Second Language AcquisitionKrashen's theory on Second Language Acquisition
Krashen's theory on Second Language Acquisitionmilaazofeifa
 
The definition of CLT By Alireza Sadeghiyan - www.academia.edu
The definition of CLT By Alireza Sadeghiyan - www.academia.eduThe definition of CLT By Alireza Sadeghiyan - www.academia.edu
The definition of CLT By Alireza Sadeghiyan - www.academia.eduAlireza Sadeghian
 
Lexical syllabus
Lexical syllabusLexical syllabus
Lexical syllabusUNACHI
 
English Language Teaching Methods
English Language Teaching MethodsEnglish Language Teaching Methods
English Language Teaching MethodsHala Nur
 
Language Planning and Policy
Language Planning and PolicyLanguage Planning and Policy
Language Planning and PolicyAssala Mihoubi
 
Task based-language-teaching k om
Task based-language-teaching k omTask based-language-teaching k om
Task based-language-teaching k omFlorida Hunay
 
The Communicative Approach of Language Teaching
The Communicative Approach of Language TeachingThe Communicative Approach of Language Teaching
The Communicative Approach of Language TeachingRapanzel Rose
 

Mais procurados (20)

Task based learning Vs PPP
Task based learning Vs PPPTask based learning Vs PPP
Task based learning Vs PPP
 
Task Based Language Teaching - TBLT
Task Based Language Teaching - TBLTTask Based Language Teaching - TBLT
Task Based Language Teaching - TBLT
 
The Post-Method era
The Post-Method eraThe Post-Method era
The Post-Method era
 
Product oriented syllabus1
Product oriented syllabus1Product oriented syllabus1
Product oriented syllabus1
 
Krashen's theory on Second Language Acquisition
Krashen's theory on Second Language AcquisitionKrashen's theory on Second Language Acquisition
Krashen's theory on Second Language Acquisition
 
The definition of CLT By Alireza Sadeghiyan - www.academia.edu
The definition of CLT By Alireza Sadeghiyan - www.academia.eduThe definition of CLT By Alireza Sadeghiyan - www.academia.edu
The definition of CLT By Alireza Sadeghiyan - www.academia.edu
 
Types of Syllabus
Types of SyllabusTypes of Syllabus
Types of Syllabus
 
Lexical syllabus
Lexical syllabusLexical syllabus
Lexical syllabus
 
English Language Teaching Methods
English Language Teaching MethodsEnglish Language Teaching Methods
English Language Teaching Methods
 
Process oriented syllabus
Process oriented syllabusProcess oriented syllabus
Process oriented syllabus
 
Situational syllabi
Situational syllabiSituational syllabi
Situational syllabi
 
Language Planning and Policy
Language Planning and PolicyLanguage Planning and Policy
Language Planning and Policy
 
Applied linguistics
Applied linguisticsApplied linguistics
Applied linguistics
 
Syllabus design
Syllabus designSyllabus design
Syllabus design
 
Situational syllabus
Situational syllabusSituational syllabus
Situational syllabus
 
Content based syllabi
Content based syllabiContent based syllabi
Content based syllabi
 
Task based-language-teaching k om
Task based-language-teaching k omTask based-language-teaching k om
Task based-language-teaching k om
 
The Communicative Approach of Language Teaching
The Communicative Approach of Language TeachingThe Communicative Approach of Language Teaching
The Communicative Approach of Language Teaching
 
Ug & sla
Ug & slaUg & sla
Ug & sla
 
Notional functional syllabuses
Notional functional syllabusesNotional functional syllabuses
Notional functional syllabuses
 

Destaque

Lecture 3 Materials Development and Adaptation
Lecture 3 Materials Development and AdaptationLecture 3 Materials Development and Adaptation
Lecture 3 Materials Development and AdaptationSalina Saharudin
 
Task centred approaches
Task centred approachesTask centred approaches
Task centred approachesNathan Loynes
 
Conceptual basis of l2 teaching and learning
Conceptual basis of l2 teaching and learningConceptual basis of l2 teaching and learning
Conceptual basis of l2 teaching and learningnmlugo
 
Instructed Language Learning
Instructed Language LearningInstructed Language Learning
Instructed Language LearningDr. Cupid Lucid
 
Materials development for language learning and teaching
Materials development for language learning and teachingMaterials development for language learning and teaching
Materials development for language learning and teachingBike
 
Social work helping models and approaches
Social work helping models and approachesSocial work helping models and approaches
Social work helping models and approachesFlorence Flores-Pasos
 

Destaque (10)

Lecture 3 Materials Development and Adaptation
Lecture 3 Materials Development and AdaptationLecture 3 Materials Development and Adaptation
Lecture 3 Materials Development and Adaptation
 
Stephen krashen
Stephen krashenStephen krashen
Stephen krashen
 
Task centred approaches
Task centred approachesTask centred approaches
Task centred approaches
 
Conceptual basis of l2 teaching and learning
Conceptual basis of l2 teaching and learningConceptual basis of l2 teaching and learning
Conceptual basis of l2 teaching and learning
 
Instructed Language Learning
Instructed Language LearningInstructed Language Learning
Instructed Language Learning
 
Task centered model....
Task centered model....Task centered model....
Task centered model....
 
Materials development for language learning and teaching
Materials development for language learning and teachingMaterials development for language learning and teaching
Materials development for language learning and teaching
 
Social work helping models and approaches
Social work helping models and approachesSocial work helping models and approaches
Social work helping models and approaches
 
Social Case Work
Social Case Work Social Case Work
Social Case Work
 
Theories of Social Work
Theories of Social WorkTheories of Social Work
Theories of Social Work
 

Semelhante a Tblt Presentation

Task based language teaching @mehdi sufi
Task based language teaching @mehdi sufiTask based language teaching @mehdi sufi
Task based language teaching @mehdi sufiIELTS Council
 
Task based learning
Task based learningTask based learning
Task based learningSa345mar
 
Task based-language-teachingkom-121024110933-phpapp01
Task based-language-teachingkom-121024110933-phpapp01Task based-language-teachingkom-121024110933-phpapp01
Task based-language-teachingkom-121024110933-phpapp01Àbdélhàdi ElhOùs
 
NTLTC 2011 - researching strategies and interventions - embedding literacy an...
NTLTC 2011 - researching strategies and interventions - embedding literacy an...NTLTC 2011 - researching strategies and interventions - embedding literacy an...
NTLTC 2011 - researching strategies and interventions - embedding literacy an...NTLT Conference
 
Task-based L2 pedagogy from the teacher’s point of view
Task-based L2 pedagogy from the teacher’s point of viewTask-based L2 pedagogy from the teacher’s point of view
Task-based L2 pedagogy from the teacher’s point of viewAndonic
 
TBL (Task based learning)
TBL (Task based learning)TBL (Task based learning)
TBL (Task based learning)tortadericota
 
Task design for telecollaborative exchanges - in search for new evaluation cr...
Task design for telecollaborative exchanges - in search for new evaluation cr...Task design for telecollaborative exchanges - in search for new evaluation cr...
Task design for telecollaborative exchanges - in search for new evaluation cr...the INTENT project
 
Joint construction Donnarumma & Shrestha 2011, EATAW conference, Ireland
Joint construction Donnarumma & Shrestha 2011, EATAW conference, IrelandJoint construction Donnarumma & Shrestha 2011, EATAW conference, Ireland
Joint construction Donnarumma & Shrestha 2011, EATAW conference, IrelandPrithvi Shrestha
 
Syllabus design by amina qatan (part one)
Syllabus design by amina qatan (part one)Syllabus design by amina qatan (part one)
Syllabus design by amina qatan (part one)A. Q.
 
K.McDonough (2011)_presentation_@ Concordia
K.McDonough (2011)_presentation_@ Concordia K.McDonough (2011)_presentation_@ Concordia
K.McDonough (2011)_presentation_@ Concordia alandon429
 
R2 LOOK, THINK, ACT: Meeting the Research Needs of Teacher Practitioners (Rob...
R2 LOOK, THINK, ACT: Meeting the Research Needs of Teacher Practitioners (Rob...R2 LOOK, THINK, ACT: Meeting the Research Needs of Teacher Practitioners (Rob...
R2 LOOK, THINK, ACT: Meeting the Research Needs of Teacher Practitioners (Rob...Center for Global Education at Asia Society
 
Managing academic literacy practices in specific disciplinary courses
Managing academic literacy practices in specific disciplinary coursesManaging academic literacy practices in specific disciplinary courses
Managing academic literacy practices in specific disciplinary coursesPeter Mickan
 
Design-based research: an introduction
Design-based research: an introductionDesign-based research: an introduction
Design-based research: an introductionPeter Reimann
 
Mica2011 mariis mills
Mica2011 mariis millsMica2011 mariis mills
Mica2011 mariis millsMarianne Riis
 
Gtn action research presentation slides1
Gtn action research presentation slides1Gtn action research presentation slides1
Gtn action research presentation slides1Laura Anaya-Graham
 
Language teaching methods: from past to future
Language teaching methods: from past to futureLanguage teaching methods: from past to future
Language teaching methods: from past to futureedac4co
 
A practice perspective on the challenges of Inquiry Based Learning
A practice perspective on the challenges of Inquiry Based LearningA practice perspective on the challenges of Inquiry Based Learning
A practice perspective on the challenges of Inquiry Based LearningFleur Prinsen
 
X-based language teaching approaches
X-based language teaching approaches X-based language teaching approaches
X-based language teaching approaches Wu Heping
 

Semelhante a Tblt Presentation (20)

Task based language teaching @mehdi sufi
Task based language teaching @mehdi sufiTask based language teaching @mehdi sufi
Task based language teaching @mehdi sufi
 
Task based learning
Task based learningTask based learning
Task based learning
 
Task based-language-teachingkom-121024110933-phpapp01
Task based-language-teachingkom-121024110933-phpapp01Task based-language-teachingkom-121024110933-phpapp01
Task based-language-teachingkom-121024110933-phpapp01
 
NTLTC 2011 - researching strategies and interventions - embedding literacy an...
NTLTC 2011 - researching strategies and interventions - embedding literacy an...NTLTC 2011 - researching strategies and interventions - embedding literacy an...
NTLTC 2011 - researching strategies and interventions - embedding literacy an...
 
Task-based L2 pedagogy from the teacher’s point of view
Task-based L2 pedagogy from the teacher’s point of viewTask-based L2 pedagogy from the teacher’s point of view
Task-based L2 pedagogy from the teacher’s point of view
 
TBL (Task based learning)
TBL (Task based learning)TBL (Task based learning)
TBL (Task based learning)
 
Task design for telecollaborative exchanges - in search for new evaluation cr...
Task design for telecollaborative exchanges - in search for new evaluation cr...Task design for telecollaborative exchanges - in search for new evaluation cr...
Task design for telecollaborative exchanges - in search for new evaluation cr...
 
Graziano presentazione CLIL
Graziano presentazione CLILGraziano presentazione CLIL
Graziano presentazione CLIL
 
Joint construction Donnarumma & Shrestha 2011, EATAW conference, Ireland
Joint construction Donnarumma & Shrestha 2011, EATAW conference, IrelandJoint construction Donnarumma & Shrestha 2011, EATAW conference, Ireland
Joint construction Donnarumma & Shrestha 2011, EATAW conference, Ireland
 
Syllabus design by amina qatan (part one)
Syllabus design by amina qatan (part one)Syllabus design by amina qatan (part one)
Syllabus design by amina qatan (part one)
 
K.McDonough (2011)_presentation_@ Concordia
K.McDonough (2011)_presentation_@ Concordia K.McDonough (2011)_presentation_@ Concordia
K.McDonough (2011)_presentation_@ Concordia
 
R2 LOOK, THINK, ACT: Meeting the Research Needs of Teacher Practitioners (Rob...
R2 LOOK, THINK, ACT: Meeting the Research Needs of Teacher Practitioners (Rob...R2 LOOK, THINK, ACT: Meeting the Research Needs of Teacher Practitioners (Rob...
R2 LOOK, THINK, ACT: Meeting the Research Needs of Teacher Practitioners (Rob...
 
Managing academic literacy practices in specific disciplinary courses
Managing academic literacy practices in specific disciplinary coursesManaging academic literacy practices in specific disciplinary courses
Managing academic literacy practices in specific disciplinary courses
 
Design-based research: an introduction
Design-based research: an introductionDesign-based research: an introduction
Design-based research: an introduction
 
Mica2011 mariis mills
Mica2011 mariis millsMica2011 mariis mills
Mica2011 mariis mills
 
Gtn action research presentation slides1
Gtn action research presentation slides1Gtn action research presentation slides1
Gtn action research presentation slides1
 
Language teaching methods: from past to future
Language teaching methods: from past to futureLanguage teaching methods: from past to future
Language teaching methods: from past to future
 
A practice perspective on the challenges of Inquiry Based Learning
A practice perspective on the challenges of Inquiry Based LearningA practice perspective on the challenges of Inquiry Based Learning
A practice perspective on the challenges of Inquiry Based Learning
 
X-based language teaching approaches
X-based language teaching approaches X-based language teaching approaches
X-based language teaching approaches
 
Presentation for MAKAIAS
Presentation for MAKAIASPresentation for MAKAIAS
Presentation for MAKAIAS
 

Mais de Dr. Cupid Lucid

Teaching English for specific purposes
Teaching English for specific purposesTeaching English for specific purposes
Teaching English for specific purposesDr. Cupid Lucid
 
Science and approaches of science
Science and approaches of scienceScience and approaches of science
Science and approaches of scienceDr. Cupid Lucid
 
Content Analysis vs secondary analysis
Content Analysis vs secondary analysisContent Analysis vs secondary analysis
Content Analysis vs secondary analysisDr. Cupid Lucid
 
Basic elements of scientific concepts
Basic elements of scientific  conceptsBasic elements of scientific  concepts
Basic elements of scientific conceptsDr. Cupid Lucid
 
Types of educational_research
Types of educational_researchTypes of educational_research
Types of educational_researchDr. Cupid Lucid
 
History of english literature sajid
History of english literature sajidHistory of english literature sajid
History of english literature sajidDr. Cupid Lucid
 
A guide to_writing_research_papers
A guide to_writing_research_papersA guide to_writing_research_papers
A guide to_writing_research_papersDr. Cupid Lucid
 
101 masterpieces of literature in english
101 masterpieces of literature in english101 masterpieces of literature in english
101 masterpieces of literature in englishDr. Cupid Lucid
 
National Curriculum of English Grade I-XII
National Curriculum of English Grade I-XIINational Curriculum of English Grade I-XII
National Curriculum of English Grade I-XIIDr. Cupid Lucid
 
The Linguistic Variables
The Linguistic VariablesThe Linguistic Variables
The Linguistic VariablesDr. Cupid Lucid
 
Research Proposal Methoo
Research Proposal MethooResearch Proposal Methoo
Research Proposal MethooDr. Cupid Lucid
 

Mais de Dr. Cupid Lucid (20)

Teaching English for specific purposes
Teaching English for specific purposesTeaching English for specific purposes
Teaching English for specific purposes
 
Science and approaches of science
Science and approaches of scienceScience and approaches of science
Science and approaches of science
 
Content Analysis vs secondary analysis
Content Analysis vs secondary analysisContent Analysis vs secondary analysis
Content Analysis vs secondary analysis
 
Basic elements of scientific concepts
Basic elements of scientific  conceptsBasic elements of scientific  concepts
Basic elements of scientific concepts
 
Observational methods
Observational methodsObservational methods
Observational methods
 
Types of educational_research
Types of educational_researchTypes of educational_research
Types of educational_research
 
Types of research
Types of researchTypes of research
Types of research
 
Types of Research
Types of ResearchTypes of Research
Types of Research
 
Literature what is it
Literature what is itLiterature what is it
Literature what is it
 
History of english literature sajid
History of english literature sajidHistory of english literature sajid
History of english literature sajid
 
A guide to_writing_research_papers
A guide to_writing_research_papersA guide to_writing_research_papers
A guide to_writing_research_papers
 
What isliterature
What isliteratureWhat isliterature
What isliterature
 
101 masterpieces of literature in english
101 masterpieces of literature in english101 masterpieces of literature in english
101 masterpieces of literature in english
 
National Curriculum of English Grade I-XII
National Curriculum of English Grade I-XIINational Curriculum of English Grade I-XII
National Curriculum of English Grade I-XII
 
The Linguistic Variables
The Linguistic VariablesThe Linguistic Variables
The Linguistic Variables
 
Term Paper
Term PaperTerm Paper
Term Paper
 
Syllabus Designing
Syllabus DesigningSyllabus Designing
Syllabus Designing
 
Semiotics Final
Semiotics FinalSemiotics Final
Semiotics Final
 
Research Proposal Methoo
Research Proposal MethooResearch Proposal Methoo
Research Proposal Methoo
 
Questionnaire
QuestionnaireQuestionnaire
Questionnaire
 

Último

UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Brian Pichman
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfDianaGray10
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfDaniel Santiago Silva Capera
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarPrecisely
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 

Último (20)

UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdfIaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
IaC & GitOps in a Nutshell - a FridayInANuthshell Episode.pdf
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 

Tblt Presentation

  • 1. John M. Norris University of Hawai´i Task-Based Language Teaching 2005
  • 2. This Powerpoint presentation is copyrighted by John M. Norris © September 23, 2005 Citation information: Norris, J. M. (2005, September). The essential roles of assessment, measurement, and evaluation in task-based language teaching . Plenary address presented at the First International Conference on Task-Based Language Teaching, University of Leuven, Belgium (September 23, 2005).
  • 3. 0:00 9:00 3:00 6:00 12:00 21:00 15:00 18:00 What time is it in Leuven ? What time is it in Hawaii ? “ Here and Now” condition “ There and… ” condition Now
  • 4.
  • 5. measurement, The essential roles of assessment, and evaluation in task-based language teaching
  • 6. TBLT 2005: What’s at stake? ??? Language Education ??? Does it work? for whom, when, why? What’s it worth? to whom, when, why? How does it work? for whom, when, why? Can it be improved? by whom, when, why?
  • 7. TBLT 2005: What’s at stake? … another L2 teaching method bandwagon… The critics say… … cognitive-interactionist SLA hegemony… … won’t work with _____ learners… … not possible in _____ program settings… … too much task, not enough language… … not happening in practice… T B L T
  • 8. Setting the record straight: TBLT at work TARGET LANGUAGES English Dutch French Czech Chinese Arabic Ukranian Japanese Russian Spanish Korean German
  • 9. Setting the record straight: TBLT at work PROGRAM TYPES Second Language Foreign Language Vocational Education General Education Local Innovation Small Classes National Ed. Policy Special Purposes Adult Child University Requirement Large Classes Beginning Learners Advanced Learners Face-to- Face Online
  • 10. Setting the record straight: TBLT foundations “ All genuine education terminates in discipline, but it proceeds by engaging the mind in activities worthwhile for their own sake.” Dewey (1933), pp. 86-87
  • 11. Setting the record straight: TBLT foundations “ This discussion rejects the doctrine that students should first learn passively, and then, having learned, should apply knowledge. […] In fact, the applications are part of the knowledge. For the very meaning of things known is wrapped up in their relationships beyond themselves. Thus, unapplied knowledge is knowledge shorn of its meaning.” Whitehead, 1947, pp. 218-219
  • 12. Setting the record straight: TBLT foundations “ For starters, this means having students do tasks, or at least meaningful simulations, that experts do in the various disciplines. Second, it means teaching them to think in ways that experts do when they perform these tasks.” Sternberg (2003), p. 5
  • 13. Setting the record straight: Other task-based domains Medical school Nursing Curriculum by design Successful intelligence Environmental studies Social work Task-Based Practice Music education
  • 14. Setting the record straight: So what is TBLT? Task-Based Language Teaching Rationales and Principles Education Philosophy Psychology SLA Language teaching Sociopolitical values L2 Education Programs Learner needs Assessment Curriculum Instruction Teacher development Evaluation Materials
  • 15. The potential of task-based practice: One example William Reid Reid. W. J. (1992). Task strategies: An empirical approach to social work practice . New York: Columbia University Press. Social work problems : truancy, aging, delinquency, substance abuse, family health
  • 16. Task-Centered Practice Empirical Justification Empirical Implementation Theory Learning, behavior, cognition Research Psychosocial change, Problem solving Evaluation Case work practice, Intervention outcomes Needs Identify, agree, prioritize Action Plan, rehearse, attempt, feedback Assessment Task accomplishment, Problem change Development Practitioner-friendly methods Improvement Field-tested findings The potential of task-based practice: One example
  • 17. The potential of task-based practice: One example “ Assessment, process, and outcome data are systematically collected in each case by means of structured recording guidelines. Continuing research is used to improve the model.” (Reid, 1992, p. 132). Development Improvement Field-testing
  • 18. “ [Reid] was the single most significant figure in social work research” Shaw (2004) p. 113 The potential of task-based practice: One example
  • 19. Task-Based Language Teaching: A(nother) method for language teaching. The potential of task-based practice: TBLT
  • 20. Task-Based Language Teaching: A(nother) method for language education practice. The potential of task-based practice: TBLT
  • 21. Task-Based Language Teaching: An empirical approach to language education practice. The potential of task-based practice: TBLT Assessment Measurement Evaluation
  • 22. The Role of Measurement in TBLT Interpreting research constructs… … to understand task-based learning
  • 23. Measurement in TBLT: Responding to research purposes What is measurement? … trustworthy definition, elicitation, observation, analysis, and interpretation of research constructs…
  • 24.
  • 25. Measurement in TBLT: Responding to research purposes “ Perhaps the best recommendation would be that, with research in this area still developing techniques and understandings, the role of A/L work will be to offer suggestions for relevant variables and the standardization of operationalizations of variables…” Tavakoli & Skehan, 2005, p. 273
  • 26.
  • 27.
  • 28. Task influence on L2 performance (adapted from: Skehan, 2001) Measurement in TBLT: Problems of practice 0 + 0 Transformations (planning) 0 + 0 Outcomes + 0 + Structure - + + Dialogic v. Monologic + 0 + Familiarity Fluency Complexity Accuracy Task characteristic
  • 29. Task influence on L2 performance (adapted from: Skehan, 2001) Measurement in TBLT: Problems of practice 0 + 0 Transformations (planning) 0 + 0 Outcomes + 0 + Structure - + + Dialogic v. Monologic + 0 + Familiarity Fluency Complexity Accuracy Task characteristic
  • 30. “… giving learners the opportunity to plan before a task is done consistently produces greater complexity of language…” (Skehan, 2003, pp. 395-96) Measurement in TBLT: Problems of practice “ To sum up, both modality and group condition affected complexity at the level of syntax…” (Ellis & Yuan, 2005, p. 184)
  • 31. Measurement in TBLT: Problems of practice Task condition Planning L2 performance outcome Complexification Modality? writing/speaking Complexity? Subordination Complexity? Other measures Scope of measure? duration/timing Planning? Focus, structure, pressure Learner proficiency? “ L-H”, “N-I-A”, “450-600” Task features? Type, difficulty, form, mono-dialogic, interlocutors ?
  • 32. Measurement in TBLT: Problems of practice Task condition + strategic planning L2 performance outcome Complexification Complexity? Clauses per C-Unit Learner proficiency? TOEFL: 427-670 Elder & Iwashita (2005) X X X
  • 33. Measurement in TBLT: Problems of practice Task condition + strategic planning L2 performance outcome Complexification Complexity? Words/T-Unit Clauses per T-Unit Total Subordination Learner proficiency? TOEFL: 420-480 TOEFL: 510-580 TOEFL: 560-610 Kawauichi (2005)
  • 34. Measurement in TBLT: An empirical approach to practice In what ways are what kinds of planning associated with what kinds of L2 performance for what kinds of L2 users under what conditions…and why?
  • 35. Measurement in TBLT: An empirical approach to practice “ ... descriptive longitudinal studies which establish norms of performance for particular processes and phenomena in L2 acquisition…” Norris & Ortega, 2003, p. 738 “… attempting to ‘measure’ acquisition without a sound descriptive basis for meaningful differences in particular acquisition-related behaviors would be akin to timing a runner’s performance over a mile without knowing how many times around the track a mile happens to be…”
  • 36. Measurement in TBLT: An empirical approach to practice Georgetown University German Department: “ Syntactic complexity development in task-based writing” Longitudinal (23) + Cross-sectional (329) Extended and extemporaneous writing tasks Multiple measures, including Multiple measures of SC End-of-curricular levels Across 4 years
  • 37. Syntactic complexity in curriculum-embedded writing assessment: LONGITUDINAL Global compexification   Phrasal elaboration Subordination 
  • 38. Syntactic complexity in curriculum-embedded writing assessment: CROSS-SECTIONAL Global compexification  Subordination   Phrasal elaboration
  • 39.
  • 40.
  • 41. The Role of Assessment in TBLT Informing decisions and actions… … to enable task-based learning
  • 42. Assessment in TBLT: Responding to educative purposes What is assessment? … the use of tests and other procedures for gathering trustworthy information about learners and making decisions and taking actions on the basis of that information, in support of teaching and learning…
  • 43.
  • 44. Assessment in TBLT: Responding to educative purposes “ In other words, by focusing on task-based assessment—here writing—faculty faced their own assumptions about long-term development in instructed L2 learning and appropriate learning outcomes at particular stages in that sequence.” Byrnes (2002), p. 428
  • 45. Assessment in TBLT: Responding to educative purposes “… the quality of task completion gave teachers a good understanding of what students did and did not know—often, a better understanding than most tests could provide.” Leaver & Kaplan (2004), p. 52
  • 46. Assessment in TBLT: Responding to educative purposes “ Focusing on what one can do instead of the competencies one has yields a more direct link with language performance that can be observed in the real world.” Gysen & van Avermaet (2005), p. 51
  • 47.
  • 48.
  • 49. Assessment in TBLT: Problems of practice “… the inferences we want to make are about underlying ‘language ability’ or ‘capacity for language use’ or ‘ability for use’…” Bachman (2002), p. 454 “… assessments can have many different functions. What is appropriate for one assessment purpose may be inappropriate for another…” Council of Europe (2001), p. 180
  • 50.
  • 51. Assessment in TBLT: Problems of practice “… is not for the test designer to decide or prescribe. Rather, it should be the test users and stakeholders who inform exactly what needs to be done in the name of language assessment, and it is up to us to enable them to do so.” Norris (2002), p. 344
  • 52. “ 1. The intended use(s) for task-based assessment within the language programme must be specified…” Long & Norris (2000), p. 600 Assessment in TBLT: An empirical approach to practice
  • 53. Specifying intended assessment use From: Norris (2000)
  • 54.
  • 55. Assessment in TBLT: Examples in practice, Specification products Intended assessment use specification Assessment policies Use specs for all tests Priorities for Development Assessment Constraints Quizzes Exams Performance Internal External Time Money Ethics Training Unknowns (Urgent!) Placement Learning outcomes External Accountability Developing Implementing Articulating Communicating Evaluating
  • 56.
  • 57. Task Content L conventions L focus Assignment 1 Assignment 2 Process writing 4-6 tasks per semester Assignment 3 Assignment 4 Prototypical Performance Writing Task: Level I Level II Level III Level IV Curricular level/genre learning expectations Feedback loop Explicit criteria Assessment in TBLT: Examples in practice, Instruments
  • 58.
  • 59.
  • 60. The Role of Evaluation in TBLT Articulating empirical practice… … to improve task-based education … with practical value
  • 61. Evaluation in TBLT: Responding to program purposes What is evaluation? … gathering trustworthy information about program elements in order to understand, demonstrate, and improve program value…
  • 62.
  • 63. Evaluation in TBLT: Responding to program purposes “ Given the checkered history of prescriptions for language teaching, the likelihood that all 10 TBLT MPs will turn out to have been well founded is minimal. Thus, designers … who draw upon these or other sources should build careful evaluation components into their delivery systems.” Doughty & Long (2003), p. 68 “ In contrast to the extensive research into tasks…there have been no more than a handful of evaluations of task-based teaching” Ellis (2003), p. 323
  • 64. Evaluation in TBLT: Problems of practice Nunan (1989) Crookes & Gass (1993) Willis (1996) Skehan (1998) Lee (2000) Bygate, Skehan, & Swain (2001) Ellis (2003) Leaver & Willis (2004) Nunan (2005) Overview books on TBLT… … with chapters on program evaluation… Ellis (2003)
  • 65.
  • 66. Evaluation in TBLT: An empirical approach to practice Patton (1996) Utilization-focused Evaluation Intended uses Intended users Questions + Methods Understand Improve Educate Demonstrate worth Hold accountable Test theory Empower Teachers Administrators Curriculum writers Learners Parents/public Researchers Funders Values clarification Implementation Process-product Experimentation Synthesis
  • 67. Evaluation in TBLT: Examples in practice Norris (2004) Evaluation of a US college German FL assessment program Van den Branden (to appear) Evaluation of task-based teacher development in Flanders
  • 68. Assessment, measurement, and Evaluation in TBLT: Essential roles TBLT in situ Measurement Theory, Research Assessment Imple-mentation Evaluation Society, Value EMPIRICAL PRACTICE
  • 69. http://www2.hawaii.edu/~jnorris [email_address] See link at: www.tblt.org For more information: Contact me
  • 70. See you in Hawaii for TBLT 2007!
  • 72. REFERENCES Please see the following web site for a complete pdf file of references and resources from this presentation: http://www2.hawaii.edu/~jnorris/TBLT%20references.pdf