Resumen de Assessing short-term change in advanced oral proficiency: problems of reliability & validity in four case studies
This paper presents four case studies to demonstrate developments in oral proficiency made by advanced learners of English during two months in England. The data base consists of picture story oral narratives. Performance shortly after arrival in Britain is compared with that at the end of the two months.
Assessment was by:
1) subjective reactions of a panel of experienced native-speaker EFL teachers 2) quantitative analysis of transcriptions of recordings.
An attempt is made to apply VORSTER's (1980) components of proficiency developed for use with children mother tongue speakers.
The main findings were as follows:
1) There was considerable dissension among teachers, so that the reliability of subjective teacher assessent in such cases must be seriously questioned.
2) Results ont he objective quantitative measures were very chequered, suggesting that the variables chosen did not, in many cases, function well to identify developments, over so short a period.
3) Nevertheless, there were clear trends towards improvements in productivity and modality (co-verbs).
4) There were signs of individual differences among subjects in route of development.
