Volume 13, Number 4, April 1995



Inside Inkshed
M-L Craven Editorial Notes:CALL for Papers for CCCC96
Margaret Procter Post-Admission Assessment of Writing at Ontario Universities:
Part One

Part Two

Co-Editors

James Brown, Mary-Louise Craven, Tom Greenwald, Jan Rehner,
Leslie Sanders, Ron Sheese, John Spencer, and Gail Van Stone
from the Writing Programmes at York University
(including the Faculty of Arts' Centre for Academic Writing, The Computer-Assisted Writing Centre, and Atkinson College's Essay Tutoring Centre)
% Mary-Louise Craven
530 Scott Library
York University, 4700 Keele Street,
North York, Ontario M3J 1P3
email: inkshed@yorku.ca
Fax: 416-736-5464

Consulting Editors

Phyllis Artiss
Memorial University
Neil Besner
University of Winnipeg
Russell A. Hunt
St. Thomas University
Wayne Lucey
Assumption Catholic High School
Burlington, ON
Susan Drain
Mount Saint Vincent University

Richard M. Coe
Simon Fraser University
Lester Faigley
University of Texas
James A. Reither
St. Thomas University
Judy Segal
University of British University
Graham Smart
Bank of Canada



Inkshed provides a forum for its subscribers to explore relationships among research, theory, and practice in language acquisition and language use. Subscribers are invited to submit informative pieces such as notices, reports, and reviews of articles, journals, books, textbooks, conferences, and workshops, as well as polemical discussions of events, issues, problems, and questions of concern to teachers in Canada interested in writing and reading theory and practice.

Inkshed is published five times during the academic year. The following is a schedule of submission deadlines and approximate publication dates:

15 September, for 1 October 1 February, for 15 February
15 November, for 1 December 1 April, for 15 April
Post-Conference: June-July


This newsletter is supported financially by the various Writing Programmes at York University. To become a member of the Inkshed organization, make cheques for $27.50 (or $17.50 for students or under employed ) payable to Inkshed at NSCAD c/o Kenna Manos, Nova Scotia College of Art and Design, 5163 Duke Street, Halifax, N.S. B3J 3J6. Fees support the Inkshed Publishing Initiative and on-going organizational expenses.

Back to Table of Contents

Editorial Notes:CALL for Papers for CCCC96

- Milwaukee, Wisconsin, March 27-30, 1996

Traditionally our SIG, the Canadian Caucus, of the College Composition and Communication organization, holds a meeting at the 3C's conference. This past conference in Washington in preparation for the 1996 meeting, as Anthony reports, "it was decided to to split our time (1 or 1-1/4 hour) between business and socializing. I'd suggest that we leave the preparation of the agenda and the initial planning for the socializing up to the current Inkshed editors (sorry folks). They can wait until the pre-CCCC newsletter to make a call for agenda items and they can ask for volunteers to organize the social stuff (Doug Vipond is very good at that sort of work)..." So, ever ready to follow the advice of the previous editor, and in keeping with the Canadian Caucus traditions, we will remind Inkshedders, in the December 1995 issue, about the caucus meeting and ask for proposals. In a CASLL message, Cathy Schryer had a good idea about asking for reports from the various "wings" of our community--the publishing wing, the Writing Centre wing, etc. So if you have any ideas about what we could/should do at the Canadian Caucus, please send them along to us.

Cathy Schryer wants to propose the following Forum to be submitted to the CCCC jury for consideration. Apparently in the past, the Canadian Caucus could sponsor a Forum (as well as its Caucus meeting), but according to Anthony, the 3CCC Conference organizers are not "privileging" SIG-sponsored forums anymore, so Cathy's proposal has to go "into the pot" along with all others. Please NOTE the urgency of meeting the deadline.

Title: WAC/WIDS and Writing to Learn in the Canadian Context

Interested instructors/researchers on the the topic of Writing Across the Disciplines in the Canadian context are invited to submit proposals for a forum* on WAC/WID. This forum will attempt to accomplish 2 tasks. It will explore the institutional differences that characterize the Canadian academy in its treatment of writing. It will also explore political, logistical and pedagogical strategies that either overcome or capitalize on those differences.

*(A forum is a 5-10 minute presentation followed by a discussion.)

Please send 100-200 word proposals to Catherine Schryer by Wednesday, April 26.

email submissions are welcomed at: cschryer@watarts.uwaterloo.ca
fax can be sent to: (519) 746-5788
snail mail to: Catherine F. Schryer / Dept. of English / University of Waterloo / Waterloo, Ontario / N2L 3G1

Back to Table of Contents

Post-Admission Assessment of Writing at Ontario Universities:
Part One


We are pleased to be able to reprint Margaret's report (prepared for the Council of Ontario Universities). Perhaps we could publish a follow-up report from those other non-Ontario universities not included in the report? For further information, please contact Margaret Procter at procter@epas.utoronto.ca or Room 216, University College, University of Toronto, Toronto, Ontario M5SlAl.
POST-ADMISSION ASSESSMENT OF WRITING:
ISSUES AND INFORMATION

INTRODUCTION

The question whether the University of Toronto should test its incoming admitted students for writing competence keeps arising in discussions of both undergraduate and graduate programs. In 1992, for instance, the Provostial Steering Group on Writing considered the matter and called for further research and discussion. In the spring of 1994, just after I was appointed Coordinator of Writing Support, the subcommittee on Academic Policies and Programs asked me to report back within a year with ideas that might help both undergraduate and graduate programs decide what post-admission testing would be desirable and feasible. The Council of Ontario Universities, through our representative Professor Guy Hamel, encouraged me to proceed in gathering information. I have since heard expressions of interest from the Commission on Undergraduate Student Recruitment and Admission and from various college and faculty committees, as well as from individual administrators, faculty members, and students across the university.

This report responds to these interests by providing information about practices here and at other universities. Part 1 is based on a survey I conducted of all universities in Ontario. The survey was assisted by the Council of Ontario Universities, and this section of my report has been distributed by COU to all universities in Ontario. Part 2 samples types of post-admission assessment at comparable institutions in the rest of Canada and the U.S. The report ends with a brief summation of implications for the University of Toronto.

Testing students after they are admitted to university implies a relationship of the test to the university programs of instruction. The information given here therefore includes attention to follow-up instruction in writing and to the writing expected in courses of study at the university. Pre-admission testing is not a main topic of this report, though it is touched on in Part 2; it is being discussed elsewhere at this university and among Ontario universities. The issues particular to graduate studies are also not an explicit focus of my research, though many ideas here may be found relevant, particularly the accounts in Part 2 of different kinds of tests.

In my research and discussions so far, I have been encouraged and challenged by the resolve of many people at the University of Toronto to improve our students' access to the literacy summed up in writing competence. I hope this document provides ideas that will stimulate us further as an institution to examine and redesign our own practices.

Part 1: ONTARIO UNIVERSITIES:
POST-ADMISSION TESTS AND PROGRAMS

With help from the Council of Ontario Universities in procuring contact names, addresses, and phone and fax numbers, I have surveyed the practices of all nineteen Ontario universities in conducting post-admission testing of their incoming undergraduates' writing skills. The results are complex. Only four institutions test all or most of their incoming students; they use the results for placement into follow-up instruction in writing. The remaining fifteen have developed a range of other ways to assess students and maintain standards of writing proficiency. The variety of programs is striking, and innovations are ongoing.

It should be noted that all Ontario universities have specific requirements for credits in English or French. Students applying from the Ontario school system need a credit in OAC English (sometimes specifically English 1) or francais. Visa applicants and recent immigrants must present specified scores in tests of English reading and writing, sometimes including oral components. Some universities have also begun to specify a certain number of years of schooling in English-language systems.

The following annotated list outlines the post-admission assessment and support systems at Ontario universities, grouped into testing and non-testing categories. A list is appended of the people to whom I talked at each university. I also consulted calendars, other informational material for students, and published accounts of writing programs.

These issues arose repeatedly in my discussions:



MANDATORY POST-ADMISSION TESTING

The following Ontario universities require all or most incoming undergraduate students to take a test of writing after admission. All use the results to place students in formal programs of writing instruction. These four universities exemplify programs of distinct types. Cost figures are given where available, but programs are so different that comparisons are not reliable.

Laurentian University has the most widely based writing program of any Ontario university. The Centre for the Official Languages of t-nnada administers a timed essay test (500 words, two hours) to all incoming students in both the English and the French streams. Faculty members score essays holistically within 48 hours. Students need a score of 3 to proceed to second year, and 1 to graduate. To improve their scores, students may take the test again or take courses designated "Writing Across the Curriculum" or "langue Integree aux Programmes." These are regular courses in a range of ans and social science departments, accredited by the Centre. They ask for substantial amounts of writing and give special attention to the process and expectations of writing in the particular disciplines. The 87 course sections currently enroll 2400 students, of whom throe quarters have already cleared the competency requirement for their year level. Instructors of these courses can call on the help of writing specialists in the Centre, including a consultant cross-appointed to the English Department. The Centre provides individual tutoring and group work in both French and English to all students. The English Department offers introductory composition courses in versions for native speakers, francophone students, and students whose first language is neither English nor French; its introductory course in literature also includes attention to writing.The budget for testing and the other work of the Centre is S290,000 yearly; 3000 students take the tests each year, including 2000 entering students.

(Lakehead University: See page 7 for an account of the program planned to begin in 1995-6.)

Nipissing University, like its parent university Laurentian, has a competency requirement based on a timed 500 word argumentative essay on a general topic, graded for spelling, punctuation, grammar, vocabulary and organization. Until 1993, students took this test as a graduation requirement; between one third and one half of students taking it for the first time failed. For the last two years Nipissing has required incoming first-year students to write the competency test to establish a baseline score. About half receive a 1 or passing score. Students receiving a 3 are expected to withdraw from a credit course and enroll in a non credit composition course for which they pay full tuition fees. About 25 students have been required to take this course each year; last year 20 of the 25 in the class had improved significantly by their second writing of the competency test. Student reactions to this imposed change in their programs range from gratitude to resentment. Students receiving a score of 2 are encouraged to take at least one of two credit half-courses offered by the English department. The few students recognized as learners of English as a second language (a total of 10 in the university) may take one or two ESL credit half-courses; they are graded according to different standards when they re-take the competency test. Last year, nevertheless, one appealed the results of the test on the grounds of cultural bias. A Writing skills Coordinator administers the test and teaches the non-credit courses. She also runs the Writing Lab, offering about 12 hours weekly of individual and group instruction for all Nipissing students. The English Department offers five half-courses in language and written communication. The direct cost of setting and grading the tests in 1993 was about $18,000 for the 450 students ($40 per student).

The University of Ottawa uses an internally developed multiple-choice test in English and French versions to classify incoming students in Arts and Science and some other divisions according to their recognition of grammatically correct sentence patterns. The results are used for placement in one of the two levels of required first-year English or French courses. In addition, the Writing Centre conducts non-credit review courses in specific skills, and makes a computer "workbook" program available for English students.

(University of Toronto: See page 9 below for an account of the testing in some professional faculties.)

Waterloo University requires students receiving less than 80% in OAC English I to take its timed essay test; they must pass before entering third year. Required scores vary according to faculty. Students who do not fulfill this English Language Proficiency requirement by the beginning of their second year must attend the Writing Clinic for weekly sessions where they work in small groups on general-knowledge essay topics. When they have written two acceptable essays in these workshops they are exempted from the test. About 2200 students take the test each fall. About one quarter of these do not meet their faculty's standards. Among the 550 ESL students who take the test, almost three quarters fail and are thus the main participants in the workshops. ESL students are also encouraged to seek out non-credit courses at local community colleges, and may take a credit course from the English Department. Besides this course and three other introductory half-courses in composition, the English Department lists over twenty advanced courses in language, writing, and rhetoric, constituting a specialist program in Rhetoric and Professional Writing. Direct costs of testing and the Writing Clinic are about S100,000 yearly (S45 per student tested).

NON-BINDING POST-ADMISSION TESTING

Three other Ontario universities conduct some testing of their incoming undergraduate students, but do not use the results of the tests to require further action or to impose penalties. They do, however, advise individual students and conduct extensive research.

Brock University is in the process of redesigning its writing program in the light of results obtained from ten years of non-binding testing of literacy. For ten years it asked incoming first-language students to take the Nelson-Denny multiple-choice reading test along with an essay test developed by the Department of Applied Language Studies. The 35-minute essay test asked students to read four short passages giving different points of view on a Inkshed 13.4 April 1995

controversial subject, and then write an essay of 25S350 words. A high proportion of students asked for their results and for advice on follow-up instruction. The Counseling Centre provided this advice, and still gives two levels of subsidized non-credit courses on basic writing and essay skills to 100 students yearly. The Writing Lab gives drop-in assistance and group workshops. The English Department currently gives three combined literature and composition courses for credit, two of them specifically for business students. The Department of Applied Language Studies gives a separate test to international students and places them in a sequence of ESL non credit and credit courses. Brock's study of the accumulated first-language test results has concluded that scores on the standardized reading tests were only weekly correlated to future academic success, but that the essay test did predict likely problems with academic work, even those not arising until the upper years. Proposals are now being drawn up for a new set of required and optional courses to meet the needs delineated, along with workshops for faculty on ways of using more writing and reading within all courses. The cost of administering the test was about $18,000 for 1800 students. This figure did not, however, include the cost of essay marking or research, both of which were done by regular faculty, or of the Counseling Centre and Writing Lab services.

The Ontario College of Art in 19934 obtained a grant of $60,000 for each of two years from the Counseling Foundation. Its research explores the hypothesis that visual learning styles are correlated with weaknesses in literacy skills. A majority of the 400 incoming full-time students for the past two years have voluntarily taken the Nelson-Denny multiple-choice reading test, an essay test, and a survey asking about left- or right-handedness and past problems with reading or writing. Scores are available to students on request but are not part of individual records. Few courses at OCA require writing. At present a Writing Lab offering individual tutoring and group work gives the only instruction in writing. Next year a credit course in basic English and a non credit course in English as a Second Language are planned.

Trent University uses a voluntary test as an introduction to its extensive programs in writing support. About half of the incoming S00 students voluntarily write a timed essay during Introductory Seminar Week, and most come back for individual appointments with the Academic Skills Centre to discuss the diagnostic comments tabulated on response sheets. Many then enroll in free non credit courses or workshops on specific skills. For students needing further work in English as a second language, a non-credit transition course is offered at a fee of $300. The Writing Lab offers individual appointments, seeing 1000 students out of the total enrollment of 5000, and gives workshops to classes about Specific skills needed for their assignments. The English Department does not teach composition courses . All costs for testing and subsequent counseling are part of the budget for the Academic Skills Centre. Its widely-sold publications on writing subsidize some of the cost of operations.

LITTLE OR NO POST- ADMISSION TESTING

The other twelve Ontario universities do not administer post-admission tests of writing except, in a few cases, to students likely to need ESL support. Nearly all have resources in place for helping students improve their writing, but many expressed concern that some students who needed help avoided seeking it. The following list outlines the ways each university monitors student needs and attempts to meet them.

Carleton University gives no tests except to international students admitted provisionally with borderline TOEFL scores. For these students, the Centre for Applied Language Studies has developed a battery of tests simulating university conditions of listening, reading, and writing; it uses the results for placement into credit ESL courses. For all students, the Writing Tutorial Service offers individual tutorials, workshops on academic skills, non-credit courses on the principles of academic writing, and seminars on discipline-specific writing. This service also has an outreach program of workshops for faculty and graduate students on supporting student writing within their courses, and conducts research on writing at university. Its Writing Consultants group provides diagnosis and instruction for writing in workplaces. The English Department offers a course on writing and language for students from all disciplines and a specialized course for Commerce students.

The University of Guelph once used the Ontario Test of English Achievement, but no longer tests first-language students. International students may take the diagnostic SPEAK test, developed at Guelph to test skills in listening and speaking English, and then enroll in a course offered for $300. It carries no credit, but those completing it receive notes on their transcripts. For all students, the Writing Centre offers two levels of non-credit writing workshops for which students pay S120, and some individual consultations. It also trains upper-year undergraduates for a peer helper program in university residences. The English Department combines training in writing with one literature course, and has developed a computerized grammar-review "workbook" for it.

Lakehead University does not test its students at present. Students in some professional faculties are required to take first-year courses in special forms of writing, taught by the English Department. The English Department also offers a first-year cross-disciplinary course in strategies of writing and a credit ESL course. The Writing Lab gives individual tutoring. Dissatisfied with the inadequacy of students' writing in upper years, the Senate in 1991 struck a committee with the mandate "to arrive at a comprehensive plan for addressing the issues surrounding the question of literacy at Lakehead University." The proposal for a Writing Across the Curriculum program adapting the Laurentian model was accepted for implementation in 19954. All incoming students will take a timed essay test as placement for appropriate credit writing courses and writing-intensive disciplinary courses. A Writing Centre will be created to coordinate this system, and a faculty committee will work with each department and division developing a detailed plan for its involvement with the WAC program. The expectation is that most departments will provide courses at all year-levels giving explicit treatment of writing in the discipline, and that they will assess a portfolio of student writing using the same scale as the writing-assessment test. Faculty workshops in assigning and evaluating writing have begun to prepare for the kinds of teaching involved.

The Writing Centre will provide ongoing support for faculty members who give designated WAC courses.

McMaster Universitv used a multiple-choice post-admission test of language proficiency the late 1980s. Besides generating bad publicity for the university, it was ineffective in motivating students to improve their writing. At present, McMaster offers only a few resources for writing support. They consist of a first-year English course combining instruction in literature and composition, required by a number of programs; some non-credit workshops in versions for ESL students and first-language students; and a Writing Centre staffed by three senior undergraduate volunteers trained by a faculty director. These volunteers offer individual tutoring and group workshops, with special sections for ESL work. Students may also buy booklets on specific aspects of university writing, written by the director of the Writing Centre and Counseling Service. He regularly visits high schools and consults with teachers about academic skills and ESL issues.

Oueen's University gives no tests. The Writing Centre offers free individual tutorials on writing in any subject, gives group workshops on the basic principles of effective writing in both first- and second-language versions, and makes presentations on specific topics tailored to the needs of classes or programs. It also runs a grammar hot line to answer questions about correct usage and houses a collection of books, handouts, and computer software. The English Department offers a non-credit course in ESL writing and a credit course in composition, available also by correspondence.

Royal Military College does not test, but requires every student to take a first-year English composition course and expects writing in every course, including those in Engineering. Standards of writing proficiency are rigorous. There is no Writing Test and no ESL support.

Ryerson does not test, but has an extensive program of required instruction. The Business and Technical Communication Department gives courses in professional communication (oral and written), each tailored to the specific program in which it is required. Students in the Business Management program may take a minor in Business Communication. The Department of English offers a semester-long course in composition and rhetoric that is required in some programs, and courses in ESL and remedial writing that are accepted as Liberal Studies electives in some programs. A Writing Centre staffed mainly by peer tutors, trained and supervised by a member of the Department of English, gives individual consultations for help with editing papers.

The University of Toronto dropped its English proficiency test for entering Arts and Science students in 1986, but makes a considerable amount of writing instruction available on an optional basis. In Arts and Science, the English Department offers 40 sections yearly (up to 1000 students) of a half-course in composition; Innis College gives three full courses in writing, one intended for new Canadians; the Professional Writing program at Erindale teaches over 250 students yearly and offers a minor consisting of six half-courses. College writing labs give individual tutoring and some group workshops and non credit courses for undergraduate students in Arts and Sciences; overall, they see as many as 20% of students in their colleges. Some writing lab instructors, especially at Erindale College, also make presentations to classes about writing in specific assignments. A project of the Writing Centre at St. Michael's College counsels incoming students about course choices and university expectations by discussing students' portfolios of OAC work. Most Arts and Science departments require substantial amounts of writing within their courses. In 1994-5 all Arts and Science departments on the downtown campus instituted first-year seminars that include attention to communication skills, with places for half of the incoming class. Next year Erindale College will name certain courses "writing-intensive" and require them in specified programs. Scarborough College is considering adding writing components to a range of courses. Responding to such interests, the newly-appointed Coordinator of Writing Support has instituted workshops for faculty and TAs on designing and evaluating writing assignments throughout the curriculum. Some professional faculties, especially in the health sciences, are moving rapidly towards this model of using writing in a range of courses and providing support for students and faculty.

The faculties of Engineering, Architecture, and Pharmacy require some or all of their students (a total of 900 yearly) to take writing tests for placement into required first- or second-language versions of required writing instruction: sometimes courses, sometimes units or special workshops within disciplinary courses. The tests, combining summary and essay writing, have been developed by the ESL program of the School of Continuing Studies. Research is underway to validate the prompts used in these tests and the scale by which they are graded. The faculties of Architecture, Engineering, Nursing and Pharmacy provide writing labs for their students, including graduate students. The writing instructors in these labs sometimes also consult with faculty members on assignment design and evaluation.

The main support for ESL students is offered centrally by the Language Learning Unit of the School of Continuing Studies. Besides developing and administering written and oral tests for admission, it offers partially subsidized non-credit courses in a range of English skills to all students, provides instructors for the professional faculties' ESL courses and workshops, and mounts special non credit courses within professional faculties on request. The International Student Centre offers a limited amount of individual tutoring, mainly to graduate students.

The University of Western Ontario gives no post-admission tests but, as a calendar note says, requires that students "demonstrate the ability to write clearly and correctly" in all courses. The English Department through the Effective Writing Program offers four half-courses in writing (including one on technical writing). The Effective Writing Program also gives free individual tutoring and group workshops on essay writing to undergraduate and graduate students, and has developed special software to let students independently review language patterns. Students are placed in the program by an interview where the instructor assesses a writing sample.

Wilfred Laurier University no longer uses tests, but has set up a Writing Centre to provide individual tutoring and group work on a demand basis, including in-service instruction for selected classes. The English Department offers a limited number of places in two credit courses in composition and workplace writing. No separate ESL instruction is provided, but local high schools and community colleges put on special classes for Laurier students.

The University of Windsor tests only incoming Engineering students, using an impromptu essay to place them in a required technical writing component of a first-year Professional Development course. This testing and the instruction that follows it are performed by the Academic Writing Centre, set up in 1992 to respond to the range of students' writing needs. The Centre is staffed by two full-time instructors, one part-time instructor, and trained peer tutors. It offers individual tutoring, small-group writing workshops, and a set of computer programs for self-instruction. This fall the Centre has given a series of seminars for Business students wishing to pursue a certificate of business-writing competence. The students produce portfolios of documents, which are assessed jointly by the writing instructors and faculty members from Business. The writing instructors also consult with professors about writing in their courses, make class visits on request, present workshop series for special interest groups on campus, assist the Office of Cooperative Education by providing specific writing instruction to Co-op students, and provide professional development in writing for a campus administrative unit. They invite OAC classes for day-long workshops that demonstrate the expectations of university writing. The Department of English also offers a credit course in writing in versions for first- and second-language speakers.

York University gives no tests, but integrates writing instruction into many courses and offers an extensive program of support for students at all levels. First-year interdisciplinary "critical-skills" seminars at the colleges pay considerable attention to writing as well as to critical reading and thinking; writing specialists are attached to each section to give class workshops and individual consultations. Some first-year general education courses have special ESL tutorial sections. Support services are also extensive. The Centre for Academic Writing gives individual tutoring and offers group work to students in Arts and Science. Its instructors, some of them cross-appointed faculty members, act as consultants in critical skills courses. The Centre also runs intensive faculty-development workshops for faculty members from a range of departments who use writing within their courses. The Computer Assisted Writing Centre in the library provides computers for student use; it supplies word processing software and some training in using it, and lets students send essays electronically for tutors' comments. At Atkinson College (for part-time students), the Essay Tutoring Centre runs some small-group workshops to guide students at the planning and editing stages of their writing; it also provides individual tutoring. Atkinson offers courses in critical thinking, reading, and writing for 300 students yearly, with separate sections for ESL students. The Department of Languages, Literature and Linguistics teaches two ESL credit courses in Canadian language and culture.

CONTACTS AT ONTARIO UNIVERSITIES

BROCK UNIVERSITY
Glen Irons
Department of Applied
Language Studies


Joan McCurdy-Myers
Counselling/Housing Office


CARLETON UNIVERSITY
Ian Pringle
Centre for Applied
Language Studies


UNIVERSITY OF GUELPH
Lenore Latta
Counseling and Student Services


LAKEHEAD UNIVERSITY
Kerrie Clarke
Institutional Research


Kirn Fedderson
Department of English


LAURENTIAN UNIVERSITY
Normand Fortin
Centre for the Official
Languages of Canada


McMASTER UNIVERSITY
David Palma
Counseling and Career Services


NIPISSING UNIVERSITY
Ted Chase
Dean of Arts and Science


ONTARIO COLLEGE OF ART
Nora McCardell
Director of Student Services


UNIVERSITY OF OTTAWA
David Staines
Vice-Dean, Faculty of Arts


ROYAL MILITARY COLLEGE
Pierre Fortier
Registrar


QUEEN'S UNIVERSITY
Doug Babington
Department of English
Writing Centre


Alison Morgan
Registrar


RYERSON POLYTECHNIC
Judy Hunter
Department of English


Margaret Morris
Chair, Department of English


D.P. White
Chair, Business and Technical
Communications


UNIVERSITY OF TORONTO
Eileen Barbeau
Special Services


Cleo Boyd
Director, Writing Centre
St. Michael's College


Alister Cumming
Department of Curriculum
Modern Language Centre
Ontario Institute for
Studies in Education


Roger Greenwald
Director, Writing Centre
Innis College


David King
Retired Director, Writing Centre
Innis College


Gay MacDonald
Director, Writing Lab
New College


Doug McBean
Office of Admissions and Awards


David Nimmo
Woodsworth College
Pre-University Program


Karel Swift
Office of Admissions and Awards


Maria Tyacke
School of Continuing Studies


Merlin Wahlstrom
Department of Curriculum
Ontario Institute for
Studies in Education


TRENT UNIVERSITY
Karen Taylor
Academic Skills Centre


WATERLOO UNIVERSITY
Mary Merikle
Manager, Writing Clinic


UNIVERSITY OF WESTERN ONTARIO
Alan Bailin
Effective Writing Program


Gordon Smiley
Registrar and Student Affairs


WILFRED LAURIER UNIVERSITY
Paul Tiessen
Department of English


UNIVERSITY OF WINDSOR
Barbara Benson
Academic Writing Centre


Chris Iwgebow
Academic Writing Centre


YORK UNIVERSITY
Mary-Louise Craven
Computer-Assisted Writing Centre


Nick Elson
York University
English Language Institute


Talie Sanders
Atkinson College
Essay Workshop


Ron Sheese
Centre for Academic Writing


Back to Table of Contents

Part Two


ASSESSMENT TYPES AND FUNCTIONS

Tests to assess the writing skill of students entering university were first given in 1874 at Harvard and have been used since 1897 by the University of California system. These early tests reflected concern about t the influx of students who had shown themselves unfamiliar with the conventions of English usage in academic writing. The tests placed students into different kinds of courses offering instruction in writing, with some provision for remedial work. Such courses are still first-year requirements in virtually all U.S. universities, but as the range of student needs has widened, universities have developed different. methods of assessment for more accurate placement.

Canadian universities have only recently begun to give such courses and use such tests. As the first section of this report shows, only four of nineteen Ontario universities test all incoming students; only two give all students a first-year course in writing, though two others plan to do so.

The University of Toronto first instituted a writing test in 1949, reacting to the unskillful use of written English by a new surge of students in the Pass Arts program, many of them veterans. From 1951-2 students who failed the test were required to take a non-credit course in Composition. This program lasted only a few years, but further calls for tests arose in the 1970s, as second-language and other non-traditional students began to enter the university in greater numbers. The English Proficiency Test used from 1979 to 1986 for Arts and Science and a few professional faculties responded to the same worry about correct language usage and knowledge of the conventions of writing. At a cost to the university of about $35 each in 1986 dollars, 5500 incoming students yearly wrote an impromptu timed essay on a general-interest topic, then were given scores indicating pass, marginal, or fail status. Students had to achieve at least a marginal score on the test, given three times yearly, before they enrolled in their third year of studies. The failure rate ranged from 20 to 30% overall. One study showed that of students in Canada less than 10 years, 50% failed their first test. Only 10% of Canadian citizens failed the test the first time; 75% of visa students did.

The program did not, however, follow through with mandatory courses or other direct instruction. Students were encouraged to visit college writing labs to discuss the results of their tests, but only a minority did so, and few continued to work with the labs. Non-credit courses were set up on a cost-recovery basis to provide instruction and exemption from the test. Almost no native-speaker students enrolled, but many second-language speakers met the requirement by taking the ESL version of the course. A credit composition course was instituted by the English Department in this period and became popular with students; about 40 sections are now offered yearly. At present, only the Faculties of Engineering and Architecture have a post-entry testing program, using it for placement into ESL and non-ESL sections of, respectively, a required writing course and a component of a disciplinary course.

To inform discussions about ways the University of Toronto might reshape its undergraduate programs of instruction in writing, I have put together a sampling of the main types of writing assessments and the ways they are used in writing programs. The following section of my report is built on my discussions with Ontario universities (as listed in Part 1 above) and my investigations of other universities comparable in size, curriculum, and population makeup to the University of Toronto. My information comes from a variety of sources, including personal communication, reading of published sources, and reading and participation in the many lively electronic discussion groups on writing. It has been enriched by the help of Victoria Littman, a graduate student in Curriculum at the Ontario Institute for Studies in Education, whose research assistance was subsidized by a grant from the Provost's Office. I greatly appreciate her energy, insight, and wide knowledge of both American and Canadian institutions.

The following pages describe some types of tests used to assess students' ability to write in English. Examples of their uses in particular institutions demonstrate the various functions that different kinds of tests can serve.

MULTIPLE-CHOICE TEST

A number of standardized tests focus on recognition of language error at the sentence level. Being machine-gradable, they are relatively inexpensive to administer. They indicate familiarity with the terminology and categories of grammar instruction, but are now largely discredited as indicators of the ability to write effectively. Since trailing can provide the kind of recognition knowledge required, students who have studied English as a second language can pass such tests even when they are unable to construct sentences of their own. At the same time, the focus on standard usage penalizes students from backgrounds where nonstandard dialects of English are spoken. For these reasons, a number of multiple choice language tests once widely used in the U.S. are being phased out.



TEKED ESSAY TESTS

Another simple form of test asks students to write brief essays under exam conditions on subjects of common knowledge. The English Proficiency Test used at U. of T. from 1979 to 1986 took this form. An essay test seems a valid kind of assessment because it asks for a product related to the kinds of writing done in many university courses. Formulas for organizing such essays can be taught in high school, arguably preparing students for course work as well as for the test itself. The criteria used to grade such pieces include organization and coherence as well as language correctness and fluency. A fair degree of reliability in grading can be achieved with sufficient training of markers; the former EPT achieved around 80% agreement between the two markers who gave each piece its initial score on a three-point scale.

Criticism of the validity of timed essay tests focuses on such matters as the cultural bias of the supposedly "general-knowledge" prompts and the judging of student writing by single pieces written under pressure with little or no time to revise. Both these matters weigh especially heavily on students learning English as a second language and students with learning disabilities. Where many sections of the test are written, developing enough prompts that avoid cultural bias and are relatively equal in difficulty can be a considerable challenge. A further deficiency is that such essays do not test students' ability to respond to texts or use reading as the basis of their writing, as will be required at university. In seeming to ask for a set form of essay, moreover, such tests can have a stultifying effect on high-school writing programs: students come to university expecting that the unreferenced rigidly organized essay on general topics is what they will write in courses there.

Though most such tests are graded according to a stated set of criteria, these are hard to maintain and apply. Grading tends to reflect the norm of the particular group of students, and standards can easily slip. Language errors are easier to see than competence in reasoning. Research has found repeatedly that faculty members without special training in assessment seldom agree with professional markers on ratings: they assign widely disparate grades.

The relatively high costs of essay tests are incurred in a number of ways. Achieving agreement among markers requires time for training and cross-checking. At least two readings of each paper are needed to obtain a reliable score. If the tests are to be used diagnostically or to counsel students, the process of individual consultation also adds considerably to the time incurred and the cost of administration. The cost of setting, administering, and marking the old EPT, for instance, was calculated at $35 per student in 1986; but the half-hour of a writing tutor's time to discuss the marked test with the student would have added at least another S15. Record-keeping and secure storage for essay prompts and marked tests are also expenses, as arc petitions for reconsideration.

Some of these problems have been overcome by variations of this test design, especially the inclusion of a reading as stimulus to the essay response. The continuing value of essay tests in showing at least a sample of thinking and writing performance is attested to by their recent inclusion as components of standardized multiple-choice tests such as the MCAT and TOEFL. Essay tests sometimes also contribute to the important function of assessing students' development as writers during their years at university. The following list shows the many uses to which these tests are put, and the corresponding variations in their design.

For Admission



For Placement in Instruction



The Centre for the Study and Teaching of Writing at McGill is housed in the Faculty of Education and is concerned with literacy and applied linguistics. It aims at educating students in awareness of the ways that language is used within present Canadian culture, as well as training them to use it competently. It offers a popular course in Effective Written Communication, and provides courses adapted for specific disciplines and often required in their programs. By working with faculty members it is encouraging gradual development of writing-intensive courses within the disciplines. Training of teachers and research on educational practice are among other primary concerns. The program leaders have argued against universal testing, pointing out that tests are unreliable, unwieldy, and expensive." The director of the program at McGill asserts that its courses can better engage students in its exploration of literacy issues when they are not already ranked and sorted according to language deficiency.



For Assessmemt of haress



PORTFOLIO ASSESSMENT

Another kind of writing assessment avoids many of the objections about validity levelled at the two previous kinds of tests, and can also be used for continuing assessment during the program of study. It has become increasingly prevalent within American universities both for initial placement in writing programs and as an exit requirement. It also serves the purpose of stimulating and assessing writing instruction across the curriculum. On the model of portfolios in the arts, the institutions ask students to assemble a number of pieces of writing, usually from a range of subjects, and sometimes including drafts and pieces written as tests. Some institutions ask students to write a further note commenting on the process and aims of the pieces, or to write an impromptu timed essay.

This method of assessment has many advantages. It looks at writing done within studies, so the pieces read have real content appropriate to students' academic interests and are authentic demonstrations of their achievements. It thus also stimulates expectations of writing in previous courses. Portfolio assessment asks students to aim high and produce their best possible work, not just fulfill a basic formula. It encourages focus on the whole process of writing, including planning and revising. It is the one method of assessment that receives approval both from those demanding "value-added" outcomes assessment and those committed to student-centered instruction. Portfolios are now widely used within courses at every level of instruction. They are mandated in OAC English courses, and were the basis of the recent Ontario study of Grade 12 writing. Teachers at all levels accept their usage in assessing programs as well as individual students.

Using portfolios, however, creates a number of administrative problems, starting with the need to store large amounts of material. Work cannot be guaranteed as the student's own, though teachers' certification can be required. Portfolios can be mere folders, with no guarantee of attention to responding and revising. Marking takes somewhat longer than with short essay tests. Reliability among markers requires training. Questions may arise over who should do the marking of pieces from various disciplines: discipline-based faculty and writing specialists are likely to agree on the qualities of good writing, but not necessarily on what flaws are debilitating. Experience and experimentation at US universities has diminished some of the practical difficulties of using portfolios, and research is confirming their validity as indicators of achievement. A few instances of specific uses are described below.



CONCLUSION

Clearly the University of Toronto has an array of precedents to guide its decisions about assessing the writing competence of its students. Before making our choices, we need to address these questions:



It is clear that the most effective systems of writing support are based on sound knowledge of student needs, including attitude and motivation as well as measurement of skills. Experience at this university and elsewhere indicates that students profit most from writing instruction when it allows them to explore and formulate ideas in which they are interested. My investigation also shows that the most valid systems of assessment are those that examine a range of writing done for definite purposes.

The diversity of our students' backgrounds and of our programs of study make it unlikely that we will find a single test or a single kind of writing instruction to meet all our needs. To design suitable resources, we should recognize key elements in this diversity. The preparation of students in Ontario high schools is not within our control, though we can contribute to its design. Among students admitted to the University of Toronto, the needs of those learning English as a second language are particularly acute . The disparities among our divisions in providing support for writing also need urgent attention.

Our diversity has already generated considerable flexibility and inventiveness of approach. I hope the variety of writing programs represented in this report will encourage the University of Toronto to continue developing systems of assessment and instruction that reach across the curriculum and involve a range of faculty as well as writing specialists. Courses and support services concentrating on teaching writing skills will certainly be needed, and so will a shared determination to expect and develop writing competence among all our students.

Back to Table of Contents