4. PREVIOUS STUDIES ON FACE VALIDITYASSESSMENTS OF THEIR ACADEMIC PR...

2.4. Previous studies on face validity

assessments of their academic progress and

performance at mid-semester. Furthermore,

Some previous studies in language testing

the faculty evaluation questionnaire was

have already been conducted in an attempt to

given to 55 staff members to get the opinions

analyze the different aspects of test validation.

about students’ English proficiency, academic

McNamara (2000) points out that insights from

performance in the course, and the extent to

such analysis provide invaluable contribution

which students’ level of proficiency caught

to defining the validity of language tests.

up with their performance in the academic

Exploring how other researchers have

course. Interviews with 20 students and 10

investigated the face validity of a language

faculty members during their office hours were

test can shed light on the process followed in

conducted individually. The results showed

this research.

the ESLPT did not correlate considerably

To begin with, Kucuk (2007) examined the

with faculty members’ ratings of performance

face validity of a test administered at Zonguldak

in content courses (r=.14). The findings

Karaelmas University Preparatory School, in

indicated that international graduate students’

Turkey. 52 students and 29 English instructors

English difficulties had less effect on students’

participated in this study. The researchers

academic performance than was expected,

used two questionnaires and students’ test

because of such other factors as sufficient

scores. The instructors and students were given

background knowledge and lecture type

questionnaires to ask for the representative of

courses during their first-semester studies.

the course contents on the achievement tests.

A study was conducted by Şeyma (2013)

All data were analyzed through Pearson Product

investigating how well various assessment

Moment Correlation and Multiple Regression.

practices (placement test, midterms, quizzes,

The results showed that even though it

and readers) of the preparatory year English

appeared that Listening was not represented on

program in the Department of Foreign

the test, both English instructors and students

Languages predict the success of students for

still agreed that the tests still possessed a high

TOEFL ITPat TOBB University of Economic

degree of face validity. The results showed

and Technology (TOBB ETU). The researcher

that the tests administered at Zonguldak

used a questionnaire to investigate both the

Karaelmas University Preparatory School,

instructors’ and students’ opinion on the

in Turkey were considered valid and the test

effectiveness of these assessment practices

scores could be employed to predict students’

on TOEFL ITP and the scores of 337 students

future achievement in their department English

to find out the relationship between in-house

courses.

assessment practices and TOEFL ITP. All

Another research on face validity goes

data was analyzed through Pearson Product

for Lee and Greene (2007) who explored the

Moment Correlation and Multiple Regression.

The result revealed that students believed that

importantly, it will contribute useful insights

mid-term exams were the most effective and

to English language teaching and learning,

especially in-house English test validation

beneficial assessment practice which helps

and prevent the mismatch between learners’

students get higher scores from TOEFL ITP.

true performance and their test scores.

Whereas, lecturers believed that quizzes were

more effective for students’ success in TOEFL

• It helps test designers and educational

ITP test.

decision makers to check to what extent the

course content can be adequately represented