Loading...

On the Reliability and Validity of Grammaticality Judgment Tests

Bagheri Sanjareh, Hemaseh | 2012

699 Viewed
  1. Type of Document: M.Sc. Thesis
  2. Language: English
  3. Document No: 43308 (31)
  4. University: Sharif University of Technology
  5. Department: Languages and Linguistics Center
  6. Advisor(s): Salehi, Mohammad
  7. Abstract:
  8. The present research aims to examine the influence of response format on the reliability and validity of grammaticality judgment tests, which will also reveal some facts about the superiority of each format. To this end, the grammaticality judgment (GJ) test developed by Gass (1994) was selected as the instrument of the study, which was manipulated in terms of the response format while the original items remained intact. Thus, in the first phase of the study, a multiple-choice GJ test (MCGJT) was constructed to be compared with the traditional form, i.e., the dichotomous type (DGJT). In an interval of a month, the two tests were administered to a group of 110 engineering-major BS students at Sharif University of Technology. The results revealed that the MCGJT was slightly more reliable than the DGJT. With regard to validity which was arrived at by means of internal correlations in Alderson, Clapham and Wall’s (1995), the DGJT yielded slightly better validity indices. In the second phase of the study, GJ tests were developed in ordinal (OGJT) and likert (LGJT) scales. 49 engineering- BS students at the university mentioned above participated. The analysis of the findings unveiled the effect of response format on reliability, since the OGJT was found to be of higher reliability compared with the LGJT. Concerning validity, which was examined via a post-test questionnaire, response format was selected as the second reason behind inconsistency in responses from participants’ point of view. On the whole, this study ventures to suggest that response format undoubtedly induces variations in reliability and validity, as well as students’ performance
  9. Keywords:
  10. Invariance ; Validity ; Likert Scale ; Ordinal Scale ; Multiple Choice

 Digital Object List

  • محتواي پايان نامه
  •   view

 Bookmark

No TOC