Sunday, October 21, 2007

correlation coefficients and true score?

Topic: Validity and reliability - issues and discussion Date: 27 November 2006 11:36 AM
Subject: correlation coefficients and true score? Author: Mondy, Steven
Last night, I was reading about how knowing the correlation coefficient (positive, negative, and no relationship) is quite a useful way to determine the reliability of a test. The study book was talking about how highly correlated scores can mean high reliability. It got me thinking about specific ways of gauging the reliability of our tests and test items. It was suggested that we could do things like give the same test twice (as long as not too much time has elapsed between the administration of the tests), or have such things as split tests, where we compare the two parts of one test. Up until this point, I didn’t really see the value of giving a test more than once in relatively the same, if not exactly the same format. I thought that it might be a waste of time, as I have been always encouraged to believe a test must be held back in extreme secrecy to not influence cheating and studying for specific items. According to the study materials, we see that there may be a change in the scores in that they may be slightly higher, but we can account for this in working out the students overall performance, and correlate the scores to see how that student performed in relation to other students doing the same test (norm referencing?). Then we can see if it has been error from the test format or from other things such as communicative ability, personal attributes, or other random factors (study materials: module 4).
Another interesting thing that I came across was the comparison of the two students with different scores, and being able to say that a student with a slightly higher score in a test may not be better than the student with the lower score, if we take into account their true score (true score=observed score +-measurement error). This was quite striking as I had assumed that ranking students in order of best to worst according to their raw scores was sufficient to get an idea of general performance. This idea of true score has made me rethink how I look at data, especially in terms of what judgments I make when I see the scores of two or more students are very close. What makes the difference between an A and an A- for example, if the range overlaps so significantly?
What do you think about correlation coefficients and true score?
Steven Mondy

4 comments:

Anonymous said...

Hi I'd love to congratulate you for such a terrific made forum!
thought this would be a perfect way to make my first post!

Sincerely,
Edwyn Sammy
if you're ever bored check out my site!
[url=http://www.partyopedia.com/articles/baseball-party-supplies.html]baseball Party Supplies[/url].

Anonymous said...

Hey I'd like to congratulate you for such a great quality forum!
I was sure this would be a perfect way to make my first post!
In order to grow assets it is usually a insightful scheme to start a savings or investing procedure as early in life as feasible. But don't despair if you have not started saving your assets until later on in life. Through hard work, that is analyzing the best investment vehicles for your assets you can slowly but surely increase your funds so that it amounts to a huge amount by the period you wish to retire. Contemplate all of the applicable asset classes from stocks to real estate as investments for your money. A knowledgeable and diversified portfolio of investments in various asset classes can help your money enlarge throughout the years.

-Kelly Siemers
[url=http://urwealthy.com]currency conversion [/url]

Anonymous said...

Hello. My wife and I bought our house about 6 months ago. It was a foreclosure and we were able to get a great deal on it. We also took advantage of the 8K tax credit so that definitely helped. We did an extensive remodeling job and now I want to refinance to cut the term to a 20 or 15 year loan. Does anyone know any good sites for mortgage information? Thanks!

Mike

Anonymous said...

top [url=http://www.001casino.com/]free casino bonus[/url] check the latest [url=http://www.casinolasvegass.com/]online casinos[/url] autonomous no consign perk at the best [url=http://www.baywatchcasino.com/]easy casino
[/url].