Which is NOT a method of evaluating the validity of a test?
relating test scores to scores obtained on other tests
examining the test's content
examining the percentage of passing and failing grades
relating test scores to the framework of a theoretical construct
Relating scores obtained on a tests to other test scores or data from other assessment procedures is typically the kind of evidence collected in an effort to establish the __________ validity of a test.
content
criterion-related
face
none are correct
Face validity, which is not really validity in the traditional sense, refers to:
the most preferred method of determining validity
another name for content validity
the appearance of relevancy of the test items
validity determined by means of face-to-face interviews
Which of the following assessment techniques has the highest degree of validity from the examinee's perspective?
asking examinees to tell what they see in inkblots for the purpose of personality analysis
administering a word processing test to a person applying to be a word processor
asking examinees to draw a picture of their family to assess family relationships
measuring the height of applicants to a police academy
Dr. Whatley announces that an exam will cover the topics of reliability and validity. Frazier boasts that he will read and study only the material on reliability. In fact, all the test questions are only on reliability. You might best conclude that:
the exam lacked criterion-related validity
the exam lacked content validity
the exam lacked face validity
it is worth getting to know Frazier better
Before constructing the final exam, your instructor reviews the objectives of the course, the text, and lecture notes. Your instructor is making an effort to maximize the ____________ validity of the exam.
content
criterion-related
predictive
none are correct
Which may best be viewed as varieties of criterion related validity?
concurrent validity and face validity
content validity and predictive validity
concurrent validity and predictive validity
concurrent validity and content validity
The form of criterion-related validity that reflects the degree to which a test score relates to a criterion measure obtained at the same time is known as:
predictive validity
construct validity
concurrent validity
content validity
The form of criterion-related validity that reflects the degree to which a test score relates to a criterion measure obtained subsequently is known as:
predictive validity
construct validity
concurrent validity
content validity
An investigation of a test's construct validity may yield evidence that:
the test is measuring a single construct
the test does not correlate significantly with another test purporting to measure the same construct
test scores increase as a function of age
all are correct
Which of the following affects the magnitude of a validity coefficient?
attrition of the sample
restriction of range
inflation of range
all are correct
What type of validity evidence best sheds light on how a shorter and less expensive test compares with a longer and more expensive test?
predictive criterion-related
concurrent criterion-related
content
construct
What type of validity evidence best sheds light on whether a college admissions test is valid for selecting students who will complete the program within four years?
predictive criterion-related
concurrent criterion-related
content
construct
What magnitude of validity coefficient is typically acceptable to conclude that a test is valid?
.50
.80
above .90
cannot determine without more information
A coefficient of correlation is calculated between Malcolm's score on a test of sociopathy and a clinician's rating of Malcolm on the variable of sociopathy. This coefficient of correlation might also be referred to as:
an index of reliability
an index of sociopathy
a validity coefficient
none are correct
What is the selection ratio for a position that has 100 applicants and 5 openings?
.50
.05
.005
none are correct
In an expectancy table, the percentage of employees who are currently successful in a position provides some indication of:
the validity of the proposed selection measure
the percent successful using current methods of selection
the reliability of the proposed selection measure
the base rate of the proposed selection measure
A test identifies an individual as being incapable of successfully performing a particular job when, in fact, the individual would have been successful in the job. This exemplifies what is meant by a:
hit
false-positive
false-negative
base rate
All validity evidence can be interpreted as ____________ validity.
content
criterion-related
predictive
construct
A "construct" may be characterized as:
unobservable
something that describes behavior
something that is presupposed to exist
all are correct
Which is an example of a false positive?
a test identifies a client as schizophrenic when the client is not
a test correctly identifies a client as schizophrenic
a normal individual feigns schizophrenia in order to receive disability compensation
a test indicates that a client is not schizophrenic when he or she is
If you were a personnel director working for Microsoft, then which claim by a test publisher might persuade you to purchase and use a new selection test?
the test identifies a large number of false positives
the test improves the hit rate
the test identifies a large base rate
the test significantly improves workers' interest, motivation, and output
What factor is perhaps the most prominent in keeping decision theory from being widely used in employee hiring?
the validity of the measures typically used
the complexity of the process
the lack of demonstrated utility of decision theory
all are correct
If a newly developed test that attempts to measure happiness correlates with other tests of happiness, but not with tests of sadness, this is referred to as ____________ and ____________ evidence of validity, respectively.