Construct validity asks whether a measure or procedure represents the intended concept. A count of club memberships may capture organizational participation but fit emotional loneliness poorly. Face validity is the basic judgment that a measure appears relevant. Criterion validity compares a measure with an accepted outcome or standard when one exists. These checks ask whether operationalization preserved the concept.

Internal validity has a different target. It asks whether a causal conclusion is credible for the studied cases. Did the treatment cause the difference, or could selection, history, attrition, contamination, or changing measurement explain it? A reliable outcome scale does not repair a confounded experiment. Consistent measurement and credible causal design solve different problems.

External validity asks whether a finding applies beyond the study to other populations, places, times, or conditions. A randomized experiment with volunteers from one elite college may have strong internal validity and limited external validity. A national probability survey may describe a population well but still lack the design needed for a causal conclusion. Generalization and causation are separate achievements.

Random error produces unsystematic variation and often makes a relationship harder to detect. Bias is a systematic tilt. A poorly translated item may push one language group’s answers in one direction. Social desirability may cause repeated underreporting of stigmatized conduct. Adding more responses can make a biased estimate more precise without making it accurate.

Researcher expectations can affect observation, coding, analysis, and publication without conscious dishonesty. Training, blind coding, preregistered plans, intercoder checks, transparent procedures, and replication give others ways to detect that influence. The appropriate safeguard depends on the source of bias. Blind scoring helps when knowledge of condition could affect ratings, while follow-up contact addresses nonresponse.

The same study can score differently on each dimension. Imagine a loneliness questionnaire that gives stable scores but measures frequency of contact better than felt isolation. It is reliable, but its construct validity for loneliness is weak. If a randomized program changes the score, internal validity concerns whether the program caused that change. External validity concerns whether the result applies beyond the participants.

Validity is always tied to a claim and use. A five-item scale may compare average loneliness across groups adequately while remaining too crude for diagnosing one patient. A finding may generalize to similar urban schools but not to rural workplaces. Rather than asking whether a study is simply valid, ask which form of validity the conclusion requires.

A measure can be reliable and wrong. A bathroom scale that adds eight pounds every morning gives a consistent reading with poor accuracy. In sociology, a survey that defines civic engagement only as voting may produce stable scores while missing protest, mutual aid, meetings, and community organizing. Reliability is still useful because an erratic measure cannot support a clear comparison. Validity asks the harder question of fit.

Bias can enter through an interviewer, an instrument, a sample, or a coding rule. If interviewers probe some respondents warmly and rush others, the procedure can create group differences. If a facial-recognition system was trained on an unbalanced set of images, its errors may cluster. Calling the result “objective” because a computer produced it misses the social choices inside measurement. A CLEP question may ask which change repairs the problem. Match the repair to the source: retrain interviewers, revise the measure, broaden the sample, blind the coder, or use another validation test.

Quick review: A repeated result concerns reliability. A concept-measure fit concerns construct validity. A credible treatment effect concerns internal validity. Generalization concerns external validity. A systematic tilt concerns bias.

Watch the chapter connection

Sociology Research Methods gives you a second explanation of the chapter ideas surrounding this lesson. As you watch, pause when the lesson concept appears and explain how the example fits.

Use this lesson for CLEP practice

Write one original example, one close nonexample, and one observation that would help you choose between them. This turns vocabulary recognition into the kind of applied reasoning the exam expects.