1.2.1 - Education research - experiments and questionnaires

1.2.1 - Education research - experiments and questionnaires

This lesson is about turning generic research-method knowledge into Methods in Context sociology. The key idea is that experiments and questionnaires do not operate in the abstract: they are shaped by school timetables, gatekeepers, adult-child power relations, safeguarding, and inequalities of class, gender and ethnicity. If you can explain how those features change a method's strengths and limitations, you are building the knowledge and judgement needed for strong short answers and for the 20-mark Methods in Context essay.

What Methods in Context Tests

Methods in Context is not just a question about research methods. It asks you to apply a method to a specific educational setting or issue, such as teacher labelling, pupil subcultures, parental choice, or class differences in achievement. That means a sentence like "questionnaires are reliable" is never enough on its own. You must show how the method works when the participants are pupils, teachers or parents, and what that does to validity, reliability, representativeness or ethics.

Methods in Context

Applying knowledge of a research method to the specific features of an educational setting, then evaluating how those features shape the data collected.

Educational settings have distinctive research characteristics. Schools are formal organisations with rules, timetables and safeguarding procedures. Pupils are usually minors, so informed consent is more complicated than it would be with adult workers or voters. Research access is controlled by institutions, and the relationship between adult researcher and child participant is unequal from the start. These are not background details: they are exactly what makes a Methods in Context answer sociological.

Gatekeeper

A person or organisation that controls a researcher's access to participants, such as a head teacher, governing body or parent.

One useful way to think about a Methods in Context paragraph is as a three-step move:

StepWhat it sounds likeWhy it scores
Method point"Questionnaires can collect standardised data from many pupils."AO1 knowledge of the method
Educational link"Schools provide ready-made groups such as tutor sets or year groups."AO2 application to the setting
Sociological evaluation"But pupils may feel pressured to complete the questionnaire during lesson time, which weakens informed consent and may reduce validity."AO3 analysis and judgement

The best answers also keep inequality in view. If a method is being used to study class, gender or ethnic differences in education, you should ask who is easiest to reach, who may be silenced, and whose experiences may be distorted by the method itself.

Experiments in Schools

Experiments are designed to test causal relationships. In education, this usually means asking whether a factor such as teacher expectation changes pupil behaviour or achievement. That makes experiments attractive to positivists, because they offer the possibility of hypothesis testing, measurement and replication. However, the moment experiments enter a school, the educational context changes both their strengths and their limitations.

Laboratory experiments give the researcher high control. Tasks can be standardised, distractions reduced, and one variable manipulated at a time. This can increase reliability because the procedure can be repeated. The problem is that classrooms are not laboratories. School life is shaped by peer groups, school ethos, teacher style, parental support and prior attainment, so a highly controlled task may tell us little about how pupils and teachers actually behave in everyday lessons.

Rosenthal and Jacobson (1968) — carried out a famous experiment on teacher expectations by telling teachers that randomly selected pupils were likely to show rapid intellectual growth. The value of the study is that it suggests teacher labelling can help produce a self-fulfilling prophecy. In Methods in Context terms, that is a strong link between research method and an educational issue. At the same time, the study also shows the ethical risks of experiments in schools: teachers were deceived, pupils and parents were not in a position to give fully informed consent, and altering expectations may have affected children's opportunities.

Self-fulfilling prophecy

A process in which a label or prediction changes behaviour so that the expected outcome becomes more likely.

Field experiments are often more useful than laboratory experiments in education because they take place in ordinary school settings. This gives them greater ecological validity: pupils and teachers are more likely to behave as they normally would. Yet field experiments still face serious problems. Researchers cannot control all the other influences operating in a classroom, so it is harder to isolate cause and effect. They are also difficult to replicate because every school has its own intake, culture and routines.

Harvey and Slatin (1975) — used an experimental design to examine how teachers judged children they perceived as coming from different social backgrounds. The study is useful because it isolates teachers' expectations, but it also shows a common limitation of experiments in education: researchers may capture judgements under controlled conditions without fully capturing the complexity of classroom interaction over time.

Practical and ethical issues are especially sharp when the participants are school pupils. Head teachers and parents may refuse access, especially where the topic is sensitive. Children are a vulnerable group, so deception, harm and the right to withdraw all matter more, not less. Even when the research stays in the school setting, participants may change their behaviour because they know they are being studied. This Hawthorne effect reduces validity because the data may reflect the research situation rather than normal schooling.

Imagine a researcher wants to test whether teachers participate more positively with pupils they believe are "high potential" in a Year 8 class. A field experiment inside normal lessons could reveal more natural interaction than a laboratory task, but it would still raise serious ethical problems: pupils may be treated unequally, teachers may be deceived, and the school's power structure makes genuine withdrawal difficult.

Questionnaires in Education

Questionnaires are often appealing in educational research because schools bring together large numbers of pupils, teachers and sometimes parents in one institutional setting. A researcher can distribute the same questions to many respondents and then compare answers by class, gender, ethnicity, school type or year group. This is one reason positivists value questionnaires: standardised questions can generate reliable, quantitative data and allow patterns to be identified across large samples.

Questionnaires can also be practical. They are usually cheaper and quicker than interviews or observation, and self-completion forms can sometimes reduce embarrassment on sensitive topics such as bullying, discipline, or teacher-pupil relationships. If anonymity is credible, pupils may feel safer disclosing attitudes they would not say aloud in front of an adult interviewer.

Imposition problem

The problem that a questionnaire may force respondents to answer using the researcher's categories rather than their own meanings and experiences.

However, the educational setting creates major limitations. Younger pupils may misunderstand wording, struggle with literacy, or find abstract concepts difficult. Pupils with English as an additional language, pupils with learning difficulties, or very young respondents may interpret questions differently from what the researcher intended. Once the questionnaire has been handed out, the researcher cannot easily clarify misunderstandings or probe deeper answers.

There are also problems of power and representativeness. If a questionnaire is distributed in lesson time, pupils may complete it because an adult has told them to, not because they have freely agreed. They may also give socially desirable answers if they think teachers might see the responses. Meanwhile, some groups are harder to reach at all. Truanting pupils, excluded pupils, some Traveller pupils, or parents who do not return forms may be missing from the sample. That matters sociologically because the groups most affected by educational inequality may be the least likely to appear in the final data.

A researcher investigating attitudes to setting across several schools could use questionnaires to compare responses by class and ethnicity quickly. But if forms are completed in tutor time, pupils may copy each other, rush answers, or tell the researcher what they think adults want to hear; if parents do not return follow-up questionnaires, the study may also miss the families most detached from school.

Interpretivists are critical here because questionnaires are weak at uncovering meanings. They can show that a pattern exists, such as differences in attitude between groups, but they are much less effective at explaining how pupils understand labels, experience teacher authority, or make sense of success and failure. In Methods in Context, that is a strong evaluative move: a questionnaire may measure inequality while still missing how inequality is lived.

Perspectives and Exam Judgement

The sharpest theoretical split is between positivism and interpretivism. Positivists prefer experiments and questionnaires because both methods can be standardised, and both can produce measurable evidence. Experiments are especially attractive where the aim is to test a causal claim, while questionnaires are useful for identifying broad patterns across groups. From this view, educational research should aim for reliability, comparison and, where possible, generalisation.

Interpretivists take the opposite line. They argue that education is a meaning-rich social world in which pupils interpret labels, negotiate identities, resist authority and respond differently to peers and teachers. Because of that, experiments may be too artificial and questionnaires too rigid. A pupil's experience of streaming, discipline or teacher labelling cannot always be reduced to pre-set categories or measured cleanly under manipulated conditions.

Critical perspectives also remind us that methods are bound up with power. Research on pupils is never neutral when adults control access, define the questions and often supervise the setting in which answers are given. This matters when researching class, gender and ethnicity because the method itself may silence some voices and over-represent others.

The comparison below shows how a strong Methods in Context paragraph moves from method to setting to judgement:

Exam moveExperimentsQuestionnaires
Start with the methodCan test whether one factor, such as teacher expectations, affects outcomesCan gather standardised data from large numbers of pupils, teachers or parents
Link to educationSchools are hierarchical settings with children as participants and many uncontrolled classroom variablesSchools offer ready-made samples, but literacy, attendance and lesson-time pressure shape responses
Evaluate in contextGreater causal testing may be offset by deception, harm and weak validityGreater coverage may be offset by imposed categories, social desirability and unrepresentative non-response

A strong Methods in Context answer usually follows a simple rhythm. First, make one clear point about the method. Second, tie that point to a specific educational feature named or implied by the item. Third, explain what that does to the quality of the evidence. If you keep repeating that structure across practical, ethical and theoretical issues, you are doing real sociology rather than listing generic method facts.

Essay Bank

Questionnaires can be very useful in educational research because schools provide a ready-made population of pupils and staff, allowing sociologists to collect comparable data quickly. This makes it easier to identify patterns in class, gender and ethnic differences across schools or year groups. For positivists, that reliability and breadth are a major strength.

A major limitation of experiments in education is that the school setting makes both ethics and validity difficult to manage. Manipulating teacher expectations or pupil labels may involve deception and possible harm, while the complexity of classroom life means researchers still cannot control all the variables that shape achievement. As a result, experiments may suggest causal processes without fully capturing how they operate in everyday schooling.

Overall, neither experiments nor questionnaires are simply "good" or "bad" methods for researching education. In Methods in Context, the best judgement is always conditional: a method becomes stronger when its advantages fit the school setting and the research issue, and weaker when gatekeepers, pupil vulnerability, power relations or missing groups distort the evidence.