InThinking Revision Sites

INTHINKING REVISION SITES

Own your learning

Why not also try our independent learning self-study & revision websites for students?

We currenly offer the following DP Sites: Biology, Chemistry, English A Lang & Lit, Maths A&A, Maths A&I, Physics, Spanish B

"The site is great for revising the basic understandings of each topic quickly. Especially since you are able to test yourself at the end of each page and easily see where yo need to improve."

"It is life saving... I am passing IB because of this site!"

Basic (limited access) subscriptions are FREE. Check them out at:

HL: Understanding observations

ATL: Essential understandings

The type of observation chosen by a researcher will depend on the aims and objectives of an investigation.

Extraneous variables and participant effects may influence the validity of an observation.

Researchers must be aware of their own biases when setting up, carrying out, and analyzing the data in an observation.

In observations, the researcher enters a situation where some behaviour of interest is likely to take place and then makes notes about it. Observation is one of the most basic tools of the psychologist - but it is not as easy as it looks.  In order for an observation to really help us to understand human behaviour, there are several things that must be considered.

Observation is an important method of gathering data. The aim is to gather first-hand information in a naturally occurring situation. There are two basic methods of observation: participant observation - where the researcher is part of the situation being studied and may interact with the participants; and non-participant observation, where the researcher is not part of the situation being studied and does not interact with the participants.

Participant observation

In participant observation, the researcher becomes part of the group that he or she observes. The aim of this research strategy is to gain a close and intimate familiarity with a given area of interest - for example, a religious group or a street gang - through personal involvement with people in their natural environment. The purpose is to develop a scientific understanding of the group.

In participant observational research, the researcher produces field notes which serve as an account of what has been observed.  It is a very demanding task. Researchers must spend a great deal of time in surroundings that may not be familiar (e.g. prisons or hospitals); they must initiate and maintain relationships with people they may or may not like (e.g. criminals); they must take a lot of notes on whatever happens (e.g. what people do, their body language, and their speech patterns); and they may run certain risks during the course of their work (e.g. injury at work if they are working in a factory). After the fieldwork is complete, the researchers analyze their field notes and diaries before they write their research report.

Participant observation has been used in psychological research for some time; for example, in studies of urban communities, abused women in shelters, and drug addicts.  One example of participant observation is Festinger et al. (1956) on a cult. Festinger used participant observation to test an existing theory - cognitive dissonance.

Research in psychology: Festinger, Riecken and Schachter (1956)

One famous case study using a covert participant observation was the investigation of a cult by Festinger, Riecken, and Schachter. The researchers wanted to find out how people in a cult would cope with the situation when their belief that the world would end on a specific date turned out not to be true.

The social psychologist Leon Festinger read a newspaper article about a religious cult that claimed to be receiving messages from outer space, predicting that a great flood would end the world. Festinger and some co-workers joined the group and pretended they were converts to the beliefs of the cult.

The members of the cult believed they were going to be rescued by a flying saucer when the rest of the world was destroyed. Some of the cult members had sold their homes and given up their jobs. The researchers wanted to see what happened to the cult members when the world did not go under. The theory of cognitive dissonance predicted that the cult members would either change their beliefs to restore balance in their cognitions or that they would change their behaviour to fit their beliefs. When the date arrived and the world did not end, some of the group members coped with it by saying that their prayers had saved the world. In this way, they created meaning from what had happened and they were able to relieve the stress of believing that they had made a tragic mistake. Other members simply left the cult. This indicated that they had changed their beliefs. The study confirmed the theory of cognitive dissonance.

Questions

  1.  Was the use of covert participant observation justified in Festinger’s study? Why or why not?
  2.  Would it be possible for the public to recognize the participants in this study?

Click here for a more in-depth description of the study: Festinger (1956)

 Teacher only box

Was the use of covert participant observation justified in Festinger’s study? Why or why not?

Yes, the method was justified.  It would not have been possible to observe the cult from the outside as they were a very private, closed group of people. By joining the cult, Festinger was able to talk to them about their beliefs and observe their daily behaviours.  It also had to be covert in order to make sure that the reactions of the participants were authentic. Most likely, they would have refused to be observed by a psychologist.  And even if they had consented, they would most likely not be completely honest about their thoughts and feelings.

That being said, although it was justified there is a significant ethical concern about observing a group of people without consent -  who have chosen to have a private religious belief.

Would it be possible for the public to recognize the participants in this study?

Theoretically, Festinger could use coding and a specific individual's behaviour would not be identifiable in the study. However, if people know people who are in the cult, it is possible that some details may lead to their identification. This is a serious ethical concern. The cult was also a relatively small group of people which means that is potentially more likely that a single individual's beliefs or behaviour could be identified.

Some researchers question whether traditional participant observations truly provide insight into people’s minds. However, most qualitative researchers suggest that this can be done by active participation in a group’s life over a period of time, without having any preconceived ideas. Some researchers believe that you can only truly understand people’s world views if you base your work on the way people understand the world themselves. People’s “theories of the world” are grounded in their daily interactions and communications. In order to discover these theories of the world, the researcher should look for regularities and patterns in the data to eventually discover the “rules” and “beliefs” that influence people.

It is important that researchers are aware of how their interactions with participants may affect their behaviour.  Critical thinking like this is always important, but particularly when the researcher chooses to study a group in which he or she has a personal or political interest. When writing up the analysis of the study, it is important that the researcher includes this information and any other relevant biographical data because this may have influenced the interpretation of the data. This is an example of reflexivity.

Evaluation of participant observation
Strength: Provides very detailed and in-depth knowledge of a topic, which cannot be gained by other methods.
Strength: One of the best methods to avoid researcher bias because the researchers seek to understand how and why the social processes are the way they are, instead of imposing their own reality on the phenomenon.
Strength: Provides a holistic interpretation of a topic, because the researcher takes into account as many aspects as possible of that particular group of people, in order to synthesize observations into a whole. The researcher uses material from the participants themselves to generate “theory” and tries to explain one set of observations in terms of its relationship with others.
Limitation: Difficult to record data promptly and objectively.
Limitation: Time-consuming and demanding. The researcher needs to be physically present and try to live the life of the people he or she is studying. This takes time - as does data analysis - if the researcher is to arrive at an account that is reasonably objective and contextually sensitive. This is not possible for short-term projects.
Limitation: Risk that researchers lose objectivity. Researchers are supposed to immerse themselves, or “go native” - that is, be able to see the world from the point of view of the participants. This may present problems in terms of objectivity. In participant observation, there is a delicate balance between involvement and detachment.

Non-participant observation

Non-participant observation means that the researcher is not part of the group being studied. It is a research technique by which the researcher observes participants, with or without their knowledge. The researcher does not take an active part in the situation. One example of non-participant observation could be a researcher studying gender differences in teacher feedback in a school class. The researcher could sit in the back of the classroom and observe the teacher. Critics of this method argue that people who are observed do not behave naturally. This is called reactivity, and it is assumed that reactivity will invalidate the data. Some observational research takes place in psychological laboratories - for example, through one-way mirrors. It is believed that this kind of observation does not really reflect what people do in real life, but it may be useful to conduct research in this way because it is easier and faster to gather data by this method.

Deception is sometimes used in non-participant observation, because the behaviour being observed may be changed if participants know they are being studied. However, it is essential that the researcher always respects the individual’s privacy and the rule of confidentiality.

Naturalistic observation

Naturalistic observation simply means that the observation takes place in the participants’ natural environment. The most important thing in naturalistic observations is that the researcher should not interfere with the naturally occurring behaviour. In order to reduce reactivity, the researcher could spend some time with the participants before the observation begins, so that the participants get used to his or her presence. The researcher could also use cameras to film behaviour and then use this for analysis. If cameras are present for a long period, they will most likely not interfere with natural behaviour.

Evaluation of naturalistic observations
Strength: Naturalistic observations have high ecological validity. The collection of data takes place in the participants' natural environment and it is assumed that the participants behave as they usually do, in contrast to research in laboratories.
Strength: Can be used to collect data in cases where it would be impossible or unethical to do so otherwise—for example, research on people with Alzheimer’s disease.
Limitation: There is the risk that people do react to being observed - that is, there may be reactivity involved.
Limitation: If the researcher collects the data alone, there may be problems in checking the data. However, multiple observers in the same field can compare data to ensure a match of the data (sometimes called inter-observer reliability). The researcher can also document the fieldwork extensively and explain how he or she arrived at the conclusions reached, in order to promote credibility.
Limitation: Ethical considerations concerning the appropriateness of observing strangers without their knowledge. The researcher should also be aware not to violate the privacy of participants.

Overt and covert observation

Participant and non-participant observations can be overt or covert. The researcher decides in advance which technique is most appropriate for the research. There are strengths and limitations of both approaches.

In an overt observation, the participants know they are being observed. This is the main strength in terms of ethical considerations.  The researcher lets the participants know that he or she is a researcher, but the purpose of the study may not always be clear.  A researcher studying a group of women in a women’s shelter might simply say that she is writing a book on domestic violence and how women cope with it. This may be enough to gain acceptance for the project.  In overt participant observations where the psychologist actively participates in the group being studied, the participants are informed about the research and give informed consent.

In a covert observation, the participants are not aware they are being studied, so they have not agreed to it. The participant has to “make up a story” to justify his or her presence in the setting in order to mask his or her real purpose in being there. This method has been used over the years in settings where it would otherwise be difficult to gain access, or when it is important that the presence of the researcher does not affect the behaviour of the people in the study.

Considerations involved in setting up and carrying out an observation

An observation is not just about “hanging around”. A researcher who decides to carry out an observation must prepare it carefully. The researcher needs to decide exactly what to focus on in the field while leaving space for flexibility. It may be a good idea that the researcher becomes familiar with the setting and the participants before starting the observations. This could reduce some of the problems of having a stranger in the setting.

The researcher must take some initial decisions as to the purpose of the research and what kind of notes to make during observations.  When collecting data, researchers refer to point, time, and event sampling.

Data collection in observational research

Event sampling means that a researcher makes a note only when they observe the behaviour being studied.  If the researcher is studying aggression on a school playground, she would only take notes when an aggressive act is observed.

Point sampling means that a researcher makes note of the behaviour of each participant and then moves on to the next participant.  If the researcher is studying time "on-task" in the classroom, he may note what student 1 is doing, then student 2, then student 3, and so on.

Time sampling means that a researcher makes note of the behaviour of the sample at a regular time interval.  If the researcher is studying time "on-task" in the classroom, every three minutes she may note what percentage of the students are engaged.

The researchers also have to decide whether they will identify the behaviours that will be observed before the observation or whether they will take an unstructured approach and analyze behaviour after the observation. In a  structured observation, the researcher records specific predetermined features of behaviour, using a checklist that has been developed before the observation. This is a deductive approach that is based on existing theory.  Data collection is easier and the research team can be trained in how to carry out the observation so that the process is standardized.  However, making a checklist limits the observation to preset categories which may not always reflect what happens in a naturalistic environment.

Researchers may prefer to use a more inductive approach with an unstructured observation. In an unstructured observation, the researcher records all behaviour relevant to a research question. There is no checklist. After the observations, the researchers look through their field notes to see what patterns emerge from their data.

Deciding how the data will actually be recorded is also important - both from a methodological and an ethical point of view.  One way of collecting data is to take notes or fill in checklists while observing the participants.  In an overt observation, this could lead to reactivity.  As noted above, one way to reduce reactivity is for the researcher to conduct pre-observation interviews with the participants. The participants should also be briefed about the purpose of the research and what is going to occur during the observations. Creating a rapport with the participants may reduce concern about the observation and result in more naturalistic behaviour.

Another possibility is to record the participants' behaviour on camera.  In an overt observation, this would need consent and the recordings may only be used for analysis; the identities of the participants must be protected. In covert observations, the use of cameras or recordings without the consent of the participants raises serious ethical concerns.

In the case of covert participant observations, taking notes is not really practical, but it is often the only way to record data.  In Festinger's classic study, he and his team would excuse themselves to go to the bathroom, where they would write down what they could remember from their observations and conversations. This method has clear limitations as it assumes that the researcher is able to accurately recall information when he finally has time to write everything down.

In observations, the goal is to preserve researcher objectivity, so that the data collection is not influenced by selective perception. With this in mind, it is helpful to have several researchers observing the sample at the same time. An advantage is that one observer might notice what another has missed. It also allows the researchers to establish inter-observer reliability if their observations are similar. In the case where behaviour is filmed, this makes it easier for several researchers to carry out the observation with the hope of confirming the original researcher's findings.

After the observations, the researcher can conduct post-observational interviews, and the participants must be debriefed, unless the observations were covert.

ATL: Think critically

For each of the following observation scenarios, what would the researcher have to consider with regard to:

          Data collection

          Ethical considerations

          Selection of the sample

          Setting up the observation

Scenario 1

Some students have been identified in your school as being incredibly low stress. The school is sponsoring research to find out how these students handle stressful situations with the goal of then helping other students with their stress management.

Scenario 2

Your city appears to be having a problem with pickpockets at the tourist sights. The city has asked that you carry out a study of how tourist behaviours may increase the likelihood of being robbed.

Scenario 3

You have been asked to carry out a study at the local zoo on the social habits of gorillas.

 Teacher only box

Scenario 1

Some students have been identified in your school as being incredibly low stress. The school is sponsoring research to find out how these students handle stressful situations with the goal of then helping other students with their stress management.

For this study, it would be a question as to how the sample would be chosen. Would this be self-identified?  Teacher identified? Stress is manifested differently by students, so it would be hard to identify "low stress students."

The observation would also be problematic in that it is not clear what situation would be observed. Students during mock exam week? During a test?  And if so, which subject?  We have to be careful not to assume that the same stressor has the same effect on all students.

For ethical considerations, consent is problematic as it may influence their behaviour. In addition, if done within a school community, it is important that the anonymity of the participants is maintained.

Scenario 2

Your city appears to be having a problem with pickpockets at the tourist sights. The city has asked that you carry out a study of how tourist behaviours may increase the likelihood of being robbed.

Students may discuss several different points here.  Where in the city would they carry out the research?  Do they just watch tourists get robbed?  Or do they intervene, which then puts the researchers in jeopardy.  If they don't actually get robbed but do something that may lead to them being victims of theft, is this just an example of researcher bias? There is also a very strange ethical concern with this study - the city is assuming that theft is partially due to "tourist behaviour."  One wonders what the intended application of the findings of this study would be.

Scenario 3

You have been asked to carry out a study at the local zoo on the social habits of gorillas.

Again, students may discuss issues like the sample size - e.g. if there are only four gorillas, to what extent can we generalize the findings? In addition, to what extent are the researchers aware of the normal behaviours of gorillas before carrying out their observation.  It is also problematic that this is like a "lab observation" in that the gorillas are not in their natural environment - thus, potentially affecting their behaviour.

Analysing and interpreting observations

After completing the observation, the field notes (and perhaps video recordings) must be analyzed and synthesized. The researcher should include information from the interviews conducted prior to and after the observations. He or she will probably also include information that can place the observations in context -  that is, describing in detail the environment and social context in which the observations took place. A “thick” description provides rich data.

One way to analyze the data is by carrying out an inductive content analysis.  The classification process consists of reading and rereading the field notes in an interactive way. The researcher must be able to identify bits of data and create categories. The researcher should write a summary of the analysis so that independent readers can follow how and why the connections are reached. These notes about notes are called memos.

When the data have been classified into themes, the researcher can look for higher-order themes and subthemes. The interpretation of the data is based on the collected data. It is important to think critically and not only look for data that support the interpretation. The researcher should also search for evidence that could contradict the interpretation. Critical thinking means looking for alternative explanations.

In the end, the researcher produces a coherent explanation and an overall theoretical framework for understanding the phenomenon under investigation. The theoretical framework is “grounded” - that is, it is based on the categories identified during the observation.  In order for researchers to establish the credibility of the interpretations of the observations, there are a few steps that can be taken. They may share the findings of the observations with the participants, to ask them whether they feel that they agree with the interpretation of their behaviour. Additionally, they can ask other researchers to take a critical look at the data to see whether they can support the interpretation and conclusions that were generated. It is important for the researcher to make it possible for the reader to track and verify how the conclusion is reached.

ATL: Thinking critically

Read the following study on aggressive behaviour during hockey tournaments.

Participants were 79 male varsity hockey players. Coaches were approached and informed of the study. Once permission was granted the teams were approached and asked for consent. The consent process occurred roughly 3 weeks before the tournament, in an attempt to minimize any social desirability biases. On game day, two cameras were placed on opposite sides of the rink. The cameras were placed at center ice, in order to provide the most detailed picture of the entire playing surface. Camera operators were instructed to capture as many of the players as possible at any one time, while always maintaining a relatively clear view of the players’ numbers. In total, three games were observed.


The competitive tapes were coded by two independent observers using an operationalized checklist, with high inter-rater reliability. The “intent to harm” was the defining characteristic of aggressive behaviour. Fourteen behaviours were labeled as “aggression”, including cross-checking, fighting, charging, head-butting, kneeing, spearing, high sticking, and elbowing.

A total of 74 aggressive behaviours were coded from the three games under investigation. Of the 74 behaviours coded by the two independent observers, only 14 received actual on-ice penalization. With respect to overall performance, winning, losing, and tied teams committed relatively equal numbers of aggressive acts. Also, there was no significant difference observed between players occupying different positions. Both offensive and defensive players committed relatively the same number of aggressive acts.

1. What type of observation was this? What is one strength and one limitation of using this type of observation?

This is a naturalistic, overt, non-participant observation. Strengths include that there is high ecological validity, there is no use of deception, and that the researcher does not interfere in the behaviour of the participants. Limitations include that variables cannot be easily controlled (for example, if girlfriends are at the game), knowing that they are being observed may lead to demand characteristics, and being "outside" of the game may mean that behaviour is misinterpreted by the researchers.

2. The summary above says that “The consent process occurred roughly three weeks before the tournament, in an attempt to minimize any social desirability biases.” What is meant by “to minimize any social desirability biases?”

Social desirability bias would mean that the hockey players were on their best behaviour in order to look good for the researchers. By asking them so far in advance of the study, it is hoped that when they are finally watched, they will be less likely to display this demand characteristic because they are less likely to be conscious of the fact that they are being observed. This will reduce the level of reactivity.

3. The summary above says that “ The competitive tapes were coded by two independent observers using an operationalized check-list, with high inter-rater reliability.” What is meant by “inter-rater reliability?”

Inter-rater reliability is the consistency in the observations made by members of the team of researchers carrying out the study. In this case, researchers should have observed similar rates of aggression in order for the results to be considered reliable

4. This study used a deductive approach to analysis.  What would this study look like if it were analyzed using an inductive approach?

An inductive approach would most likely use an unstructured observation. Fields notes would then be read and reread to look for trends with regard to the hockey players' behaviour on the ice.  The researchers would pull out "themes" which may have been overlooked in a predetermined checklist.

5. Identify one concern you have about the way that this study was carried out.

There are several possible responses here. One is that only four matches are observed. Is this enough to draw conclusions? In addition, these are varsity teams. To what extent can the findings be transferred to professional sports teams? Or women's teams? In addition, one has to consider the history of the team that they are playing against. Is it considered an easy win? Is this a long-standing rival?

Checking for understanding

Festinger's study of the Doomsday cult is an example of what type of observation?

 

 

Which of the following is a strength of a participant observation?

In a participant observation, the reseacher is not taking an "outsider's view" but is becoming involved with the participants with the goal of better understanding their situation. This, of course, has the potential problem of introducing researcher bias into the interpretation of the findings.  This is why researcher triangulation is important in such observations.

 

Which of the following is a limitation of a covert observation?

 

 

Which of the following is not a limitation of a naturalistic observation?

 

 

Which of the following is true of an inductive approach to carrying out observations?

 

 

Which of the following would be true if all members of the team record a similar level of aggressive play on a playground while watching the same group of children?

 

 

A researcher wanted to study how mothers handle stress when they are with their child. A series of lab observations were carried out where mothers were given a very frustrating task to complete with the promise that they would be paid 20 dollars if they completed the task in the time allotted.  They had been instructed to bring their 2 - 3 year old child with them to the lab.  After writing up an interpretation of the mothers' behaviour, the researcher shared the interpretations with the mothers to see whether they felt that the interpretation reflected their experience in the lab.  Why did the researcher do this?

 

 

Total Score:

HL: Understanding interviews