Natural experment: Smoking bans
The following is a sample Paper 3 that looks at a natural experiment. Below you will first find the stimulus piece, followed by the static questions. A copy of the mock paper is included to give students as an in-class assessment.
Potential answers are included in the hidden boxes below.
Stimulus piece
The following study by Hyland et al (2009) is a natural experiment using a longitudinal telephone survey of nationally representative samples of smokers and non-smokers aged 18 years or older in Scotland and the rest of the UK.
The aim of the study was to evaluate how Scotland's smoking ban impacted the lives of the average person in Scotland compared to the rest of the UK, where these laws were not yet in place. The goal was to look at exposure to secondhand smoke, attitudes toward the smoking ban and frequency of going to pubs and restaurants.
The study carried out a telephone survey with a sample of 705 Scottish smokers and 417 non-smokers. In addition, surveys were carried out with 1027 smokers and 447 non-smokers in the rest of the UK where smoking in public places was not regulated at the time. Respondents were recruited by telephone numbers selected at random from the population of each country with the goal of representing all geographic districts.
Respondents were interviewed before the Scottish law (February to March 2006) and 1 year later after the law (March 2007).
The results showed a significant decline in smoking in pubs, restaurants and workplaces compared to the UK. In addition, support for the smoking ban increased to a greater extent in Scotland than in the rest of the UK. Although the self-reported frequency of going to pubs and restaurants was similar in Scotland and the rest of the UK, non-smokers in Scotland showed a significant increase in their frequency of going to pubs. There was no clear difference in smoking cessation observed - although this could be due to the length of the study. One year may not have been enough time to notice such effects of the law.
The researchers concluded that the Scottish smoking ban has been successful in decreasing secondhand smoke exposure while at the same time having no significant negative effect on pubs and restaurants.
Questions
1a. Identify the method used and outline two characteristics of the method.
The researchers used a natural experimental method. One characteristic is that the independent variable is naturally occurring and not manipulated by the researcher. In this, the IV was the imposition of the smoking ban. One group (Scotland) had the IV and the other group (UK) served as the control. A second characteristic of natural experiments is that the participants cannot be randomly allocated to conditions. In this experiment, participants were allocated to conditions based on whether they were in the part of the UK with the smoking ban in place or not.
1b. Describe the sampling method used in the study.
The sample is a geographically stratified sample. Each geographic district in Scotland and the rest of the UK was represented. From each district telephone numbers were randomly selected to be in the study. This may have been done by a random number generator or by pulling phone numbers out of a hat. As the numbers were randomly selected, this increases the probability that the sample is representative and thus the results may be generalized to the population from which the sample was drawn.
1c. Suggest an alternative or additional research method giving one reason for your choice.
An alternative measure would be to carry out focus group interviews prior to the smoking ban and then again a year later. The face to face experience, as well as being part of a group, is more natural than a phone interview and may result in more trust of the researcher, and potentially more "honest" responses. It also would allow the participants to interact with each other. This would potentially lead to responses which an individual might not think of in a phone survey - or it may also legitimize their own thoughts and give them the "permission" to share ideas that may be perceived as politically incorrect or socially undesirable.
2. Describe the ethical considerations that were applied in the study and explain if further ethical considerations could be applied.
Since the study was a phone survey, the researchers would have to obtain informed consent in order to carry out their research. They would have to inform the participants about the nature of the study, how the results would be used and their rights as participants, including the right to withdraw from the study at any time. There is little danger of "undue stress or harm" as the independent variable is not manipulated by the researchers. As consent is given to discuss their own smoking behaviour and their right to withdraw is guaranteed, there is no concerns about undue stress or harm. The researchers would also have to guarantee that their personal information would not be revealed in any publication and that their results would be anonymized. It would be important that the researchers debrief the participants about the study, sharing their findings. This also allows the participants to ask any questions, and if they feel that they would like to withdraw their data, there is an opportunity to do so.
3. Discuss the possibility of generalizing/transferring the findings of the study.
Representational generalizability: As the sample was randomly selected from each geographic division of the two areas of the UK - and the sample size was relatively large - it can be assumed that the sample is representative of the population. This means that we can generalize to the larger population of both Scotland and the rest of the UK
Transferability: However, it would be difficult to generalize the findings to other populations. Cultural dimensions such as power distance, socioeconomic status, and accessibility of cigarettes could all be variables that may affect the effectiveness of a smoking ban in a different country. Higher power distance may make individuals more likely to obey a smoking ban; more highly individualistic cultures may be more likely to oppose any such top-down approach to limiting unhealthy behavior. You would also have to look at, for example, the availability of cigarettes. If tobacco is cheap and easily accessible, then smoking rates may not change; but if in addition to the ban there is an increase in the cost of cigarettes, then there is more than one variable that must be considered and the findings could only be applied to similar situations.
Theoretical generalizability: Although you could generalize cautiously to other countries, it would be best to look at studies of other countries. If there are several studies from different countries with the same results (which there are), then we can generalize the findings more confidently about smoking bans in general. In addition, the study could be generalized to support theories of social cognition as a way to change behaviour - e.g. conformity or obedience.