Experimental Methods and Research Design

  1. A researcher wants to study the developmental changes in social and political attitudes that occur during the time a person is in college. The researcher is interested in both overall trends and in the changes that individual students undergo. Which survey research design will this researcher need to use?
    A. observational design
    B. cross-sectional design
    C. successive independent samples design
    D. longitudinal design
  2. In a study that investigates the effects of two different doses of a drug on memory performance, doses of the drug represent the _ variable and memory performance represents the _ variable.
    A. correlational; confounding
    B. experimental; control
    C. dependent; independent
    D. independent; dependent
  3. The validity of a questionnaire concerns
    A. removing any confounds.
    B. whether or not it causes response bias
    C. if it measures what it was designed to measure.
    D. how consistently it measures.
  4. (5 points) Distinguish between probability sampling and nonprobability sampling (explain the difference). Name two types of probability samples and one type of nonprobability sample.
  5. The problem of _ in a repeated measures design occurs when the effects of a condition persist or carry over to affect performance in the subsequent conditions.
    A. sensitivity
    B. anticipation effects
    C. differential transfer
    D. counterbalancing
  6. Researchers have studied changes in the values and goals of college freshman from 1966 to the present by drawing random samples from each year's incoming class. Which survey research design describes this research?
    A. cross-sectional design
    B. stratified random sampling design
    C. longitudinal design
    D. successive independent samples design
  7. A health psychologist conducts an experiment to test the effectiveness of three techniques for helping a person to relax. The psychologist has a limited number of people available to participate in the experiment, and each relaxation technique takes a long time to complete. The psychologist has decided, therefore, to use the incomplete repeated-measures design with all possible orders to balance practice effects. What is the minimum number of participants the psychologist will need for this experiment?
    A. 4 B. 6 C. 8 D. 24
  8. To determine which candidate for governor residents will vote for, a survey study was conducted by phone by a polling company. Ten percent of the state’s population makes over $200,000; 20% makes between $100,000 and $200,000; 50% makes between $50,000 and $100,000; and 20% makes below $50,000. Which sampling strategy makes sure all segments of the population are adequately surveyed?
    A. random B. non-probability C. prorated random D. stratified random
  9. Each of the three techniques that are used to balance practice effects in the incomplete repeated measures design conforms to a general rule that can be stated as
    A. each condition must appear in only one ordinal position.
    B. each condition must appear in the first ordinal position equally often.
    C. each condition must appear in each ordinal position at least twice.
    D. each condition must appear in each ordinal position equally often.
  10. (5 points) Match the definitions below with the proper terms.
    _ Sampling frame Population Sample _ Element
    A. each member of a population
    B. list of the members of a population
    C. set of all cases of interest
    D. subset of population drawn from a sampling frame
  11. Which of the following samples would be representative of a population that is 75% women and 25% men?
    A. 60 women, 20 men
    B. 78 women, 26 men
    C. 225 women, 75 men
    D. all of these
    E. none of these
  12. A survey researcher chose to administer a survey using the Internet. This sample likely overrepresents people who own a computer and underrepresents people who don't own a computer. This problem in the researcher's survey is best described as
    A. response bias.
    B. a stratified sample.
    C. selection bias.
    D. a spurious relationship.
  13. Which of the following is NOT one of the reasons researchers choose to use the repeated measures design?
    A. Repeated measures designs are generally less sensitive than are independent groups designs.
    B. Repeated measures designs are needed when the experimental procedures require participants to compare two or more stimuli.
    C. Repeated measures designs require fewer subjects.
    D. Repeated measures designs are more convenient and efficient.
  14. In a nationwide study conducted in 2017, samples of students were asked their opinions about the quality of their college education. The results of the survey were analyzed for differences among students at the various colleges and universities. What survey design was used in this study?
    A. correlated samples design
    B. longitudinal design
    C. cross-sectional design
    D. successive independent samples design
  15. A student is considering doing a complete repeated measures design experiment involving motor skills. The student's advisor has told him that people show a large initial improvement on the task followed by slow steady improvement after this initial change. The student must choose a technique for balancing practice effects. Which technique should the student NOT use?
    A. ABBA counterbalancing
    B. block randomization
    C. Latin Square
    D. all possible orders
  16. A researcher designs an experiment with five conditions, but each condition takes only a very short amount of time to administer. The researcher has the opportunity, therefore, to administer many trials of each condition in the experiment. Which of the following techniques is likely to be most effective for balancing practice effects?
    A. ABBA counterbalancing
    B. block randomization
    C. stratified randomization
    D. all possible orders of conditions
  17. A marketing researcher wants to test the effectiveness of three different types of advertisement. Each participant will respond to 50 examples of each type of advertisement so that the researcher can determine each person's preference. What type of design is this researcher using?
    A. conditional repeated measures design
    B. partial repeated measures design
    C. complete repeated measures design
    D. incomplete repeated measures design
  18. A researcher compares students' performance using a new learning strategy to their performance using the old strategy. Students' performance is first tested with the old strategy, followed by the new strategy. The results indicate that students perform better with the new strategy. These results
    A. show that the order of the two learning strategies does not matter.
    B. are uninterpretable due to the confounding with practice effects.
    C. indicate that teachers should use the new strategy.
    D. all of these
    Go to next pages for essays
  19. (8 points) A researcher was interested in developing a reliable and valid measure of friendliness. That is, she wanted to distinguish between friendly and unfriendly people using her questionnaire. To determine whether she developed a good measure (called "Friend"), she administered her "Friend" questionnaire to a group of 300 people twice (Friend-Time 1 and Friend-Time 2), separated by six months. At the second testing session, she also administered a similar questionnaire called "Nice," which previous research has shown to be a valid measure of people's ability to get along with people and to make friends. She also administered a questionnaire designed to measure art ability, which she predicted to be unrelated to friendliness. She observed the following correlations among the measures:
    Friend-Time 1/Friend Time 2 correlation: .90
    Friend Time 1/Nice correlation: .80
    Friend Time 2/Nice correlation: .85
    Friend Time 1/Art Ability correlation: .10
    Friend Time 2/Art Ability correlation: .15
    Which correlation coefficient is an indicator of whether the "Friend" measure is reliable?
    Which correlation(s) test(s) convergent validity?
    Which correlation(s) test(s) discriminant validity?
    Do these correlations suggest her questionnaire is reliable and valid? Why or why not?
  20. (8 points) A researcher wishes to use stratified random sampling to select a representative sample of 100 people from a population that has the following characteristics:
    Describe the sample in terms of how many single and married women and men the researcher would need to represent the population.
    Suppose the researcher mails the survey to the 100 people in the representative sample and only 50 of the people return a completed survey. Can you state that this sample of 50 represents the population? Why or why not?
  21. (8 points) A psychologist wishes to have participants rate two different sets of inkblots (labeled A and B) for their "emotionality." The inkblots differ in their use of color. Ten inkblots in set A are created in shades of gray; ten inkblots in set B use shades of red, blue, and yellow. The psychologist hypothesizes that color will influence participants' ratings of emotionality. Each participant will rate all twenty inkblots.
    What is the independent variable in this experiment?
    What is the dependent variable in this experiment?
    What potential confounding variable must be balanced in this research?
    Explain what balancing procedure would be best for this experiment.
  22. (8 points) Explain (don’t just mention, explain) one concept from Chapter 5 or 7 that you know that I did not ask a question about on this test

Sample Solution