Skip to main content

Scientific Inquiry in Social Work: 7.4 Mixed Methods

Scientific Inquiry in Social Work
7.4 Mixed Methods
  • Show the following:

    Annotations
    Resources
  • Adjust appearance:

    Font
    Font style
    Color Scheme
    Light
    Dark
    Annotation contrast
    Low
    High
    Margins
  • Search within:
    • Notifications
    • Privacy
  • Project HomeSWK 340: Social Work Research Methods OER Collection
  • Projects
  • Learn more about Manifold

Notes

table of contents
  1. Cover
  2. Title Page
  3. Copyright
  4. Table Of Contents
  5. Student and Instructor Resources
  6. Copyright Information
  7. Acknowledgements and Contributors
  8. Version Information
  9. 1. Introduction to research
    1. 1.0 Chapter introduction
    2. 1.1 How do social workers know what to do?
    3. 1.2 Science and social work
    4. 1.3 Why should we care?
    5. 1.4 Understanding research
  10. 2. Beginning a research project
    1. 2.0 Chapter introduction
    2. 2.1 Getting started
    3. 2.2 Sources of information
    4. 2.3 Finding literature
  11. 3. Reading and evaluating literature
    1. 3.0 Chapter introduction
    2. 3.1 Reading an empirical journal article
    3. 3.2 Evaluating sources
    4. 3.3 Refining your question
  12. 4. Conducting a literature review
    1. 4.0 Chapter introduction
    2. 4.1 What is a literature review?
    3. 4.2 Synthesizing literature
    4. 4.3 Writing the literature review
  13. 5. Ethics in social work research
    1. 5.0 Chapter introduction
    2. 5.1 Research on humans
    3. 5.2 Specific ethical issues to consider
    4. 5.3 Ethics at micro, meso, and macro levels
    5. 5.4 The practice of science versus the uses of science
  14. 6. Linking methods with theory
    1. 6.0 Chapter introduction
    2. 6.1 Micro, meso, and macro approaches
    3. 6.2 Paradigms, theories, and how they shape a researcher’s approach
    4. 6.3 Inductive and deductive reasoning
  15. 7. Design and causality
    1. 7.0 Chapter introduction
    2. 7.1 Types of research
    3. 7.2 Causal relationships
    4. 7.3 Unit of analysis and unit of observation
    5. 7.4 Mixed Methods
  16. 8. Creating and refining a research question
    1. 8.0 Chapter introduction
    2. 8.1 Empirical versus ethical questions
    3. 8.2 Writing a good research question
    4. 8.3 Quantitative research questions
    5. 8.4 Qualitative research questions
    6. 8.5 Feasibility and importance
    7. 8.6 Matching question and design
  17. 9. Defining and measuring concepts
    1. 9.0 Chapter introduction
    2. 9.1 Measurement
    3. 9.2 Conceptualization
    4. 9.3 Operationalization
    5. 9.4 Measurement quality
    6. 9.5 Complexities in quantitative measurement
  18. 10. Sampling
    1. 10.0 Chapter introduction
    2. 10.1 Basic concepts of sampling
    3. 10.2 Sampling in qualitative research
    4. 10.3 Sampling in quantitative research
    5. 10.4 A word of caution: Questions to ask about samples
  19. 11. Survey research
    1. 11.0 Chapter introduction
    2. 11.1 Survey research: What is it and when should it be used?
    3. 11.2 Strengths and weaknesses of survey research
    4. 11.3 Types of surveys
    5. 11.4 Designing effective questions and questionnaires
  20. 12. Experimental design
    1. 12.0 Chapter introduction
    2. 12.1 Experimental design: What is it and when should it be used?
    3. 12.2 Pre-experimental and quasi-experimental design
    4. 12.3 The logic of experimental design
    5. 12.4 Analyzing quantitative data
  21. 13. Interviews and focus groups
    1. 13.0 Chapter introduction
    2. 13.1 Interview research: What is it and when should it be used?
    3. 13.2 Qualitative interview techniques
    4. 13.3 Issues to consider for all interview types
    5. 13.4 Focus groups
    6. 13.5 Analyzing qualitative data
  22. 14. Unobtrusive research
    1. 14.0 Chapter introduction
    2. 14.1 Unobtrusive research: What is it and when should it be used?
    3. 14.2 Strengths and weaknesses of unobtrusive research
    4. 14.3 Unobtrusive data collected by you
    5. 14.4 Secondary data analysis
    6. 14.5 Reliability in unobtrusive research
  23. 15. Real-world research
    1. 15.0 Chapter introduction
    2. 15.1 Evaluation research
    3. 15.2 Single-subjects design
    4. 15.3 Action research
  24. 16. Reporting research
    1. 16.0 Chapter introduction
    2. 16.1 What to share and why we share
    3. 16.2 Disseminating your findings
    4. 16.3 The uniqueness of the social work perspective on science
  25. Glossary
  26. Practice behavior index
  27. Attributions index

7.4 Mixed Methods

Learning Objectives

  • Define sequence and emphasis and describe how they work in qualitative research
  • List the five reasons why researchers use mixed methods

So far in this textbook, we have talked about quantitative and qualitative methods as an either/or choice—you can choose quantitative methods or qualitative methods. However, researchers often use both methods inside of their research projects. For example, I recently completed a study with the people who administer state-level services for people with intellectual and developmental disabilities on a program they implemented called self-direction, which allows people with disabilities greater self-determination over their supports. In this study, my research partners and I used a mixed methods approach to understand the implementation of the program. The goal of our project was to describe the implementation of self-direction across the United States. We distributed a short, written survey and also conducted phone interviews with program administrators. While we could have just sent out a questionnaire that asked states to provide basic information on their program (size, qualifications, services offered, etc.), that would not provide us much information about some of the issues administrators faced during implementation of the program. Similarly, we could have interviewed program administrators without the questionnaire, but then we wouldn’t know enough about the programs to ask good questions. Instead, we chose to use both qualitative and quantitative methods.

three hands, holding up one finger, two fingers, then three fingers

Sequence and emphasis

There are many different mixed methods designs, each with their own strengths. However, a more simplified synthesis of mixed methods approaches is provided by Engel and Schutt (2016) [1] using two key terms. Sequence refers to the order that each method is used. Researchers can use both methods at the same time or concurrently. Or, they can use one and then the other, or sequentially. For our study of self-direction, we used a sequential design by sending out a questionnaire first, conducing some analysis, and then conducting the interview. We used the quantitative questionnaire to gather basic information about the programs before we began the interviews, so our questions were specific to the features of each program. If we wanted to use a concurrent design for some reason, we could have asked quantitative questions during the interview. However, we felt this would waste the administrators’ time and would break up the conversation and rhythm of the interviews.

The other key term in mixed methods research is emphasis. In our mixed methods study, the qualitative data was the most important data. The quantitative data was mainly used to provide background information for the qualitative interviews, and our write up of the study focused mostly on the qualitative information. Thus, qualitative methods were prioritized in our study. Many times, however, quantitative methods are emphasized. In these studies, qualitative data is used mainly to provide context for the quantitative findings. For example, demonstrating quantitatively that a particular therapy works is important. By adding a qualitative component, researchers could find out how the participants experienced the intervention, how they understood its effects, and the meaning it had on their lives. This data would add depth and context to the findings of the study and allow researchers to improve the therapeutic technique in the future.

A similar practice is when researchers use qualitative methods to solicit feedback on a quantitative scale or measure. The experiences of individuals allow researchers to refine the measure before they do the quantitative component of their study. Finally, it is possible that researchers are equally interested in qualitative and quantitative information. In studies of equal emphasis, researchers consider both methods as the focus of the research project.

Why researchers use mixed methods

Mixed methods research is more than just sticking an open-ended question at the end of a quantitative survey. Mixed methods researchers use mixed methods for both pragmatic and synergistic reasons. That is, they use both methods because it makes sense with their research questions and because they will get the answers they want by combining the two approaches.

Mixed methods also allows you to use both inductive and deductive reasoning. As we’ve discussed, qualitative research follows inductive logic, moving from data to empirical generalizations or theory. In a mixed methods study, a researcher could use the results from a qualitative component to inform a subsequent quantitative component. The quantitative component would use deductive logic, using the theory derived from qualitative data to create and test a hypothesis. In this way, mixed methods use the strengths of both research methods, using each method to understand different parts of the same phenomenon. Quantitative allows the researcher to test new ideas. Qualitative allows the researcher to create new ideas.

With these two concepts in mind, we can start to see why researchers use mixed methods in the real world. I mentioned previously that our research project used a sequential design because we wanted to use our quantitative data to shape what qualitative questions we asked our participants. Mixed methods are often used this way, to initiate ideas with one method to study with another. For example, researchers could begin a mixed methods project by using qualitative methods to interview or conduct a focus group with participants. Based on their responses, the researchers could then formulate a quantitative project to follow up on the results. This is the inverse of what we did in our project, which was use a quantitative survey to inform a more detailed qualitative interview.

In addition to providing information for subsequent investigation, using both quantitative and qualitative information provides additional context for the data. For example, in our questionnaire for the study on self-direction, we asked participants to list what services people could purchase. The qualitative data followed up on that answer by asking whether the administrators had added or taken away any services, how they decided that these services would be covered and not others, and problems that arose around providing these services. With that information, we could analyze what services were offered, why they were offered, and how administrators made those decisions. In this way, we learned the lived experience of program administrators, not just the basic information about their programs.

Finally, another purpose of mixed methods research is corroborating data from both quantitative and qualitative sources. Ideally, your qualitative and quantitative results should support each other. For example, if interviews with participants showed a relationship between two concepts, that relationship should also be present in the qualitative data you collected. Differences between quantitative and qualitative data require an explanation. Perhaps there are outliers or extreme cases that pushed your data in one direction or another, for example.

In summary, these are a few of the many reasons researchers use mixed methods. They are summarized below:

  1. Triangulation or convergence on the same phenomenon to improve validity
  2. Complementarity, which aims to get at related but different facets of a phenomenon
  3. Development or the use of results from one phase or a study to develop another phase
  4. Initiation or the intentional analysis of inconsistent qualitative and quantitative findings to derive new insights
  5. Expansion or using multiple components to extend the scope of a study (Burnett, 2012, p. 77). [2]

yellow sign reading caution

A word of caution

The use of mixed methods has many advantages. However, undergraduate researchers should approach mixed methods with caution. Conducting a mixed methods study may mean doubling or even tripling your work. You must conceptualize how to use one method, another method, and how they fit together. This may mean operationalizing and creating a questionnaire, then writing an interview guide, and thinking through how the data on each measure relate to one another—more work than using one quantitative or qualitative method alone. Similarly, in sequential studies, the researcher must collect and analyze data from one component and then conceptualize and conduct the second component. This may also impact how long a project may take. Before beginning a mixed methods project, you should have a clear vision for what the project will entail and how each methodology will contribute to that vision.

Key Takeaways

  • Mixed methods studies vary in sequence and emphasis.
  • Mixed methods allow the research to corroborate findings, provide context, follow up on ideas, and use the strengths of each method.

Glossary

  • Emphasis- in a mixed methods study, refers to the priority that each method is given
  • Sequence- in a mixed methods study, refers to the order that each method is used, either concurrently or sequentially

Image attributions

one two three/ un deux trois by Improulx CC-0

caution by geralt CC-0


  1. Rubin, C. & Babbie, S. (2017). Research methods for social work (9th edition). Boston, MA: Cengage. ↵
  2. Burnett, D. (2012). Inscribing knowledge: Writing research in social work. In W. Green & B. L. Simon (Eds.), The Columbia guide to social work writing (pp. 65-82). New York, NY: Columbia University Press. ↵

Annotate

Next CHAPTER
8. Creating and refining a research question
PreviousNext
Copyright © 2018 by Matthew DeCarlo. Scientific Inquiry in Social Work by Matthew DeCarlo is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License, except where otherwise noted.
Powered by Manifold Scholarship. Learn more at
Opens in new tab or windowmanifoldapp.org