Abstract
Fields from political science to critical education policy studies have long explored power relations in policy processes, showing who influences policy agendas, policy creation, and policy implementation. Yet showing particular actors’ influence on specific points in a policy text remains a methodological challenge. This article presents a five-stage, embedded mixed methods design for establishing influence on educational policy moving from a policy text outward. I use an example analysis of Australia’s policy making on boys’ education—the report Boys: Getting it Right (2002)—to show how data transformation measures, both quantitizing and qualitizing, within a larger qualitative study helped identify influence. This mixed design, I argue, can be useful in other research contexts, with variations for data availability and researcher resources.
|
Adler, P. A., Adler, P. (2003). The reluctant respondent. In Holstein, J. A., Gubrium, J. F. (Eds.), Inside interviewing: New lenses, new concerns (pp. 153-173). Thousand Oaks, CA: Sage. Google Scholar | |
|
Ainsworth, S. (2010). Methodological perspectives on interest groups. In Maisel, L. S., Berry, J. M. (Eds.), The Oxford handbook of American political parties and interest groups (pp. 77-96). Oxford, England: Oxford University Press. Google Scholar | Crossref | |
|
Amenta, E., Caren, N., Chiarello, E., Su, Y. (2010). The political consequences of social movements. Annual Review of Sociology, 36, 287-307. Google Scholar | Crossref | ISI | |
|
Apple, M. W. (1995). Education and power (2nd ed.). New York, NY: Routledge. Google Scholar | |
|
Apple, M. W. (2000). Official knowledge: Democratic education in a conservative age (2nd ed.). New York, NY: Routledge. Google Scholar | |
|
Apple, M. W. (2006). Educating the “Right” way: Markets, standards, God, and inequality (2nd ed.). New York, NY: Routledge. Google Scholar | |
|
Armstrong, D., Gosling, A., Weinman, J., Marteau, T. (1997). The place of inter-rater reliability in qualitative research: An empirical study. Sociology, 31, 597-606. Google Scholar | SAGE Journals | ISI | |
|
Australian House of Representatives Standing Committee on Education and Training . (2002). Boys: Getting it right. Report on the inquiry into the education of boys. Canberra, Australia: Parliament of the Commonwealth of Australia. Google Scholar | |
|
Ball, S. J. (1994a). Education reform: A critical and post-structural approach. Buckingham, England: Open University Press. Google Scholar | |
|
Ball, S. J. (1994b). Researching inside the state: Issues in the interpretation of elite interviews. In Halpin, D., Troyna, B. (Eds.), Researching education policy: Ethical and methodological issues (pp. 107-120). London, England: Falmer Press. Google Scholar | |
|
Ball, S. J. (2007). Education Plc: Understanding private sector participation in public sector education. Abingdon, England: Routledge. Google Scholar | |
|
Ball, S. J. (2010). New states, new governance and new education policy. In Apple, M. W., Ball, S. J., Gandin, L. A. (Eds.), The Routledge international handbook of the sociology of education (pp. 155-166). Abingdon, England: Routledge. Google Scholar | |
|
Banfield, E. C. (1961). Political influence. New York, NY: Free Press. Google Scholar | |
|
Baumgartner, F. R., Berry, J. M., Hojnacki, M., Kimball, D. C., Leech, B. L. (2009). Lobbying and policy change: Who wins, who loses, and why. Chicago, IL: University of Chicago Press. Google Scholar | Crossref | |
|
Bensimon, E. M., Marshall, C. (2000). Policy analysis for postsecondary education: Feminist and critical perspectives. In Glazer-Raymo, J., Townsend, B. K., Ropers-Huilman, B. (Eds.), Women in higher education: A feminist perspective (2nd ed., pp. 133-147). Boston, MA: Pearson Custom. Google Scholar | |
|
Bhanji, Z. (2012). Transnational private authority in education policy in Jordan and South Africa: The case of Microsoft Corporation. Comparative Education Review, 56, 300-319. Google Scholar | Crossref | ISI | |
|
Bhatta, P. (2011). Aid agency influence in national education policy-making: A case from Nepal’s “Education for All” movement. Globalisation, Societies and Education, 9(1), 11-26. Google Scholar | Crossref | |
|
Bryman, A. (2006). Integrating quantitative and qualitative research: How is it done? Qualitative Research, 6, 97-113. Google Scholar | SAGE Journals | |
|
Carspecken, P. F. (1996). Critical ethnography in educational research. New York, NY: Routledge. Google Scholar | |
|
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46. Google Scholar | SAGE Journals | ISI | |
|
Creswell, J. W., Plano Clark, V. L. (2010). Designing and conducting mixed methods research (2nd ed.). Thousand Oaks, CA: Sage. Google Scholar | |
|
Dahl, R. A. (2005). Who governs? Democracy and power in an American city (2nd ed.). New Haven, CT: Yale University Press. Google Scholar | |
|
Eisenstein, H. (1996). Inside agitators: Australian femocrats and the state. Philadelphia, PA: Temple University Press. Google Scholar | |
|
Fairclough, N. (1995). Critical discourse analysis: The critical study of language. London, England: Longman. Google Scholar | |
|
Foucault, M. (1972). The archaeology of knowledge (Smith, A. M. S. , Trans.). New York, NY: Pantheon Books. Google Scholar | |
|
Gage, N. L. (1989). The paradigm wars and their aftermath: A “historical” sketch of research on teaching since 1989. Educational Researcher, 18(7), 4-10. Google Scholar | Abstract | |
|
Hess, F. M., Henig, J. R. (2008, February 6). “Scientific research” and policymaking. Education Week, 26, 36. Google Scholar | |
|
Hruschka, D. J., Schwartz, D., St. John, D. C., Picone-Decaro, E., Jenkins, R. A., Carey, J. W. (2004). Reliability in coding open-ended data: Lessons learned from HIV behavioral research. Field Methods, 16, 307-331. Google Scholar | SAGE Journals | |
|
Keddie, A. (2005). A framework for gender justice: Evaluating the transformative capacities of three key Australian schooling initiatives. Australian Educational Researcher, 32, 83-102. Google Scholar | Crossref | ISI | |
|
Kvale, S. (1996). InterViews: An introduction to qualitative research interviewing. Thousand Oaks, CA: Sage. Google Scholar | |
|
Landis, J. R., Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174. Google Scholar | Crossref | Medline | ISI | |
|
Lather, P. (2004). This IS your father’s paradigm: Government intrusion and the case of qualitative research in education. Qualitative Inquiry, 10(1), 15-34. Google Scholar | SAGE Journals | ISI | |
|
Levinson, B. A. U., Sutton, M., Winstead, T. (2009). Education policy as a practice of power: Theoretical tools, ethnographic methods, democratic options. Educational Policy, 23, 767-795. Google Scholar | SAGE Journals | ISI | |
|
Lincoln, Y. S., Guba, E. G. (1985). Naturalistic inquiry. Beverly Hills, CA: Sage. Google Scholar | |
|
Lingard, B. (2003). Where to in gender policy in education after recuperative masculinity politics? International Journal of Inclusive Education, 7(1), 33-56. Google Scholar | Crossref | |
|
Madill, A., Jordan, A., Shirley, C. (2000). Objectivity and reliability in qualitative analysis: Realist, contextualist and radical constructionist epistemologies. British Journal of Psychology, 91, 1-20. Google Scholar | Crossref | Medline | ISI | |
|
Maxwell, J. A. (2010). Using numbers in qualitative research. Qualitative Inquiry, 16, 475-482. Google Scholar | SAGE Journals | ISI | |
|
McDermott, K. A., DeBray, E., Frankenberg, E. (2012). How does Parents Involved in Community Schools matter? Legal and political influence in education politics and policy. Teachers College Record, 114(12), 1-39. Google Scholar | ISI | |
|
McFarland, A. (2010). Interest group theory. In Maisel, L. S., Berry, J. M. (Eds.), The Oxford handbook of American political parties and interest groups (pp. 37-56). Oxford, England: Oxford University Press. Google Scholar | Crossref | |
|
McNeil, L. (2000). Contradictions of school reform: Educational costs of standardized testing. New York, NY: RoutledgeFalmer. Google Scholar | |
|
Merriam, S. B. (1998). Qualitative research and case study applications in education. San Francisco, CA: Jossey-Bass. Google Scholar | |
|
Mertens, D. M. (2003). Mixed methods and the politics of human research: The transformative-emancipatory perspective. In Tashakkori, A., Teddlie, C. (Eds.), Handbook of mixed methods in social and behavioral research (pp. 135-164). Thousand Oaks, CA: Sage. Google Scholar | |
|
Mertens, D. M. (2007). Transformative paradigm. Journal of Mixed Methods Research, 1(3), 212-225. Google Scholar | SAGE Journals | ISI | |
|
Meyer, D. S. (2004). Protest and political opportunities. Annual Review of Sociology, 30, 125-145. Google Scholar | Crossref | ISI | |
|
Ministerial Council on Education Employment Training and Youth Affairs Gender Equity Taskforce . (1997). Gender equity: A framework for Australian schools. Canberra, Australia: Author. Google Scholar | |
|
Morse, J. M. (1991). Approaches to qualitative-quantitative methodological transformation. Nursing Research, 40, 120-123. Google Scholar | Crossref | Medline | ISI | |
|
Morse, J. M., Niehaus, L. (2009). Mixed methods design: Principles and procedures. Walnut Creek, CA: Left Coast Press. Google Scholar | |
|
Newman, A., Deschenes, S., Hopkins, K. (2011). From agitating in the streets to implementing in the suites: Understanding education policy reforms initiated by local advocates. Educational Policy, 26, 730-758. Google Scholar | SAGE Journals | ISI | |
|
Olson, M. (1965). The logic of collective action: Public goods and the theory of groups. Cambridge, MA: Harvard University Press. Google Scholar | |
|
Onwuegbuzie, A. J., Teddlie, C. (2003). A framework for analyzing data in mixed methods research. In Tashakkori, A., Teddlie, C. (Eds.), Handbook of mixed methods in social and behavioral research (pp. 351-383). Thousand Oaks, CA: Sage. Google Scholar | |
|
Opfer, V. D. (2001). Beyond self-interest: Educational interest groups and congressional influence. Educational Policy, 15(1), 135-152. Google Scholar | SAGE Journals | ISI | |
|
Ozga, J., Gewirtz, S. (1994). Sex, lies and audiotape: Interviewing the education policy elite. In Halpin, D., Troyna, B. (Eds.), Researching education policy: Ethical and methodological issues (pp. 121-135). London, England: Falmer Press. Google Scholar | |
|
Patton, M. Q. (2002). Qualitative research and evaluation methods (3rd ed.). Thousand Oaks, CA: Sage. Google Scholar | |
|
Prunty, J. J. (1985). Signposts for a critical educational policy analysis. Australian Journal of Education, 29, 133-140. Google Scholar | SAGE Journals | ISI | |
|
Rist, R. C. (2003). Influencing the policy process with qualitative research. In Denzin, N. K., Lincoln, Y. S. (Eds.), Collecting and interpreting qualitative materials (2nd ed., pp. 619-644). Thousand Oaks, CA: Sage. Google Scholar | |
|
Rizvi, F., Lingard, B. (2010). Globalizing education policy. London, England: Routledge. Google Scholar | |
|
Rogers, R., Malancharuvil-Berkes, E., Mosley, M., Hui, D., Joseph, G. O. G. (2005). Critical discourse analysis in education: A review of the literature. Review of Educational Research, 75, 365-416. Google Scholar | SAGE Journals | ISI | |
|
Sabatier, P. A. (2007). Theories of the policy process (2nd ed.). Boulder, CO: Westview Press. Google Scholar | |
|
Saldaña, J. (2009). The coding manual for qualitative researchers. Los Angeles, CA: Sage. Google Scholar | |
|
Sandelowski, M., Voils, C. I., Knafl, G. (2009). On quantitizing. Journal of Mixed Methods Research, 3(3), 208-222. Google Scholar | SAGE Journals | ISI | |
|
Song, M., Miskel, C. G. (2005). Who are the influentials? A cross-state social network analysis of the reading policy domain. Educational Administration Quarterly, 41(1), 7-48. Google Scholar | SAGE Journals | ISI | |
|
Stone, C. N. (2001). Powerful actors versus compelling actions. Educational Policy, 15, 153-167. Google Scholar | SAGE Journals | ISI | |
|
Tamir, E. (2009). Capital, power and the struggle over teacher certification. Educational Policy, 24, 465-499. Google Scholar | SAGE Journals | ISI | |
|
Tashakkori, A., Teddlie, C. (1998). Mixed methodology: Combining qualitative and quantitative approaches. Thousand Oaks, CA: Sage. Google Scholar | |
|
Taylor, S., Rizvi, F., Lingard, B., Henry, M. (1997). Educational policy and the politics of change. London, England: Routledge. Google Scholar | |
|
Teddlie, C., Yu, F. (2007). Mixed methods sampling: A typology with examples. Journal of Mixed Methods Research, 1(1), 77-100. Google Scholar | SAGE Journals | ISI | |
|
Weaver-Hightower, M. B. (2003). The “boy turn” in research on gender and education. Review of Educational Research, 73, 471-498. Google Scholar | SAGE Journals | ISI | |
|
Weaver-Hightower, M. B. (2006). Every good boy does fine: Policy ecology, masculinity politics, and the development and implementation of Australian policy on the education of boys, 2000-2005 (Unpublished doctoral dissertation). University of Wisconsin-Madison. Google Scholar | |
|
Weaver-Hightower, M. B. (2008a). An ecology metaphor for educational policy analysis: A call to complexity. Educational Researcher, 37, 153-167. Google Scholar | SAGE Journals | ISI | |
|
Weaver-Hightower, M. B. (2008b). The politics of policy in boys’ education: Getting boys “Right.” New York, NY: Palgrave Macmillan. Google Scholar | Crossref | |
|
Whittemore, R., Chase, S. K., Mandle, C. L. (2001). Validity in qualitative research. Qualitative Health Research, 11, 522-537. Google Scholar | SAGE Journals | ISI | |
|
Willinsky, J. (2001). The Strategic Education Research Program and the public value of research. Educational Researcher, 30(1), 5-14. Google Scholar | SAGE Journals | |
|
Wood, J. M. (2007). Understanding and computing Cohen’s kappa: A tutorial. WebPsychEmpiricist. Retrieved from http://wpe.info/vault/wood07/wood07ab.html Google Scholar | |
|
Woodside-Jiron, H. (2003). Critical policy analysis: Researching the roles of cultural models, power, and expertise in reading policy. Reading Research Quarterly, 38, 530-536. Google Scholar | Crossref | ISI | |
|
Woolley, C. M. (2009). Meeting the mixed methods challenge of integration in a sociological study of structure and agency. Journal of Mixed Methods Research, 3(1), 7-25. Google Scholar | SAGE Journals | ISI |

