Read Understanding Research Online
Authors: Marianne Franklin
Topics covered in this chapter:
We now turn to the role and specifics of analysis; an integral yet often under-discussed aspect of successfully completing a research project, let alone how this process operates within particular methodological traditions. Ways of going about gathering material and then analysing it are intimately connected. Yet the quality of final reports rated as above average often lies in the strength of the analysis sections; tables of survey results, chunks of interviews cited verbatim, focus-group transcripts, large quotes
from the thinker under investigation, or chapters of descriptive prose based on field-work observation are not sufficient in themselves. They all require an analytical dimension. Yet this is where many student projects can suffer from a lack of attention to this aspect; running out of time and ‘oomph’ playing a major role here.
The chapter has a dual aim: (1) to deal with a broader question that often goes begging for many students: what
is
‘analysis’? and (2) to unpack a cluster of methodological approaches in which analysis plays a key role. These relate to the data-gathering techniques covered in
Chapter 6
as well as departing from them. As analysis is a stage most of us encounter later on in a project, or we are confronted with the limits of our understanding and ability to make sense of more literature-based material as we write, the rest of this chapter looks at corollary issues that arise at this point. With generating or gathering ‘raw data’, the focus of the last chapter, we see in the discussion here that ways to approach and then ‘process’ material can produce different sorts of outcomes and accompanying claims of how these critique, or contribute to existing knowledge.
Issues raised here may catapult some readers back to the start; though by now you will be looking back from further down the research road, for better or worse. Others will notice here that they have reached another set of crossroads, where distinctions between analysing and presenting quantifiable and qualitative material require you to make another set of decisions. The power lies in knowing why you are making these choices and being able to deal with the consequences for what you can claim at the end of the day as well as the selections that come with writingup (
Chapter 8
).
After taking a look at the whole notion of analysis in terms of the larger research project, the second section gets back to practicalities: working with
texts
in various forms and related analytical ‘rules and procedures’. Here I take in turn three large areas of research approaches that are often presented in the literature and classroom as diametrically opposed to one another: content analysis, textual/visual analysis and discourse analysis. In the second instance, as these very categorizations are in themselves the object of some controversy, past and present, they tend to operate as markers of intra- and interdisciplinary pedigree. This in turn affects how the outcome of the research project gets presented in the final dissertation. In these cases, firmly on either side of the trenches so to speak, divisions are as deep within as they are between competing rules and procedures (tacit or codified) and their respective worldviews.
This practical section, a follow-on from those covered in
Chapter 6
, makes way for a discussion that is often dealt with early on in a project’s life-cycle. This is the way presumed and imagined differences between
deductive
and
inductive
modes of reasoning affect how we draw conclusions – or inferences. This returns us to interrelated differences about how research traditions regard the relationship between the observer (that’s me and you) and the ‘evidence’ (facts or fiction, depending on how you see these things). These two lines of reasoning are usually regarded as characterizing the difference in how quantitative and qualitative research ticks, one usually
positioned as inherently superior to the other. As philosophers and practitioners have been showing for some time, research working realities suggest otherwise. Because flexing our analytical muscles, so to speak, usually follows the collection – or selection – of the material under investigation, this discussion has been held back until now.
To ground these issues in practical research realities, this chapter draws to a close by breaking out in two directions: first the legacy of
behaviouralism
and its critics. Second, we consider some working distinctions between quantitative and qualitative sorts of data as these emerge during a research process and its outcome.
A lot of territory to cover, some of which will be passed over and all of which bears closer scrutiny. A further reading guide will provide some ways to get on with this. At this stage in the project, you will need to bear in mind the limits to what you have done, and what you hope to achieve with the time and resources (still) available to you, so some of the points may need to wait for another time. For others it may be the moment to pause and reconsider some fundamentals of this particular project; progress in this respect is not considered here as forward movement only along a straight road.
Now that you have a clear research question, have isolated what your object of inquiry (the ‘what’) is, done the lion’s share of data-gathering – whatever that entails – the next level is sifting and sorting all this material in order to make sense of it, to yourself but more importantly to shape it in some coherent way for public consumption. What you are entering is the
analysis
phase, a portal through which you pass in order to construct an argument and make it stick as you present your
findings
and draw conclusions about the inquiry. It is at this moment that many a research student often finds themselves leaving a supervision session or seminar presentation with the words ‘go analyse this’ ringing in their ears.
It is a truism as well that there is more than one way to analyse something; interpretation and analysis are synonyms in many respects (see Harding 1987, Ulin 1984, van Zoonen 1994). Moreover, different modes and
levels of analysis
can lead to distinct if not conflicting outcomes or conclusions based on the same evidence, along with the consequences when these interpretations are then translated into action.
Whatever term we may give it, this phase is when a researcher puts their stamp on the project, makes sense of their material in an original way, however understood. For some modes of research, analysis is synonymous with codified ‘rules and procedures’. For others it is tantamount to writing and reflection; the upshot being how effectively and convincingly you can convey the outcome of these reflections to the reader. At the end of the day, for the purposes of completing an academic dissertation, you are looking to make and sustain an argument in a written account of what you did, how, why, and with what sort of outcome.
Even when talking about modes of inquiry identified with
philosophical research
, the primary material referred to here comes in the form of ideas and meanings, usually in written, sometimes multimedia, and increasingly visual
texts
; from philosophical
treatises, to images, to sounds. In these scenarios a researcher engages with primary rather than secondary sources; getting to grips with the ideas of Simone de Beauvoir or Hannah Arendt in their own words, or investigating silent movies, is a different prospect from relying entirely on what others have to say.
1
Whilst all analyses make recourse to the ‘facts’, the strength of any analysis lies in its ability to combine (counter-)arguments, (counter-)evidence, and a persuasive narrative. For instance:
The question of what the purpose of analysis is in any particular research undertaking, let alone which – or whose – analysis counts in light of conflicting evidence or contentiousness over procedure, are questions that tend to go begging when students are working in mixed/hybrid or composite disciplinary settings. As Carol Smart notes, these days the work being done in many parts of academe is
well beyond the old empiricist idea that we simply capture ‘reality’, condense it, and represent it. We know that knowledge is always knowledge from somewhere, and that different research questions create different realities.
(Smart 2010: 6)
For those projects working with worldviews that would dispute this view (see Chapter
3
) the point still remains that analysis, even as the sum total of variable sorts of capturing, condensing, and representing said ‘reality’, is when the researcher
actively
provides some sense of coherence,
makes informed
and perhaps even inspired
decisions
about the value of any findings (including the means by which they were arrived at), and
sets up parameters
for presenting the material to be included, or excluded, either beforehand or in the course of writing. This is why analysis is more than listing, more than description, more than assertion, more than a compilation of everything a researcher has done, everything we have found out. Analysis entails:
What are the trade-offs, then? Researchers, students in particular, at this stage are often confronted with the realization, sometimes too late, that not matter how much material we have, or have not managed to gather, as ‘evidence’ it needs help in ‘speaking for itself’. This boils down to three sorts of trade-offs:
Before getting into particulars, the next section deals with approaches in which the ‘rules and procedures’ reside in modes of analysis rather than modes of gathering data.
3
In western academe, the large majority of material that is gathered, analysed and presented as scholarly knowledge in the humanities and social sciences takes the form of written texts, as already noted in
Chapter 4
. Even as industrialized societies have acquired significant dimensions of visual material with the advent of television, film, and increasingly image-laden computer interfaces in the age of the internet, written documents still provide researchers with primary data. Historians deal with archival documents, those looking to investigate policy study written communiqués, White Papers, and legislation as legal scholars dissect legal statutes. Meanwhile, cultural and social anthropologists, media and communications scholars, sociologists, and political scientists have been taking an interest in the ‘visual cultures’ that constitute how individuals and communities live and make sense of their world.
For these reasons alone, the term ‘text’ now denotes more than the written word; a photographic image, film, television programme, advertisement, or piece of music can also be regarded as a text. Their multiples also, such as an advertising campaign,
musical genre, set of images, novel. That no text emerges from nowhere, out of context, is a basic premise of those forms of analysis focusing on the way texts are produced, who produces them and under what conditions. These demarcations are further complicated when text (literal and otherwise) is accompanied by an interest in attitudes, behaviours, and even outcomes whereby the text/s are treated as causal agents. By the same token, much useful and indeed groundbreaking research has been carried out on texts treated as self-contained data, in which meaning/s are contained, intention and interpretation deducible from this content.
Paths diverge within this larger rubric. On the one hand researchers can treat texts (narrowly and broadly defined) as opaque or transparent. In both instances we see research designs where a body of material (written texts for instance, or advertising images) is treated forensically, being broken down into composite parts, examined, and then reconstituted with an increase in insight or new knowledge emerging. These two forks in the road proceed more or less as follows:
So where exactly does the divide, if indeed there is but a single one, lie? The main line in the sand for our purposes is, I would argue, between approaches that see
It sounds like a riddle but this distinction has been a fundamental source of friction, both productive and corrosive, in a number of classic and ongoing debates across the arts and humanities, and their counterparts in the social sciences.
In the spirit of pragmatism, the modus operandi here, I will deal with these two pathways and their respective twists and turns in turn, bearing in mind that, as always, these overviews focus on operating principles, practicalities, and wider methodological implications that can be executed as both multi-directional and one-way streets. Moreover, this is a terrain in which terms of reference are often particularly fudged or have different applications; where intellectual fashions come and go. It is also where the polemics of philosophical and interdisciplinary
methodological
grandstanding can hinder creative research, research into not just what people (and now their virtual personae) do or think but also what these activities and ideas produce – as cultural practices, art, media rituals, social institutions, power hierarchies, political regimes, economic exchange, bodies and even the human psyche.