Analysis
Understanding of the case study is cumulative, developed through combinations of activities and repeated examination of the resulting material.
Analysis will be on-going, with themes identified throughout the research process, but a specific process of review and interpretation of the materials is normally required once other activities have been completed.
Analysis is not purely based on taking people’s comments and behaviours as stated. The interpretation goes beyond the assessment material to contextualise the findings according to wider social theories and research on the phenomena being observed.
- The research notes were typed up and any transcription or reflections were completed, providing an initial refamiliarizing with the content.
- Materials were loaded into a database (Nvivo).
- A thematic framework was developed throughout the research process based on the type of assessment being undertaken (i.e. identification of social values), the specific case context and reading of literature on comparable cases and social phenomena.
- All the material was coded, which required a further close reading of the material.
- In assessments of this size, there was no real difference between using a database and the manual thematic analysis (which was used in one study). However, it was easier to quickly retrieve and cross-check material once it was in the database and in a larger study this might be a more significant consideration.
- Involving a multi-disciplinary team is helpful in identifying themes and applicable comparative cases.
- Analysis was on-going throughout the process but also benefitted from hindsight and time to look in depth across the material generated by the study.
Braun, V., and V. Clarke. 2006. “Using thematic analysis in psychology.” Qualitative Research in Psychology 3 (2): 77-101. https://doi.org/10.1191/1478088706qp063oa
Research material
Each method has the potential to generate a large amount of material and it is not always readily apparent in the moment which details will prove most useful when it comes to analysis and interpretation.
- Returning to the material over time and in the light of other activities can bring deeper understanding.
- Avoid being highly selective early on, as this can limit the scope for future interpretation.
The type of material can make a difference to the analysis, with audio recordings and materials such as photos or handwritten notes connecting more readily to memories of the activity and situation.
- When an audio recorder was used during interviews and transect walks, the sounds of the weather or other activities in the background of the recordings brought to mind details that were not easily captured in the written notes.
- Listening to the discussions was useful in reconnecting with the activity and individual respondent, especially in an extended study where many months may have passed since the original interaction. Similarly, photographs of the site served as prompts and reminders of particular details.
To ensure participant confidentiality, material must be stored securely and separately from any identifying documents such as consent forms.
Writing
Writing is itself a process of analysis and knowledge creation from which new insights can emerge. Choices are also being made when writing up the assessment as to what and how the interpretations are presented.
The presentation of the findings or report formats will depend on the activities that have taken place and material available, the nature of the collaboration or engagement, as well as the intended audience or use to which the assessment will principally be applied (at least in its initial iteration). The time taken will vary depending on the process and presentation format(s) being used.
Options for presenting material and interpretation
Composite maps: Presenting the results from multiple mapping activities as a composite or layered map, where diverse responses are made visible simultaneously, can be useful in highlighting the range of values associated with a site and overlapping points of interest. A composite map can help illustrate the range of practices associated with a place and identify locations that are focal points for one or more groups.
Reporting formats: The site reports in the Case Studies sections provide one example of a management style report. Formally recognised historic environments will have a Statement of Significance or similar that describes all the types of value ascribed to the site, to which assessments can contribute. Contemporary use values, including social value, tend to feature at the end of such documents. You could consider an alternative ordering of the format, to commence with the significance to contemporary communities.
Biographies: A chronological approach that positions a site within changing contexts and fields of relations can help show how it can touch simultaneously on the heritages of different communities and carry multiple (and at times contradictory) values for those groups. This may be particularly appropriate in a situation where new historical or archaeological information has come to light during the assessment period, but is not limited to those contexts.
Report writing depended on reflections and notes that were written throughout the studies, as well as the process of analysis.
- The first element drafted was the Social Values Statement, which is annexed in full to the report. Development of the Social Value Statement depended not only on the case study material but also wider reading and other studies (as in the analysis). These ‘Comparators and References’ were summarised in a separate annex.
- The Social Values Statement informed the findings and implications sections of the report.
- The background and communities sections were drafted based on the site scoping completed in advance and understandings of the context that emerged during the study, with reference to documentary sources.
- A brief summary of the research process and scope of participation was provided (an anonymised list of contributors was provided as an annex).
- An important factor for the application of the findings was to reflect on the gaps or limitations and where further research may be needed.
- An executive summary was prepared with the key findings.
- Draft reports were shared with participants and interpretations were discussed before finalising.
Written reports were produced in all cases. An info-graphic style poster was developed in the Cables Wynd House study, as an alternative, accessible means of sharing the draft findings, following the repeated research presence in communal areas.
- The greatest engagement was with the written reports, perhaps because of their formality and perceived ‘officialness’.
- The responses to the written reports, were useful in confirming the findings but also interesting in understanding the participants’ relationships with formal heritage processes and how they viewed the research. Although the reports were not advocating particular policy positions, they were nonetheless seen as useful or influential in advancing these agendas by some participants.
- As with analysis, report preparation also benefitted from a multi-disciplinary team. Careful consideration is needed of language and use of terms that may carry implied meaning.