SALLY FORT
  • Home
  • ABOUT
    • About Me
    • Right now...
    • Clients
    • Client Feedback
    • Contact
    • Privacy Policy
    • Fees
    • BLOG
  • IMPACT
    • What is Impact?
    • Impact Development
    • Evaluation
  • ENGAGEMENT
    • Heritage
    • Visual Arts
    • Education
    • Creative Industries
    • Culture, Education & Community Guidance
  • CHANGE
    • Research
    • Professional Development
    • Organisational Development
  • RESOURCES & DOWNLOADS
    • REPORTS
    • TOOLS & TEMPLATES >
      • Measuring & Managing Impact Quick Guide
      • Theory of Change Planning Template
      • Rose, Thorn & Bud Tool
    • TEACHER RESOURCE PACKS

6/10/2021

WHAT IS THE POINT OF EVALUATION?

0 Comments

Read Now
 
Picture
Nothing makes me happier as an evaluator than clients who use and share the evaluation to improve their work and the work of others. It's the direct opposite of sending your report off to trustees or funders and forgetting about it. So I was delighted to find out Leeds Dance Partnership (LDP) had done exactly that. I recently completed their impact and process evaluation for the first four official years of the partnership - a three quarters of a million pound initiative supported by Arts Council England's (ACE) Ambition for Excellence scheme.

It was a very complicated partnership, programme and evaluation. Partners had to be honest, not only identifying successes, but also looking at where not everything had gone to plan. We included it all. Participants, the local and national dance sector, the Leeds cultural decision makers, and regional freelance artists all inputted to ensure a really balanced and practical set of perspectives.
There was a lot to say about the achievements, pitfalls and learning along the way. And at the same time we wanted the report to be accessible, easy to find what different people needed.

As soon as the report was completed, LDP sent it off to ACE ahead of a follow-up meeting. I rarely expect funders to read evaluation reports, knowing how stretched everyone's workload is. So I was delighted to hear ACE had not only read the report but also fed back their appreciation that "the report was more thorough than we expected - very good, and we welcomed the SWOT which explored the flaws as well as stating the positives."
Those investing in your work really do want to see the learning process not just the good news stories (of course they want to see those too!).

I thought that was the end of the story, but no. I was even more pleased when I received a message out of the blue via LinkedIn from an Organisational Development Consultant now working with Leeds Dance Partnership who said the report had been shared with her and, "I found this such a helpful and insightful piece of work that I wanted to write to say thank you as it has enabled me to engage with LDP faster and in a more informed way than would otherwise have been the case."

LDP has also made the summary and full reports available for anyone via their website here or you can read it on screen / download directly from my own collection  here.  A variety of other examples of my evaluation reports are also available on the Example Reports page.

So - these are just a couple of examples of what the point of evaluation is. It's a way to reflect, learn and evolve. It's a way to pass the memory of what happened, what worked and what didn't on from one set of people to another, to save time, stop reinventing wheels, and make the most of the resources you have. There are other reasons to do evaluation, do it well, and put it to good use. But making it publicly available and actively sharing it are a couple that really make me feel the work has been worthwhile.

Share

0 Comments

22/7/2020

Understanding Impact

0 Comments

Read Now
 

What is Impact?

It's a word used frequently by organisations, academics, practitioners and others looking to prove their worth, but what does it actually mean?

There is no single definition, but at its most simple, it means the significant difference your activity makes.
​Examples might be long term difference to individuals, a big difference to the locality, an important change in regional or national policy that will have long lasting implications, the creation of new jobs, a reduction in poor mental health, a stronger visibility for hidden voices and communities, a stronger economy, or a culture change in another group or organisation.

​This might be expressed as
- social impact or social value
​- economic impact or return on investment
- academic or research impact 

Impact is not:
  • ​Small every day changes or differences. These are outcomes. Just as important, but different in scale
  • Monetary, or at least not always
  • Purely statistical. Impact can be measured, but numbers may not be impact, and statistics alone make no sense without the story of how they came about. Outputs are the numbers of things that happened as a result of your work (such as number of workshops, people involved, things created) but they don't show how things have changed.
  • ​Purely descriptive. Anecdotes, stories, observations and other descriptions alone need some form of measurement to prove that change has happened
  • ​Always positive. It's important to note that negative impact can happen too and this needs including in impact assessment
  • ​Easy to demonstrate. Or at least not without some knowledge of how to do so reliably
  • ​Easy to claim. Often impact happens as a combination of many other experiences and activities as well as yours. It's important to understand how much you can take credit for, or not.

Why is it important?

As well as being able to demonstrate the difference you've made as a result of the resource you have, understanding, evaluating and managing your impact will help you:
  • achieve the most you can
  • do it as well as you can
  • make your resources go as far as they can

Understanding impact also helps with morale and job satisfaction as it helps everyone involved to really see tangible results to their work, which is especially important to those who may spend more days at their desk and not seeing the real difference 'on the ground'.

By having a thorough understanding of what your impact is, what it takes to create it and how it relates to your organisational purpose, you are in a stronger position for making strategic and operational decisions. You will have a much stronger knowledge of what can be improved in your processes, vision and models; what could happen when things are changed; and what it would take to create deeper or broader impact.

As social investment grows as a means of revenue, being able to evaluate and manage your impact will become ever more vital, in order to return and / or grow the investments made.

It also enables you to show how you support the Social Value Act, which not only demonstrates an ethical commitment, but can bring a competitive edge when tendering for commissioned services that receive public funding.

In short, understanding, evaluating and managing impact strengthens your organisation.

Share

0 Comments

9/8/2019

Evaluation: What Do You Want and How Much Does it Cost?

0 Comments

Read Now
 
Picture
One of the most common questions I'm asked is: can you help us with our evaluation?
My response to that is always: very probably, what do you want and what are the parameters you're thinking of regarding timeframes and budget? And what is it exactly that you want or need?

Often, people don't exactly know. They know evaluation is a good thing, or at the very least that they should be doing / getting some. But sometimes that's all they know. So here are some things to consider when you want to commission some evaluation (or put it out for tender).
  • Typically, evaluation should take around 7% of the cost of your project - give or take. There's no real hard and fast rule but it's about that to get something worthwhile. You can spend more, you can spend less, and this partly depends on the size and duration of the activity.
  • Most medium - large cultural projects tend to cost between £5000 and £20,000 to evaluate. Smaller ones understandably cost a bit less - again depending on what you want. (A large agency will cost more than an individual consultant, partnership or small company - there are pros and cons either way. And specialists within the London area tend to cost more than those elsewhere).
  • You needn't actually spend 7% or £5-20k. But do think about it taking that much resource. Some of this you might want to allocate to in-house staff so the cost is absorbed back into your budgets. But it's helpful to think of the monetary value to make sure it's properly allocated and planned in and given the value internally that it needs to be done well.
  • What are you buying - is it capacity or expertise? If it's capacity you might want to outsource the whole thing. So you need to allocate a bigger budget.
  • If it's expertise, an external specialist can guide and mentor someone in the organisation. Your specialist might help set up a framework, templates and methodologies; or they could run some internal training. And then let the team run with it. They might step back in to analyse the data and write your final report. So you can do more with less money wise.
  • Discuss costs together. If a specialist hasn't quite 'got' what you're asking for, tell them. They will be happy to adapt their suggestion. Most will give you two or three options with a breakdown of costs to help you focus on what you really do or don't want.
  • If you do know exactly what you have available to spend, tell them and ask them to advise you on how it can be best spent to get what you most need.
Two last pieces of advice:
Firstly - if the evaluation is because an external funder expects / requires it, please do be prepared to let an evaluator see your application. They will treat it confidentially, but it is a very quick way for them to give you guidance on exactly what will work best for you. A good specialist won't be pushing a big sale, but they can help you decide which options are going to be best.
Secondly - no matter how much you decide to outsource or not, an evaluator cannot do everything for you. You need a good, consistent, honest working relationship to get the best results possible. The more you put in and own it, the better the relationship and the results will be. Ideally it works as a partnership.

All of this shows how I try and work with organisations wanting evaluation. This is what you can expect from me. You can also just say: "We have £x. We'd like X. Could you do that for us?"

Share

0 Comments

18/2/2016

Local History on Your Doorstep: Educators toolkit

0 Comments

Read Now
 

Local History, Culture on Your Doorstep

In summer I researched and wrote a new resource for history and heritage educators on behalf of Curious Minds. Drawing together examples from across the North West, covering an array of indoor and outdoor museum and heritage locations, it explores how schools and heritage organisations have worked together to help young people learn about their local history in cross-curricular ways. It's particularly relevant to the Key Stage 2 curricula but extends to KS1 and KS3 too. Browse or download above, or from my resources page.
​
Each case study includes
- Description of a topic or activity
- Objectives and outcomes of the activity
- Practical activity suggestions to include in topics / lesson plans
- Top tips for planning and practicalities
- Links to further resources

Includes five example case studies of projects by schools and museum or heritage sites working together cover these overarching themes:
- Investigating a heritage site (through the ages and a timeline)
- Investigating a local street (in this instance Victorian but transferable to other periods)
- Investigating a historical period (Stone, Bronze and Iron ages)
- Creative engagement with maths (using the art / design of Blackpool Illuminations to cover the full KS1 & 2 maths curriculum)
- Exploring the local town (in this instance a coastal town with a migratory mining history)

Current History links
- the lives of significant individuals in the past who have contributed to national and international achievements
- significant historical events, people and places in their own locality
- changes in Britain from the Stone Age to the Iron Age
- a study of an aspect or theme in British history that extends pupils’ chronological knowledge beyond 1066
- ideas, political power, industry and empire: Britain, 1745-1901

​With a foreward from Prof. Kerri Facer - education innovator and advocate for place-based curricula.

Share

0 Comments

15/1/2016

Ten Top Tips for Evaluation

0 Comments

Read Now
 
Photo of a paper tag hanging from a small metal tree. The tag shows a Victorian illustration of a monkey. Under the monkey someone has written two words to describe the museum, which say fantastic and upbeat.
Creative consultation / visitor research activity: The Whitaker Museum & Art Gallery 2015
A few years back, I worked on a three year contract supporting organisational change in a group of universities who were starting to come to terms with a then brand new agenda, where academics and researchers needed to become more outwards facing, connecting with the public on their doorstep and at large. Part of my role was to mentor internal directors and project managers, and the departments they worked with, in looking for the impact of their activities. Like many major programmes, the initiative had a quite intense, technical, formal, robust evaluation system underpinning it. Like many organisations, this was not the fun part of anyone's work, and on top of everything else going on, was not generally what most people were interested in prioritising. In my mentoring role, I wanted to increase people's confidence about being able to carry out evaluation that was realistic and meaningful, and reduce their fear of becoming overwhelmed. At the same time, some of the community groups involved had been saying their previous experiences of evaluation in university programmes had, at times, been overwhelming, invasive, and one-sided.
​As a result, I created a simple, practical, set of suggestions to make evaluation do-able, useful, positive and meaningful. It simply offered these ten top tips, and five years later with the huge amount of learning I've developed about evaluation, they still absolutely stand the test of time...
  1. Be Selective: stay focused – keep your aims and objectives in mind. Don’t try and capture everything about everything. 
  2. Impact: always aim to answer these questions: What happened that wouldn’t otherwise have happened? What difference did it make – to us and to our participants, partners or colleagues? What did we learn from this? What do we intend to do next?
  3. Achievability: think about what’s realistic and achievable with the resources you have, this may mean you select only one thing to explore in depth, and a few other areas to cover briefly. 
  4. Breadth and depth: include quantitative and qualitative information. Quantitative methods lead to facts and figures; qualitative methods capture experiences and personal impacts. 
  5. Varied questioning: use open and closed questions. Closed questions allow you to create statistics to show particular patterns of what’s happening. Open questions mean people can say what’s really important to them. 
  6. Bespoke and appropriate: every project or event is unique. Create methods that work for you and your partners/participants.  Think about what will make it easy for people to complete any evaluation requests and, where appropriate, make it fun and integrate it into the main activity of your work. 
  7. Combined approaches: where possible combine a range of evaluation methods and techniques. This will allow you to cross-reference your findings to develop a clearer understanding of what is happening. 
  8. People-centred: Remember to explain to participants why you are collecting the information and be mindful of protecting private information. 
  9. Analysis: analyse the information you have.  Statistics and conclusions are just the start, keep going until you know why is that important? What does it show or prove?  
  10. Applying the understanding: use your evaluation. Tell people what you found out and the lessons you have learned. Consider how it will inform future plans and strategies going forward.  Reflect on how you might do things differently next time.

Share

0 Comments

5/1/2016

Autism in Museums

0 Comments

Read Now
 
Photo from the museums and autism blog showing around 100 bobbins, all different colours and sorted into colour order from deep blue to bright pink. The bobbis are standing upright on their ends, except for one which tilts at a wonky angle.
The museums and autism blog header image: A rainbow of bobbins at Queen Street Mill Textiles Museum.
The Kids in Museums campaign logo showing a cartoon illustration of a wooly mammoth on a museum plinth, surrounded by curious looking museum visitors of all ages and abilities.
I'm delighted to be chairing Kids in Museums new workshop 'Welcoming Families with Autism' at the Science Museum on February 9th. It's a day packed with experts from museums and arts organisations who can share their experiences of welcoming families with children or young people on the autism spectrum. You can book for the event here or keep an eye on future workshops here

It's a subject I've been interested in for many years and have blogged about previously, though my interest has ramped up several gears over the past 12 months thanks to my involvement with two local autism charities, and my work with Lancashire Museums who commissioned me to research the subject of museums and autism from the perspectives of museums and autistic visitors. You can read more about that on my separate, ongoing blog http://www.museumsandautism.tumblr.com/ which combines museum practice, feedback from families and visitors on the autistic spectrum, and expert reports and presentations on the subject.

Share

0 Comments

23/10/2015

Free Downloadable resource - Children & Young People's Arts Participation in Practice: For Rural and Other Areas

0 Comments

Read Now
 
Last winter I was asked to create a series of case studies and good practice guidance for arts related work with children and young people in rural areas. This was part of a bigger piece of work for Arts Connect as they began their journey to support the creation of a consortium for arts and cultural organisations across Shropshire.

Shropshire Arts Consortium was formally launched this week with much ground covered already in the past few months and a lively energy to carry on building opportunities for children and young people in the area moving forward. A website for their work is on its way and in the meantime you can follow them on the #ShropConsortium hashtag.

Many people were interested in the case studies and research I carried out, and Arts Connect have kindly agreed to share it as widely as possible. ​​

The resource created from this research contains
  • Introduction to the depth / breadth of opportunities for engaging children and young people
  • 14 case studies across a variety of art forms and models of practice, with images and a breakdown of transferable learning from each example other organisations could pick out and adopt / adapt in their own context
  • 5 practical guiding principles for working with children and young people​​​​ particularly (though not exclusively) in rural areas

Feel free to read or download the resource below...

Children & Young People's Arts Participation in Practice: For Rural and Other Areas by sallyent

Share

0 Comments

7/4/2015

Lightworks: the heritage of Blackpool Illuminations

0 Comments

Read Now
 
Picture
I am so very lucky to be able to get involved with such a wide variety of projects. In each one I love to find out about new collections, artworks, exhibits, activities and the people behind them or indeed at the receiving end.

Right now I'm writing a resource pack for Curious Minds which looks at how local heritage can be used to work with schools towards an area based curriculum. The resource will include several case studies, one of which features Blackpool Illuminations.
It's little known that the Illuminations have a historic archive, or that they are all designed and made in Blackpool itself, at a design and manufacture depot called Lightworks.

You might like to read this excellent page about where the magic happens. Many images from the archive of illuminations artwork and some accompanying catalogue detail is available at the Illuminations blog right here. On occassion, Lightworks opens up for tours for special events and groups such as Heritage Open Days. A potted history of the illuminations is provided here.
Further information is available here.

Meanwhile, the Curious Minds resource, and another teaching resource produced by cultural team members of Blackpool council offering many ways to use the illuminations to support maths based learning - developed in close consultation with teachers, will all be available online to download as a pdf in due course.

Image: Up for Promotion, copyright Blackpool Illuminations Collection

Share

0 Comments

10/12/2014

Arts & Culture for Children and Young People in Rural Areas

0 Comments

Read Now
 
Picture
Do you have experience of working with children and young people in rural areas through arts / culture / media? I'm currently doing a small piece of research for a rural consortium who are at the start of creating a county-wide strategic approach.

I'd like to provide the group with some core principles to inform the way they think about their work and some good case studies / examples of relevant activity to help them reflect and be inspired.

Can you add some tips / advice based on your own experience and / or do you know of some relevant programmes, projects, policies, initiatives etc? 
If you could answer any of the 4 quick questions here, please do - let's hear about your experiences and top tips, thank you so much. (Survey closes 31st Dec 2014)

http://bit.ly/ruralCYP



Share

0 Comments

5/12/2014

Museums and Autism

4 Comments

Read Now
 
sallyfort.com autism and museums recommendations
The relationship between museums and autism first began to percolate in my mind a few years ago and slowly I've been piecing together more and more learning and thinking. It's been accelerated lately for a number of reasons, each of which has some really useful learning for the museums (and wider cultural) landscape. In no particular order, they are presented below - take whatever learning and inspiration you can from it, and apply it in some way to your own work or thinking. Change is made one step at a time...

1.  "If you've met one person with autism, you've met one person with autism"
People who have autism each have their own version of it. Many such people share some of the characteristics, but one person's experience of autism could be almost unrecognisable to another. (Great blog post here if you're interested in more on that theme).

2. We're slow on the uptake.
Cinemas have been programming autism friendly events for a few years now. Museums can a learn a lot here from their cultural counterparts. You could look up pretty much any cinema and find an autism friendly events listing. Try it. Why should museums be different? It's hard to try and assemble a single approach to becoming more autism friendly precisely because every person with autism has their own individual version of it. Whilst a good starting point is find out what you can, and do what you can with what you have (and read point 3 below), the cinema approach has taken a few core approaches: 
- lower lighting levels when lights are up [to help people with extra sensitivity to bright light]
- lower volume levels [for people with extra sensitivity to sound / reverberations]
- trailers are removed from the show [reducing the time needed to be in a different environment or the time needed to focus]
- taking own food / drinks is encouraged [special dietary needs are common with autism]
- moving round the cinema is fine whilst the film is showing [because sitting still and / or quiet for long periods is a challenge for some people with autism].

Simple adaptations, no cost involved.

3. We have an excellent champion working from the inside out.
She won't thank me for cheerleading her work because she's a modest and unassuming sort of person, but over on Twitter you can follow Tincture of Museum, 'Volunteer at Museum of London, Horniman Museum and Bromley Museum; blogger; mum; advocate of autism in museums'. She's a gentle and hugely effective campaigner and writes very insightfully on this subject. Maybe start with this post from her blog.

4. Collectively, the museum profession is onto a good thing.
There was a great question about how to successfully, sensitively and appropriately include some particular children with autism and other conditions posted on the Group for Education in Museums email list and some brilliant insight collated and shared back around by Dr Trudie Cole, Learning and Access Manager at Poole Museum Service. You'll find it all in the document at the bottom of this post. What an incredible body of knowledge and experience museum professionals have on this subject - pretty powerful when you put it all together.
Likewise, the Science Museum have their Early Birds programme offering more quiet access for children with autism (both in terms of noise and visitor hustle and bustle); Manchester Art Gallery trialled their Open Doors programme for families with children on the autistic spectrum; and  the RAF Museum have recently become the UK's first cultural venue to receive The Autism Access Award from the National Autistic Society. More here and here.
There are more plans afoot and more conversations being had within the museum sector to push awareness and understanding up a gear. I'm sure this will soon become a big thing for our profession.

5. You can't necessarily spot museum staff (or people in general) with autism, and it's hard to put in an employment policy.
This is a strange one that came about when I saw a post on twitter asking if anyone knew of any museums who employed people with autism.
It would be unethical and illegal (in the UK at least) for an organisation like a museum to give any personal information out about any of their employees.
And then there are further complications which would make it difficult even if technically, they could, but I think it's worth talking about these with the intention of building more understanding about the nature of having and working with autism...
   On the one hand I think you'd be hard pushed to find a museum of a decent size that didn't employ someone with autism (statistically autism is currently thought to occur in between 1 in 100, and 1 in 80 people in the UK, depending on which reports you read); and many facets of museum work would naturally attract certain skills and characteristics known to be part of the autistic spectrum.
   On the other, who would know? Autism is invisible.
There are a range of associated conditions that can accompany autism which have physical manifestations but autism itself exists and plays out within the brain first and foremost. This leads to complications about identifying employees with autism since
   a) a person may not know they have it - it may never have occurred to someone that they may have it, and diagnosis levels in adults (particularly women) in the UK are low for various reasons
  b) a person may have self-diagnosed, but have no professional confirmation - so do they have it or not?
  c) if they know they have it, they may or may not have chosen to let their employer (or anyone else) know
  d) even if a museum were to have an actual pro-autism or targeted disability employment policy, see a, b and c above
So, if for some reason you're interested in finding people with autism who work in museums, try and find the people, rather than the museums.

6. More here
And finally - there is a long list of autism friendly work by museums around the world here (listed by Autism Speaks, though this is not an endorsement of that organisation. If you discover a list hosted elsewhere leave a comment, I would be happy to refer elsewhere instead when possible).

... thanks to Trudie Cole and Claire Madge for their help with putting this blog post together...

gem_list_collective_responses.docx
File Size: 28 kb
File Type: docx
Download File

Share

4 Comments
<<Previous
Details

    ...Blog

    I'm most interested in how the public, your public, whoever that may be, engages with culture and creativity.  

    And if it nurtures creativity and develops personal, social or professional skills  I'm absolutely all ears.
    View my profile on LinkedIn

    To subscribe by email, enter your email address:

    RSS Feed

    Categories

    All
    Access
    Art
    Arts
    Artsmark
    Autism
    Children
    Citizenship
    Communities
    Conferences
    Consultation
    Craft
    Creative Industries
    Creativity
    Culture
    Dance
    Digital
    Early Years
    Education
    Evaluation
    Events
    Families
    Festivals
    Freelancing
    Funding
    Galleries
    Heritage
    Impact
    Interpretation
    Lancashire
    Learning
    Leeds
    Manchester
    Monitoring
    MOSI
    Museums
    Opportunities
    Outdoors
    Partnership
    Play
    Presentations
    Public Art
    Public Engagement
    Recommendations
    Reports
    Research
    Resources
    Rural
    Schools
    Science
    Social Value
    Training
    Universities
    Videos
    Writing
    Young People

    Archives

    October 2021
    July 2020
    August 2019
    February 2016
    January 2016
    October 2015
    April 2015
    December 2014
    October 2014
    September 2014
    August 2014
    July 2014
    June 2014
    May 2012
    September 2011
    May 2011
    April 2011
    March 2011
    November 2010
    October 2010
    September 2010
    August 2010
    July 2010
    June 2010
    May 2010
    April 2010
    March 2010
    February 2010
    January 2010
    December 2009
    November 2009
    October 2009
    September 2009
    April 2009

CONTACT
  • Home
  • ABOUT
    • About Me
    • Right now...
    • Clients
    • Client Feedback
    • Contact
    • Privacy Policy
    • Fees
    • BLOG
  • IMPACT
    • What is Impact?
    • Impact Development
    • Evaluation
  • ENGAGEMENT
    • Heritage
    • Visual Arts
    • Education
    • Creative Industries
    • Culture, Education & Community Guidance
  • CHANGE
    • Research
    • Professional Development
    • Organisational Development
  • RESOURCES & DOWNLOADS
    • REPORTS
    • TOOLS & TEMPLATES >
      • Measuring & Managing Impact Quick Guide
      • Theory of Change Planning Template
      • Rose, Thorn & Bud Tool
    • TEACHER RESOURCE PACKS