Posts

Offender/Offender Manager Relationships - image of paper people holding hands

Positive Relationships in Offender Management

We are delighted to welcome Prof Darrick Jolliffe, Professor of Criminology at the University of Greenwich as a guest blogger. Prof Jolliffe has worked with GtD on our offender management work and here he discusses the role of relationships in that work.

Positive relationships have the power to change us. This is not just the catchy slogan of the International Coaching Federation, but something that resonates with all of us.  The constructive relationships that we have, or have had with our parents, teachers, friends and colleagues not only define our interactions with them, but our interactions with all others, while defining who we see ourselves to be. Translating this ‘common sense fact’ into the management of those who have committed offences has an extensive history, and some would argue is the bedrock on which the probation service was founded. However, like many things that are common sense, such as we only use 10% of our brains, and carrots provide good eyesight, the suggestion that if ‘offenders’ have a positive relationship with those providing their supervision they will have more positive outcomes, the actual relationship might actually be a bit more complicated. 

I was invited by Get the Data Director Jack Catell to speak their event, Transforming Rehabilitation – Learning from the PbR results, about my experience of attempting to capture the evidence that positive relationships between offenders and offender managers results in definable benefits. This was something that I first worked on over a decade ago, having first been commissioned by the Home Office to develop an Offender Management Feedback Questionnaire, which was a series of questions that asked offenders about their engagement with their named offender manager. I was subsequently commissioned to work on revised versions, and also helped develop a mirror version which asked about how offender managers viewed the relationship that offenders had with probation.

Some findings fit with expectation, for example, female offenders consistently had more positive relationships with offender managers than males, and the longer that an offender had spent on probation the more they felt they had developed positive relationships and acquired useful skills.  However, some findings were very far from expected, for example, those who reported greater engagement with probation were not less likely to reoffend, and even more concerning, or at least confusing, those who reported greater acquisition of skills while on probation were significantly more likely to reoffend.

How do we reconcile these findings with what we know about the power of positive relationships?  Well, I don’t think there is an easy answer here.  I suspect that positive relationships with offender managers are important for offenders, but they may not be important enough to have an impact on a blunt measure such as reoffending over and above the other issues that many of these people are facing in their lives.  We put the finding, that those who reported greater acquisition of skills were more likely to reoffend, down to offender’s overly optimistic view of how easy it would be to continue to stay crime free.  When we looked more closely at the scores of the questionnaires, it was the items which referred specifically to acquiring skills which would reduce later reoffending that those who reoffended tended to endorse more strongly – almost as though they were trying to convince themselves of their ability to stay on the straight and narrow.

Reflecting back on this work, I am really proud of what we did achieve, despite not getting the common sense result we all expected.  I think there would be a lot of mileage in revisiting the offender/offender manager relationship as a potential desistence tool, and if I was going to do this again I would be looking to measure changes in relationships (so administering items more than once) and see how these changes might relate to more short-term outcomes (e.g., offender’s motivation), as well as longer-term outcomes (e.g., reconviction). 

Tape measure

The Data Revolution Will be Measured

“Innovation distinguishes between a leader and follower”, so said the late Steve Jobs. His words came to mind as I prepared to present to Gideon’s Promise’s Summer Session last month.  Gideon’s Promise asserts that a revolution is needed in how the criminal justice system treats indigent defendants. And as befits an organization that sees itself in the vanguard of that revolution, Gideon’s Promise has a radical vision of the impact of its work. For them it is less about increased efficiencies in case management or the effectiveness of sentencing. Rather it is about changing how the criminal justice system and society-at-large regard poor people caught up in the system’s net. To bring this about, Gideon’s Promise provides a community of public defenders who put their clients at the center of their practice. In doing so, they insure their clients’ stories are told and their humanity is revealed to the court. Or in the words of one member of the movement, “we need to think of this person as a human being and not simply a number in an orange jump suit”.

So how to measure a revolution? Over the past 18-months Gideon’s Promise has led an expert collaboration that has included Get the Data and another Atlanta-based organization, Techbridge. Together we have delivered a ground-breaking program of work that has produced innovative measures of both the public defenders’ values and their clients’ experiences of the client-centered approach. In developing those measures, GtD grounded our work on understanding the impacts that Gideon’s Promise strives to achieve and the resources at its disposal. Having articulated this theory of change, we were able to design the appropriate measurement instruments and subject them to cognitive, reliability and validity testing with samples of Gideon-trained public defenders and their clients. The next step was to collaborate with Techbridge to deliver a technological solution that will allow the instruments to be completed on-line and held in a database. This technology will be essential as the measurement work is rolled out across Gideon-affiliated offices. Finally, we designed a “Digital Dashboard” that Techbridge attached to the database and to report data by offices, public defenders and their clients.

“Innovative” is a word that can be overused or cliched, but in this case the program of work undertaken by the collaboration has truly been new and refreshing. Moreover, it provides the means by which Gideon’s Promise can measure its bold and revolutionary vision. The next steps will be to roll-out this program of work and then move to designing measures of the impact on the criminal justice system and ultimately society as a whole.

The revolution is coming, and the revolution will be measured.

Make Social Impact Your Goal! - GtD and Street Soccer Academy

Make Social Impact Your Goal!

I am delighted to be working again with Street Soccer Academy (SSA) to put evidence of their social impact at the heart of their work with ex-offenders. This important work has been made possible by a grant from the Access Impact Foundation whose mission is to make charities and social enterprises more financially resilient and self-reliant, so that they can sustain or increase their impact. Without the generous funding from the Access Impact Foundation we would not able to provide Street Soccer Academy with our powerful data analysis.

Street Soccer Academy is a great client to work with. They use professionally organised sports-based programmes in the rehabilitation and reintegration of people from some of the nation’s hardest to reach groups, including ex-offenders. Our task is to prove that SSA’s pro-social models are affecting the attitudes and thinking of the men and women with whom they work, with particular emphasis on their relationships and roles in society.

In the coming months we will be using our rigorous social impact analytics to contribute to the knowledge of what makes ex-offenders desist from crime. Our previous evaluation of the academy’s prison to community service, produced evidence of SSA’s excellent engagement of ex-offenders into their programme. With the foundation’s funding we will build on that by using our advanced statistical analysis to identify who benefits from the programme, how and in what circumstances. These analyses will assist the academy to identify the most effective practice and allow it to develop its professional programmes. To ensure that it has the right information at the right time we will be building a dashboard to communicate this data to those delivering the programme, their managers and the funder.

Not only will this improve their practice, but it has important implications for government’s Transforming Rehabilitation agenda. That agenda depends on organisations like SSA being commissioned to deliver services through the private community rehabilitation companies. However, the participation of such organisations has been low as they struggle to demonstrate their impact on reoffending pathways and desistance from crime. Access Impact is helping to overcome those obstacles and by funding our work, will enable SSA to attract further funding and make the systemic changes that are essential to support men and women to desist from crime.

To find out more about our analytics services and how we can help your organisation demonstrate your impact definitively, contact us on 020 3371 8950 or email jack.cattell@getthedata.co.uk

GtD Transforming Rehabilitation Event

Transforming Rehabilitation: Learning from the PbR results

Transforming Rehabilitation challenged Community Rehabilitation Companies (CRCs) to reduce reoffending significantly and October will see the publication of the reoffending rates of the first Transforming Rehabilitation cohort.

These results are an important test of the government’s Transforming Rehabilitation agenda and the success of the new CRCs. Some CRCs will be happy with their results, while others will need to improve. The published results also provide opportunities to commission new services for offenders.

Besides the implications for policy and practice, the results also present an opportunity for your organisation to learn how best to reduce reoffending with the tools at your disposal. You might want to increase a CRC’s performance, identify “what works?” and roll that out across all your CRCs, or prove that your specific service will make the difference.

Come join our experts at our TR PbR event, to discuss what needs to be learnt, what is within your control, and how embedding impact analytics in your CRC or service delivery organisation will help you to reduce reoffending.

Transforming Rehabilitation: Learning from the PbR results

Tuesday 28th November

2 – 4.30 pm

The Space Centre

94 Judd St, Kings Cross, London WC1H 9NT

SPEAKERS:

Professor Darrick Joliffe, University of Greenwich

“How to measure the quality of relationships between offenders and probation officers.”

Darrick is Professor of Criminology at the University of Greenwich. Darrick is interested in the broad areas of developmental life-course criminology, programme evaluation, prison research and psychology, individual differences and offending. He has developed tools to measure the satisfaction of offenders and the quality of their relationships with probation officers, and has estimated the association between relationship quality and reoffending. Darrick will also chair a discussion after the presentations.

 

Dr Sam King, University of Leicester

“What is high quality offender management?”

Sam is an expert on offender management and rehabilitation, and has contributed significantly to developments in desistence theory. His talk will discuss the latest evidence on what makes high quality offender management and what can be implemented to reduce reoffending. Sam has published widely on probation work and desistence theory, and has helped CRCs to implement innovative offender management tools to measure offender motivation.

 

Jack Cattell, Get the Data

“Predict your PbR results and continuously learn how to improve them before they happen.”

Jack is an expert on the prediction of reoffending rates, and the analysis of how a probation service can audit and improve its reoffending rate. He has worked for the Ministry of Justice, former probation trusts and Sodexo Justice Service’s six CRCs on research and analysis projects. He heads up GtD’s thought leadership on the use of predictive analysis to improve adult and youth offender management.

Free event – register today! Places are limited.

 

Headed by Jack Cattell, Get the Data is located in the UK and USA. We are an international thought leader on how to reduce reoffending through high quality analyses of offender management data. We have delivered high-profile projects for the Ministry of Justice, HMPPS (formally NOMS), and the police. We are proud to provide our Social Impact Analytics service to Sodexo Justice Service’s six CRCs.

 

Delivering Innovative Social Impact Analytics to Sodexo Justice

We are delighted to announce a new contract to deliver our ground breaking social impact analytics to Sodexo Justice, a leading provider of justice services in the UK.

The purpose of our social impact analytics is to provide definitive evidence of an organisation’s impact on society by delivering predictive analyses and impact evaluation.  Under the newly signed contract, we will measure the effectiveness of Sodexo’s six Community Rehabilitation Companies in managing the risk associated with the offenders and delivering interventions that reduce their reoffending.

By understanding “what works?” in changing lives and delivering safer communities, our social impact analytics will also be used by Sodexo Justice to measure the impact of its services.  Sodexo Justice will be paid through a payment by results mechanism that measures its success in reducing reoffending.

Our founding director, Jack Cattell said, “We very much look forward to providing our social impact analytics to Sodexo Justice Services.  Our SIAs will provide offender managers with the information they require to manage resources and deliver high quality interventions to reduce reoffending.”

Evaluation for accountability courts

Building on Success: Evaluation for Accountability Courts

Across the U.S. Accountability Courts are proving effective in reducing substance misuse and lowering recidivism. Once again, our home state of Georgia is in the vanguard of reform. Next week, GtD will be attending the annual conference of the Council of Accountability Court Judges of Georgia to show how evaluation can be used to build on these successes.   

Accountability courts provide interventions that address the mental health, substance misuse and other health issues that can be associated with an individual’s criminal behaviour. Designed to keep nonviolent offenders out of prison, those who are eligible will agree to completing a plan of action that includes counselling, support and regular drug testing by the court. While sanctions are imposed for those who violate a rule of the program or relapse, the court will be the forum for recognizing and congratulating an individual’s progress.

Once again Georgia is in the vanguard of criminal justice reform. Of the estimated 2,500 accountability courts in the U.S., 93 of them are in Georgia.  With the mounting evidence that they are successful in reducing substance misuse and lowering recidivism, there is also a good economic case to promote accountability courts over the use of jail. But if the evidence is there, what is the role of evaluation?  To answer this question GtD will be attending the annual conference of the Council of Accountability Courts of Georgia.

Building on Success

Although accountability courts can be successful, more can be done to improve, replicate and sustain this innovative approach. So, whether a new accountability court is being set up, an existing program is being extended or a funder needs evidence of impact, then GtD’s social impact analytics can provide definitive data to assist courts measure, learn and prove their impact.

Measuring

If a court is implementing a new program, GtD’s Impact Measurement Service will determine its intended impacts, how to measure them and identify what resources will be required. In providing this service we will collect data and report analyses that will be relevant to judges, court managers and practitioners.

Learning

GtD’s social impact analytics can help accountability courts improve their existing programs. Our Predictive Analysis service will help practitioners identify what is working best for offenders, and will provide information for managers to re-define high-quality interventions and deliver a more effective program.

Proving

Ultimately, accountability courts will want to prove their impact. Our rigorous Impact Evaluation service will provide definitive evidence of reductions in recidivism, lower substance misuse and the wider benefits to individual offenders, the local criminal justice system and community.

If you are attending next week’s conference, come by GtD’s table in the exhibition hall to learn more of the value of our social impact analytics for your court.    

A lightbulb of cogs to illustrate service innovation

Service Innovation – Segment and Conquer

Supermarkets use data to sell us more of the things we want, and even things we don’t yet know we want – a real world example of service innovation through segmentation that we can learn from.

In social policy, we all know that there is no one programme or service that will work equally well for everyone in the target cohort. Even if it is having an impact across the board there will be some people for whom it works better than others and that’s where extra value can be squeezed out.

We might roll our eyes at the buzz-phrase ‘customer segmentation’, and of course there’s a difference between tailoring public services and selling sausages, but both require a similar approach to gathering data, analysing it, and in a sense letting it lead the way.

In the case of Tesco it’s about working out what shoppers want and selling it to them – a far easier job than convincing them to buy things in which they have no interest, a win for both parties. With public services it’s a matter of thinking in broad terms where we want people to end up – or not end up, as the case may be – and then letting what bubbles up from the data determine the most efficient route, and even the specific end point.

For example, working with one client that specialises in tackling youth offending, our data analysis found that though their intervention was effective overall, it was less effective at reducing offending among 12 to 13-year-olds than among young people of 15 and 16. By treating these two segments differently the overall impact of the intervention can be improved and more young people can be set on the right path at the right moment in their lives.

This approach challenges current orthodoxy which would have us determine our theory of change and set out clearly how we will achieve a given outcome before starting work. This can lead people to impose an analysis on the data after the fact, forcing it to fit the predetermined course. It also implies that all service users need more or less the same thing and we know very well that they don’t. The orthodox approach has its place, of course, once data has been collected and analysed, when we can start to make predictions based on prior knowledge.

Equally, it’s not efficient to design a bespoke service for every single end user, but there is a sweet spot in which we can identify sub-groups and thus wring out more value from programmes with relatively little additional time, manpower or funding. I’ll finish with another example: we have been designing approaches to impact management with a number of providers of universal services for young people and adult disability services. These agencies work with different sorts of people, with varying needs, and for whom different outcomes are desirable. Advanced statistical analysis can help us identify groups within that complex body and lead to service innovation which is both tailored and general.

Influence through Data

“Yeah, Says Who?” – Influence Through Data

You know you’ve achieved results – the data tells you so – but how do you influence sceptics to believe it?

It can be a rude awakening to take the findings of a study outside your own team or organisation, where trust and mutual support are more or less a given. In front of a wider audience of funding providers or other stakeholders, you will inevitably in my experience find yourself being challenged hard.

This is as it should be – scrutiny is a key part of a healthy system – but, at the same time, it’s always a shame to see an impactful project or programme struggle purely because its operators fail to sell it effectively.

Fortunately, while there are no black-and-white rules, there are some things you can do to improve your chances.

Confidence = Influence

When I present findings I do so with a confidence that comes with experience and from really understanding the underlying mechanics. But if you’re not a specialist and don’t have that experience there are things you can do to make yourself feel more confident and thus inspire greater confidence in your audience.

First, make sure you have thought through and recorded a data management policy. Are you clear how often data should be entered? If information is missing, what will you do to fill the gaps? What are your processes for cleaning and regularising data? Is there information you don’t need to record? A professional, formalised approach to keeping timely and accurate data sends all the right signals about your competence and the underlying foundations of your work.

Secondly, use the data as often as possible, and share the analysis with those who enter your data so that they can understand its purpose, and own it. Demonstrating that your data is valued and has dedicated, accountable managers hugely increases its (and your) credibility.

Thirdly, take the initiative in checking the reliability and validity of your own tools. If you use well-being questionnaires, for example, take the time to check whether they are really measuring what you want to measure in most instances. In other words, try to find fault with your own approach before your stakeholders so that when they find a weak point you have an answer ready that not only reassures them but also underlines the objectivity with which you approach your work.

Own Your Data’s Imperfections

Finally, and this might feel counterintuitive, you should identify the weaknesses in your own data and analysis and be honest about them. All data and analysis has limitations and being clear about those, and the compromises made to work around them demonstrates objectivity which, again, reinforces credibility.

In conclusion, the better you understand your own data and analysis, flaws and all, the more comfortable and confident you will feel when it, in turn, comes under scrutiny.

Hallmarks of a Good Evaluation Plan Part 2 – Change & Competence

Hallmarks of a Good Evaluation Plan Part 2 – Change & Competence

People don’t want to fund projects, or organisations, or even people – they want to fund change. And they want to work with professionals who know the territory.

Last week  I introduced the three hallmarks of a good evaluation plan and covered the first of those, “relevance”, in some detail. This week, I’m unpacking the others.

The second hallmark is evidence that evaluation, as planned, will promote learning and change within an organisation.  In our experience at Get the Data, we know that not all organisations are ready for change, so reassuring funding bodies of that willingness at the outset is a good tactical move. You can support this by engaging with changemakers within your organisation – those individuals who, if the evaluation demands change, have the desire and ability to make it happen.

For our part, Get the Data’s cutting edge predictive analyses are helping practitioners to identify what will work best for their clients. Managers are using that information to improve interventions, predict future impact and, in the case of social impact bonds, forecast future income. All of which, of course, goes to demonstrate a focus on improving results through intelligent change.

Knowing Your Stuff

The third and final hallmark of a good evaluation plan is evidence of technical competence which will reassure funding assessors that they are dealing with people who are truly immersed in the field in which they are working.

In practice, that means employing the agreed professional nomenclature of inputs, outputs, outcomes and impacts; and also demonstrating an awareness of the appropriate methods for impact and process evaluation. Though this is partly about sending certain signals (like wearing appropriate clothing to a job interview) it is by no means superficial: it also enables assessors to compare your bid fairly against others, like for like, which is especially important in today’s competitive environment. In effect, it makes their job easier.

Organisations that commission Get the Data are working with some of the most vulnerable people in society. We value their work and are committed to using quantitative methods of evaluation to determine their impact. We are proud that our impact evaluations are not only delivering definitive reports on the impact of their work but also play a decisive role in ensuring vital interventions continue. A rigorous evaluation is a business case, a funding argument and publicity material all in one.

I hope you have found this short introduction to the hallmarks of a good evaluation plan useful.  If you want to learn more about how our social impact analytics can support your application for grant funding then contact me or sign up for a free one-hour Strategic Impact Assessment via our website.

 

Hallmarks of a Good Evaluation Plan

Hallmarks of a Good Evaluation Plan Part 1 – Introduction & Relevance

When a potential funder glances at your application for a grant will they see reassuring signs of quality or something that immediately makes them wary?

When an antique collector finds what they suspect is a piece of fine English silverware they flip it over and look for a set of hallmarks – simple indicators that certify the metal, identify the maker, the place of production, and the year of manufacture. It can help them distinguish quickly between, say, an item of 17th-century sterling silver produced in London by a famous craftsman, and a mass-produced reproduction with only a thin plating of the real thing.

Similarly, it strikes me that there are three hallmarks of a good evaluation plan. First, it should be relevant. Secondly, it ought to promote adaptive change. And, finally, it must be technically competent. Get this right and you will certainly have a funder’s attention.

What has got me thinking about all this lately is a presentation I’ll be giving at the National Grant Conference which takes place in Atlanta, Georgia, between 25 and 27 July 2017, sponsored by the American Grant Writers’ Association.

My presentation complements the work Get the Data does in the UK where our social impact analytics practice provides organisations, including non-profits with the expertise they need to measure, improve and prove their impact. Our social impact analytics are often used to convince careful funding bodies to fund or invest in programs which ultimately assist the most vulnerable in society.

Demonstrating Relevance

So, going back to the first of those hallmarks mentioned above – what sells an evaluation plan as relevant? You have to know, first, what your organisation needs and what type of evaluation you are looking to conduct. Practitioners, board members and those responsible for awarding funding all think constantly about what impact they are seeking to achieve, how to measure it, and how they can achieve it with the resources at their disposal. You need to convey to them that you understand their priorities and mission and tie your work into theirs.

Of course, that’s easier said than done: stakeholders very often value different impact information so there is rarely a one-size-fits-all solution. This is an area where Get the Data can help. Our impact management services can assist in defining the needs of an organisation, and through smart reporting and analysis systems will ensure individual stakeholders can find the information that matters to them.

In the next post in this series, I will consider how we can help deliver an evaluation plan that promotes adaptive change and is technically competent.

In the meantime, I look forward to hearing from you if you would like to learn more about how our social impact analytics can support your application for grant funding email me to get the conversation started.

Please also visit our website where you can sign up for a free one-hour Strategic Impact Assessment in which we’ll take the time to evaluate your current impact management success and will identify key areas to develop in order to help your organisation maximise your social impact.