Conference workshop program – Tuesday 16 September

>>> DOWNLOAD A PRINTABLE VERSION (WITH PRICING)

Having trouble seeing the full overview table? Switch to mobile version.
View Monday conference workhop program.

The following categories will help you select sessions best suited to your interests: Foundation – Intermediate – Advanced

Workshop details

Full day workshop 

Cultivating evaluation: Exploring an expanded garden of approaches for diverse contexts

presented by Bianca Montrosse-Moorhead (KEYNOTE), Daniela Schroeter  |  FOUNDATION / INTERMEDIATE

Workshop description

> back to overview

FULL DAY WORKSHOP  

Practical approaches to evaluating impact without experiments: Contribution analysis, process tracing and more 

presented by Patricia Rogers   |  INTERMEDIATE / ADVANCED     

Workshop description

There is increasing demand for high quality impact evaluation, but it is not always possible – or appropriate – to use experimental methods (such as randomized controlled trials) or quasi-experimental designs. This workshop will explore rigorous non-experimental approaches to impact evaluation, focusing on contribution analysis and process tracing.

For evaluators, the workshop will strengthen their ability to design and conduct high-quality non-experimental impact evaluations. For evaluation commissioners, it will strengthen their ability to frame appropriate terms of reference, select and manage appropriate evaluation teams and support use of findings. 

By the end of this workshop, participants will:

• understand why experimental approaches are not always feasible and how non-experimental methods can still provide strong evidence of impact
  
• learn the key principles of contribution analysis and process tracing and how they help answer impact questions
  
• apply these methods to practical exercises, improving their ability to assess whether and how a program has contributed to observed changes
  
• identify how they might apply these approaches in their work
  

The workshop will employ adult learning strategies including case studies, group exercises and individual reflection.   

The full-day advanced workshop is intended for people with a good understanding of foundational evaluation concepts and data collection, analysis and reporting options. It addresses Domain 4  of the AES Evaluators’ Professional Learning Competency Framework.

About the facilitator

Patricia Rogers has over 30 years of experience conducting evaluations, teaching evaluation courses and workshops, conducting research into evaluation and strengthening evaluation capacity with government and non-government organisations in Australia and internationally. 

She is the founder of BetterEvaluation, the global knowledge platform on evaluation methods and processes and has an enduring commitment to supporting appropriate choices in evaluation design. She has presented keynote and plenary addresses at evaluation conferences in Australasia, Europe, Asia, Africa and North America and successful evaluation workshops in Australia and internationally including AES pre-conference workshops. She has written on appropriate methods for impact evaluation and ways of addressing complexity in evaluation. Her publications include Purposeful Program Theory: Effective Use of Theories of Change and Logic Models (with Sue Funnell) and Choosing Appropriate Designs and Methods for Impact Evaluation (with ARTD Consulting) for the Department of Industry, Science and Resources. She is a Fellow of the AES, and recipient of the AES Outstanding Contribution to Evaluation Award and the American Evaluation Association's Myrdal Evaluation Practice Award.

> back to overview

FULL DAY WORKSHOP  

Evaluation and value for money: An inter-disciplinary, participatory approach using evaluative reasoning and mixed methods

presented by Julian King   |  FOUNDATION / INTERMEDIATE    

Workshop description

About the facilitator

Julian King is a NZ based public policy consultant. His professional background includes over 20 years evaluating policies and programs in high, middle and low-income countries. The Value for Investment (VfI) approach, developed through Julian's doctoral research, is used worldwide to evaluate complex and hard-to-measure policies and programs. Julian received the 2021 AES Evaluation System Award in recognition of the contribution made through the VfI approach. Julian is a member of the Kinnect Group, an Associate of Oxford Policy Management, a member of Verian Group's Centre for Value for Money (VfM), an Honorary Fellow at the University of Melbourne and a University Fellow at the Northern Institute. He is a member of the evaluation societies of Australia, NZ, UK, USA, and Europe. Julian specialises in VfI capability-building. He regularly provides training workshops on Evaluation and Value for Money in Australia, NZ and globally.

> back to overview

FULL DAY WORKSHOP  

Cultivating our bubble: Using developmental rubrics to enhance evaluation

presented by Amy Gullickson, Ben Lawless   |  FOUNDATION / INTERMEDIATE 

Workshop description

This full-day workshop brings together best practice in rubrics with best practice in evaluative reasoning: developmental rubrics. A powerful tool for qualitative, growth-oriented program evaluation, developmental rubrics offer deeper insights for monitoring, evaluation, and learning at any point in a program’s lifecycle by replacing traditional static ratings with nuanced performance descriptors. Workshop participants will learn the basics, practise on examples, and  create developmental rubrics for their own projects.

Participants will learn to: 

• distinguish between developmental and traditional rubrics
• • design rubrics that capture stages of progress with clear criteria and descriptive indicators
  
• apply these rubrics to real-world program and systems evaluation contexts
  
• avoid common pitfalls such as pseudo-counting and overly vague language
  

Drawing on educational research and established frameworks, the workshop emphasises:

• structuring effective rubrics with progressive, observable quality markers
  
• integrating rigorous evaluative reasoning into rubric design
  
• providing meaningful feedback for decision-making and stakeholder engagement
  

This interactive session uses hands-on activities, small-group discussions, and case studies to guide participants in creating or refining their own developmental rubrics. Templates, sample rubrics, and follow-up materials will be provided to enable immediate application.

Designed for evaluators, commissioners, and policymakers with foundational to intermediate experience in evaluation, though no prior rubric-writing expertise is required. Familiarity with basic evaluation concepts is helpful but not mandatory.

Aligned primarily with Domain 3 (Theoretical Foundations) of the AES Evaluators’ Professional Learning Competency Framework, the workshop also addresses evaluative reasoning and stakeholder engagement domains. It fits both the ‘New Approaches and Ways of Thinking’ and ‘Foundational Evaluation Skills and Capabilities’ categories.

Through practical exercises and expert facilitation, participants will leave with the skills to implement robust developmental rubrics in their evaluation work.

About the facilitators

Associate Professor Amy Gullickson is an AES Fellow who has been doing, researching, and teaching evaluation for more than 20 years. She is  in demand internationally as an expert in evaluation-specific methodology, evaluation teaching and learning, and evaluation capacity building for individuals, organisations, and systems. As a member of the AES Pathways committee, she co-leads the ongoing work on evaluator competencies and self-assessment. 

Ben Lawless is an educator and researcher at a large P-12 College in northwest Melbourne. He writes textbooks, lectures in assessment at the University of Melbourne, worked with VCAA to improve their assessment practices, written units of work for the National Museum and presented widely on the topics of developmental learning, assessment, well-written rubrics, and using assessment data to target teaching. He has won a number of awards, including Hume's Graduate Teacher of the Year and being a finalist for ResourceSmart teacher of the year. He has created a number of international political simulation games putting students in the role of world leaders to solve various political, environmental and social challenges, one of which was in the Top 10 for Australia for the HundrED prize. His personal education passions are using evidence to improve teaching, and learning through games. He is currently in the process of developing a PhD proposal, with the thesis being "Bringing developmental education rubrics into the field of evaluation".

> back to overview

FULL DAY WORKSHOP  

Making it stick: Increasing the power of evaluation reports using easy-to-apply principles, tools, tips and tricks 

presented by Samantha Abbato   |  FOUNDATION / INTERMEDIATE 

Workshop description

Communicating evaluation findings through effective reporting is for those of us who commission, plan and do evaluations. This workshop builds on the AES online Making it Stick 1-3 series to introduce practical activities for strengthening participants’ evaluation reporting across the suite of report types, including written reports, infographics, data dashboards, video reports and PowerPoint presentations.

Drawing on the principles of effective communication and evaluation use, this workshop incorporates activities and techniques from various disciplines. Throughout the day, participants can apply the learnings to real-life examples, including the opportunity to volunteer their own reporting projects for small-group work.

Activities include: 

• crafting the report message using the Rule of Three for a three-part and three-minute story
  
• increasing the effectiveness of communication with report audiences using visual empathy mapping
  
• use of storyboarding and story-arc tools to effectively ‘show’ the report story through images, drawing and data visualisation, and structure your story for greater impact
  
• script-writing techniques for decluttering and creating powerful language to deliver directly, using video and increasing the report audience’s engagement with written text
  

Workshop participants will have the chance to use cost-effective digital kits to present their report message on video. Easy-to-use tools, templates and checklists will enable participants to directly apply the workshop learnings to their own reporting projects. 

Workshop learning outcomes include:

• the ability to use empathy mapping to communicate with evaluation stakeholders effectively
  
• skills in crafting and delivering a potent core message
  
• practice using storytelling tools to structure the report, create powerful language, and ‘show’ the message through visuals
  

This workshop is an ideal introduction for those who write or commission reports. It provides an opportunity for participants of the Stick 1–3 online workshops (2020–2025) to further their skills in reporting through new materials and tools that are best delivered face-to-face.

This workshop aligns with Domains 1, 3, 5 and 6 of the AES Evaluators’ Professional Learning Competency Framework.

About the facilitator

Samantha Abbato has completed more than 100 evaluation and research reports and papers for various government, non-government organisations and community stakeholders.  She has published numerous book chapters and peer-reviewed journal articles and has worked as a freelance journalist for several years. She received the 2015 AES Evaluation Publication Award (Caulley Tulloch Award).  

With a passion for communication and maximising evaluation use, and an extensive understanding of the evaluation commissioner perspective through her work on Visual Insights organisational capacity building, Samantha can offer a wealth of case studies of the good, the bad and the ugly of evaluation reporting. As the director of Visual Insights People since 2013, she has introduced a pictures and stories and play approach to evaluation reporting and the delivery of workshops. Using cartoons and a range of visual tools, templates and checklists that workshop participants can take away with them, Sam is passionate about participants’ continued use of learnings for sustained improvement of their evaluation reports.    

> back to overview

HALF DAY (MORNING) WORKSHOP  

Strong stories, strong outcomes: Narrative practice and strength based evaluation

presented by Donna-Maree Stephens  |  FOUNDATION 

Workshop description

This interactive workshop will focus on applying Aboriginal and Torres Strait Islander narrative practice methods

The workshop will cover:

• defining Aboriginal and Torres Strait Islander narrative practice and storytelling
  
• share a narrative framework for understanding narrative practice and processes in Aboriginal and Torres Strait Islander communities, particularly drawing from remote NT contexts
  
• practice drawing strength-focused messages and metaphor using narrative inquiry
  

As an interactive half-day session, this workshop is open to all levels of evaluators but may suit early career and First Nations evaluators best.

This workshop aligns with Domains 1, 2, and 3 of the AES Evaluators’ Professional Learning Competency Framework. It is a valuable opportunity for evaluators especially those early in their careers or from First Nations backgrounds to enhance their culturally responsive and narrative-based evaluation skills.

About the facilitator

Donna-Maree Stephens is a Muran/Iwaidja women whose family come from Northwest Arnhemland. She grew up living on Larrakia Country in the Northern Territory.  In 1992, Donna began working as a teacher in Belyuen School on the Cox Peninsula. Her early work focused on teacher professional learning, including literacy pedagogy and e-learning in remote settings. In 2010, Donna moved to higher education as a lecturer for the CDU School of Education, during which time she focused on First Nations and international student support - working in the Growing Our Own First Nations remote preservice teacher program and as the NT Teaching Schools Coordinator. In 2014, Donna moved to a research-focused role addressing education pathways and remote community development.  

Donna has worked in research and evaluation roles focused on AOD, mental health, social and emotional wellbeing and workforce development. In 2019, Donna started work as a consultant and has had the honour of being the inaugural Community First Development Research and Evaluation Fellow. She also contributed to the Better Evaluation Aboriginal and Torres Strait Islander Evaluation Protocol. Donna has more than a decade of experience in research and evaluation project management and administration, reporting, publications and presentations at local, national and international forums.  Her research and evaluation interests include remoteness, poverty, mobility, flourishing, organisational change, ecosystems thinking, generative design and narrative inquiry.

> back to overview

HALF DAY (AFTERNOON) WORKSHOP  

Observation methods for evaluators

presented by Emma Williams  |  HALF DAY WORKSHOP (AFTERNOON) | FOUNDATION 

Workshop description

This half-day workshop will build participants’ awareness of the potential of observational data to answer evaluation questions and build skills in rigorous, ethical observational techniques. There are many variants of observational data; it may be quantitative or qualitative, gained through trace, overt or covert observation in controlled or natural situations, and recorded digitally or manually. 

This workshop will explain how each type of observational data suits a different range of evaluation questions and situations; it will focus on data gained through the observation of human behaviour in public places, which is typically of most use to evaluators. Ethical issues, particularly where evaluations include vulnerable populations, will be a special focus of the workshop.

By the end of the session, participants will be able to:

• distinguish between different types of observational data
  
• identify the evaluation situations for which each type of observational data is suited
  
• implement strategies to ensure rigour in observational data collection, recording, and analysis
  
• formulate strategies to ensure their observations are ethically designed and collected
  

Five real-life cases will be used to illustrate the range of approaches and issues that observational research can provide, with interactive exercises conducted after each case. 

No prerequisites are required; this is a foundational skills workshop targeted to those without a great deal of experience in evaluation, although it may be of use to those with intermediate and even advanced skills in other areas of evaluation, if they do not have observational experience. 

The workshop focuses on the Research Methods and Systematic Inquiry domain of the AES Evaluators’ Professional Learning Competency Framework, although elements of it, particularly the ethical exercises, address the Culture, Stakeholders and Context domain, and all of it is relevant to the Evaluation Activities domain.

About the facilitator

Emma Williams is a Credentialed Evaluator with experience in realist, observational and participatory evaluations on topics including throughcare, family violence, service access, employment, environmental issues, and international development. She was co-editor, with Ana Manzano, of Realist Evaluation: Principles and Practice (2024), and her chapter on observational techniques will come out in Sage’s Data and Research Literacy collection mid-year. Emma is currently undertaking a realist investigation of evaluation ethics for a PhD that also uses Q methodology and would love to talk about evaluation ethics with anyone at the conference. 

> back to overview