What is PQD?

PQD stands for Participatory Quality Development. You can use PQD as a Quality Improvement tool for prevention and health promotion projects.

The PQD Toolkit is an integrated set of theory, eleven practical methods and a set of case studies. PQD aims to involve stakeholders meaningfully in improving Health Promotion and HIV Prevention and support projects/programmes, create practice-based evidence and improve the effectiveness of interventions.

How will PQD help improve quality?

PQD uses local knowledge to improve the relevance of projects/programmes and provide feedback on the effectiveness of interventions.

PQD methods can be used to improve the quality of interventions at all stages of the cycle – from needs assessment to planning, implementation and evaluation.

PQD methods can help gather data that supports evidence-based practice and in turn build practice-based evidence.

Although the PQD methods can be used to enhance the quality of a project/programme, they do not necessarily offer specific quality benchmarks. Stakeholder collaboration and participation can, however, be an indication of the quality of a project/programme.

PQD can be used with other Quality Action tools, for example the Succeed tool, which will provide a structure to guide quality improvement of your project/programme.

Background and evidence of effectiveness:

PQD is an approach used by Deutsche AIDS-Hilfe (DAH), initiated with WZB (the Social Science Research Centre, Berlin) and supported by BZgA, the German Federal Centre for Health Education. The feasibility of PQD has been tested in German HIV and Health Promotion organisations.

The methods and processes of PQD are based on evidence from the fields of health and social science, theory and practice. The four-phase PQD cycle is adapted from the Public Health Action Cycle.

PQD stems from the internationally recognised Action Research model (or community-based participatory research), which demonstrates the effectiveness of interventions through generating practice-based evidence.

What are the benefits of PQD?

PQD is a flexible and adaptable quality improvement tool that offers a choice of methods for all stages of the project/programme cycle.

PQD provides practical, step-by-step methods that are tailored, feasible, useful, participatory and evidence-based.

PQD helps you gather the local knowledge of target groups to help identify problems and provide insights into implementing interventions that are relevant and appropriate to the local situation.

When you use PQD methods, you can document local knowledge and theories and produce practice-based evidence.

PQD is a means to strategically increase participation of key stakeholders.

When you involve stakeholders, you create the opportunity for more informed and expansive thinking. Stakeholders then have greater ownership of interventions and their capacity to identify with the project/programme is strengthened. This can lead to better outcomes for the interventions.

When can PQD be used?

Quality improvement is a long-term commitment and different methods from the toolkit may be used at all stages of planning, implementation and evaluation.

You can use PQD in combination with other Quality Action tools.

You can use PQD in a variety of prevention and health promotion interventions such as information campaigns, outreach, group work, social support, self-help groups, community development as well as community-based health services and clinics.

You can use PQD if your projects/programmes are engaged directly with your target groups, or if you want to move in that direction.

Case studies

Click here to view PQD Case Studies

Click here to view the HIV toolkit for migrants case study

Click here to view the HCDCP case study

Click here to view PAAARC case study

Click here to view the BHA HIV prevention & community testing project case study

Click here to view the “AH Plus” case study

Local knowledge

You can use PQD to include the observations of the target group alongside the perspectives of service providers and other experts because they each possess local knowledge. By using the local knowledge (i.e. expertise) of key stakeholders, your project/programme will be more fully informed about the needs and environments of your target groups.

Based on this local knowledge, you may develop a local theory or understanding of the characteristics of the health problem and its context and causes, so as to devise appropriate interventions.

Local knowledge and local theories exist but are often implicit (unspoken). You can make these more explicit and clarify them through the participatory data collection, planning and evaluation methods in PQD, which are:

• Tailored to the specific local conditions such as the composition of the target group and the approach and capacity of your organisation.
• Feasible so that the time you put into the appbrcation is proportionate to the results you get from it.
• Useful so that you can act to improve the situation.
• Evidence-based (practice-based evidence)so that you can check if your intervention methods are appropriate to the local context.

Collaboration

Building and sustaining collaboration between stakeholders is a core principle of PQD, informed by the view that no individual stakeholder has a full picture of the local problem.

You can facilitate collaboration between different stakeholders in your project/programme, to help ensure the diverse views of stakeholders are heard, common interests identified and solutions mediated.

The stakeholders usually include the project team, members of the key groups or individuals, intermediaries in close contact key populations, funding bodies and others identified as key to the success of the project/programme.

You and your team can identify the key stakeholders for your project/programme by assessing whom you want/have to collaborate with for this intervention and how they should be involved. See Collaboration on the PQD website for further information.

You and your team can use PQD methods and other Quality Action tools to clarify structures and agree procedures and levels of authority in the decision-making process for the project/programme. For example, you can use the Circles of influence method to clarify who contributes to the decision-making process and at what level they are best involved.

Participation

PQD focuses on the strong and meaningful participation of key populations at any stage of the intervention (needs assessment, planning, implementation, evaluation).

Participation means more than being involved in the project/programme. It also facilitates ownership by target groups and service providers who possess the local knowledge required for the success of the interventions.

Participation depends on both the abilities and experience of all of the stakeholders and the various contextual factors of the intervention.

Strong and meaningful participation requires involvement in the decision-making process.

People are more likely to participate in your project/programme when they see the benefits of their involvement and that their contributions are valued and respected.

Participation requires planning to ensure that the key people are involved and that the collaborations are sustainable. This can be quite a time-consuming process and you will need to ensure that you and your team have the resources to support it. The benefits of participation for the project/programme outweigh this.

You can use some PQD methods to assess the level of participation best suited to your project/programme and your target group under current conditions. Other PQD methods focus on increasing the level of participation.

The staged levels of participation are as illustrated below:

What is the structure of PQD?

While the other tools provide a very clear structure to guide you through their application, PQD provides a variety of participatory methods for use at any stage of the intervention.

You can select the most appropriate methods and apply them to suit the problems, skills and interests of the stakeholders and the phase of the intervention.

The PQD cycle describes the four phases of interventions: needs assessment, project planning, implementation and evaluation/analysis, as you can see in the diagram below.

Needs Assessment refers to what the people need in order to improve their health and well-being.

When you use PQD methods for needs assessment, you will generate specific information about your key populations from the key stakeholders. Participation of stakeholders in needs assessment means that information is not only collected about the target group, but also from and with the target group.

In addition to gathering local knowledge using PQD methods, you can also use other data to help with needs assessment, such as epidemiological data, research, official reports etc.

Project planning with PQD methods means involving the target group and other stakeholders in setting the goals, objectives and strategies of the project/programme, in response to the results of the needs assessment.

Meaningful participation of stakeholders improves project planning by clarifying what is desirable at societal level (vision); the values, principles, ideas, methods and expectations of the organisation (mission); and the objectives of the intervention.

Evaluation with PQD methods means the participation of stakeholders in all stages of the evaluation process.

What stakeholders want/require from an evaluation can differ. If you involve the stakeholders from the beginning you can focus on the approach you need to the evaluation which best suits everyone’s (appropriate) needs.

How can PQD be used?

You can organise training workshops on the principles and methods of PQD to enable the project teams to facilitate meaningful and purposeful participation using the methods.

You will need to make a decision which stage(s) of the quality improvement cycle to work on and then select the most appropriate methods for that purpose. If you are not sure which part of the cycle to focus on or which aspect of your project/programme needs improvement, one of the assessment-based Quality Action tools, such as Succeed, can help you make that decision.

Ideally, your project will aim to improve all parts of the cycle and you will select one or more appropriate methods for each.

PQD Toolkit – Link to PQD on Quality Action website for Toolkit: All Tools at a Glance

The toolkit consists of eleven methods to improve interventions through participation. The methods are accessible on the right hand side of this page.

The methods include the following:

• Service User Advisory Committee

• Guided Working Group

• Open Space

• Focus Groups

• Rapid Assessments

• Enquiries and Concerns Register

• Circles of Influence

• Programme Logic

• SMART Criteria

• Participant Observation

• Developing Local Objectives and Strategies – ZiWi Method

The toolkit describes each method in detail with sections as follows:

Brief Description
• Prerequisites Applications
• Process Overview
• Resources Required (Time, Personnel, Materials, Other Costs)
• Detailed Working Steps
• Further Advice
• Further Reading and Links

While you can choose the methods which are most suitable for your project/programme, the toolkit highlights methods which are of particular use during each of the four phases of the cycle.

PQD also contains a collection of case studies that illustrate the use of specific methods in a range of health promotion and prevention projects.

Some methods require a high level of participation from the service providers and target group and others require a lower level of participation. This allows you to choose the method most appropriate to your project/programme.

You can also use PQD methods for facilitating or increasing stakeholder participation in the application of other Quality Action tools.

What resources are required?

Preparation:

It is essential that you are familiar with the PQD Toolkit. This will help you select and apply different methods to a variety of situations and at the different stages of the process.

You need to consider whether the meetings you organise to apply PQD are better facilitated by a neutral (external) person to allow for diverse views to be expressed and respected.

Decide what time is available and when meetings will be held. It is advisable to tell people in advance to keep the time for applying PQD completely free and that phones and computer access will be reserved for the breaks.

People:

The number of participants involved depends on the PQD method you select and your decisions about participation. See Levels of Participation above.

You will need people with experience and skills in facilitation and leadership to build and maintain mutual trust and respect between the various stakeholders in the project/programme.

Some methods require research expertise. You will at a minimum need people to take notes during meetings and make the documentation available to participants afterwards.

You can consider ways in which to support the on-going participation of key stakeholders, such as facilitating environments of mutual respect to ensure positive experiences of their involvement.

Time:

Some methods require a high degree of commitment from stakeholders and others require relatively low levels. The application of PQD methods can range from hours to days to weeks, depending on the aims and methods you choose. The PQD toolkit states the time required in the step-by-step guides to each method.

The greater the levels of stakeholder participation, the more time may be required to support it.

You will need to be prepared to contribute a significant amount of time to ensure sustainable, strong and meaningful participation at all stages of the cycle.

Facilities:

Creating an open and supportive environment for reflection is essential. Time-tabling, allowing for sufficient breaks, food, comfortable surroundings with good light and ventilation, can all be considered when choosing the best venue for meetings.

Finances:

The application of the tool itself need not require additional resources. It may be possible to use meeting rooms that are free of charge, for example. Food and travel expenses may or may not be an issue, depending upon geographical spread of participants and the ethos of the organisation.

You may consider providing financial assistance to support participation of those who are not employed by the project/programme, such as travel or childcare expenses.

What are the challenges of using PQD?

PQD requires leaders and facilitators who are skilled and share the principles of collaboration and participation.

There may be differences in power relationships and responsibilities between stakeholders (for example between funders and recipients; drug users or sex workers and government officials). You will need careful planning and facilitation to ensure all viewpoints are heard and respected.

PQD requires considerable time and a commitment to collaboration and participation which can be difficult to sustain given the diversity of interests involved.

PQD may require that you train people in using the methods so as to sustain collaboration and ensure participants engage with the process effectively.

You will need to ensure that you have the right people involved and consider how to identify them and how to motivate them to be involved.

Checklist for implementing PQD

What is QIP?

QIP stands for Quality in Prevention and is a comprehensive, evidence-based questionnaire. It is completed by the project or programme and assessed by external expert reviewers co-ordinated by BZgA in Cologne.

QIP is a quality improvement tool that uses 7 quality assurance dimensions with 22 sub dimensions.

The external QIP assessment offers a detailed profile of the project or programme against the quality dimensions and sub-dimensions.

QIP helps to ensure that prevention work is implemented in a targeted, effective and sustainable way.

QIP is more comprehensive and detailed than Succeed and includes an external assessment.

How will QIP help improve quality?

QIP delivers practice-oriented, detailed quality profiles and generates ideas for improving quality.

QIP identifies strengths as well as opportunities for improvement and prioritises areas for future action.

QIP offers the advantage of independent, external quality assessment.

QIP helps document that a project is quality-assured and based upon quality dimensions and up-to-date knowledge.

Background and evidence of effectiveness

QIP was first developed for use in general health promotion and then adapted for use in HIV prevention.

The generic version of QIP has undergone systematic field tests that examined its objectivity, reliability and validity over several years.

QIP is based on evidence about the efficacy, effectiveness and efficiency of prevention, health promotion and education interventions.

QIP has been evaluated, tested in practice and adapted for use in HIV prevention projects and programmes.

HIV prevention specialists have reviewed and pilot-tested the QIP version used for HIV prevention.

What are the benefits of QIP?

QIP helps improve your work according to evidence-based dimensions.

QIP provides the opportunity for external assessment and feedback on the quality of projects. An external viewpoint can be more objective than self-assessment. It can highlight “blind spots” which are easily overlooked internally and can also contribute new questions, suggestions and ideas.

QIP identifies opportunities for improvement at every stage of the project cycle, including the early planning stages.

QIP supports continuous quality improvement so as to increase efficiency, effectiveness and sustainability over the long term.

QIP helps improve the success of interventions by identifying gaps in the project and shortfalls in skills and knowledge.

QIP helps identify the links between needs, objectives, methods and effects.

QIP highlights areas where the quality of the intervention is already high.

QIP provides feedback on where operating environments need to change in order to improve projects and services.

QIP helps improve the quality of evaluation design so that projects and programmes can have more meaningful descriptions of measureable results, outcomes and operating environments.

When can QIP be used?

QIP has been validated for all professional prevention and health promotion tasks.

QIP examines the quality of programmes, projects, campaigns, setting-based interventions, one-off interventions, health education and training.

QIP can be used for innovative and recently initiated projects or programmes of any size.

QIP can be used to improve quality at any level and every stage of the project cycle: from planning to implementation to improving evaluation design.

What is the structure of QIP?

QIP focuses on key components for effectiveness in prevention and health promotion which are used internationally: project description and concept; personnel and their qualifications; target groups (beneficiaries and intermediaries); planning and preparation; dissemination and promotion; process design and results.

QIP uses yes-/-no or multiple choice questions where possible. It also uses open questions to stimulate responses on specific areas so that information about every aspect of the project or programme is documented.

How can QIP be used?

You complete a detailed questionnaire. It may either be used as a self-assessment tool or it may be sent to an external review panel selected by the QIP team at BZgA. Only the nominated contact persons of the project/programme will receive the results of the external review. Confidential information is handled by a data manager not involved in Quality Action.

When you receive the feedback and recommendations, you can use them to decide on actions for quality improvement. You can use methods from other tools, such as PQD for example, to improve aspects of the project. And you can apply the QIP tool again later to document your improvements.

Stakeholders – Who should be involved?

Anyone who is familiar with the project can complete the questionnaire. Your team may decide to complete the whole document together, or you may divide it into sections and then meet up to agree on a final version.

As completing the document is an opportunity for self-reflection, you and your team will gain a more complete picture when there is broad participation of the relevant stakeholders.

We have found from experience that using a facilitator who is familiar with the tool helps improve participation and communication.

You may like to use methods from PQD to help identify relevant stakeholders and the levels of participation best suited to the application.

Documentation

You will complete a questionnaire where you describe the structures, concepts, processes and outcomes of the intervention in detail.

See the QIP tool for details of the documentation to be completed.

Completing the documentation in itself provides an opportunity for self-reflection and conversations within your team.

The more detail you provide, the more complete the picture reviewers will get of your project / programme and the more specific their feedback.

What is the review process?

The review process includes assessment using the quality dimensions, analysis and specific feedback.

Assessment:

Experienced, independent, trained QIP reviewers use a detailed assessment guide with evidence-based criteria to assess structure, processes and outcomes according to set criteria outlined in the quality dimensions.

To ensure objectivity and validity, each project is assessed by at least three reviewers. The process is co-ordinated at BZgA, in Cologne.

The assessment creates a detailed profile of the project/programme against the QIP quality dimensions and sub-dimensions, with feedback on where the project/programme is doing well and suggestions about areas for improvement.

Reviewers rate each dimension using a set of clearly defined quality levels.

Levels of achievement are assigned ranging from 0 (problem zone) to 3 (exceeds standards) for each dimension. A score of near or above 2 indicates that the project operates at a good level of quality and can expect to succeed.

Analysis:

Reviewers send their assessments to the Federal Centre for Health Education (BZgA) in Cologne, Germany where the data is statistically analysed, feedback is compiled and sent directly and exclusively to the project. QIP ensures the statistical validity of the assessment.

BZgA pools the assessments and characteristics of all projects/programmes that have applied QIP in a database. The QIP database only contains non-identifiable, aggregate data, ensuring confidentiality for projects and programmes.

Benchmarks are arrived at through comparisons with the average scores among the different projects stored on the database. The QIP database is not yet large enough to derive benchmarks for comparative analysis in the field of HIV prevention, so projects/programmes participating at this stage will be important contributors to the database.

In addition to the assessment of the individual project, the analysis can show structural influences on quality by comparing projects from similar fields of activity. Examples of these include the impact of financial constraints or the benefits (or otherwise) of a targeted approach.

Feedback and Quality Profiles:

QIP provides project/programme-specific advice and suggestions for improvements based on the documentation submitted and current professional standards.

QIP provides an overall picture of the achievements, results and probable effectiveness of the project, indicating starting points for improvement so that actions may be taken quickly.

QIP reports only to the designated individual in the project.

What resources are required?

Preparation: You may find it useful to send the questionnaire to everyone involved in the application in advance of the meeting/s so that everyone has prepared their input for the discussions.

Decide how much time is available and when meetings will be held. It is advisable to tell people in advance that using QIP needs every participant’s full attention and that breaks are provided for urgent phone and computer uses.

Decide whether you need an external facilitator and nominate a note-taker who documents the discussion.

Time: In addition to the preparation time, the completion of the documentation by the projects or programmes may take regular dedicated time over up to two weeks. The preparation work may require additional time if stakeholders receive advance copies of the questionnaire. The review process takes approximately seven weeks, after which you need to schedule time to reflect on the feedback and plan actions to improve quality.

Facilities: Creating an open and supportive environment for reflection is essential. Time-tabling, allowing for sufficient breaks, food, comfortable surroundings with good light and air, can all be considered when choosing the best venue for implementing the tool.

Finances: For the duration of Quality Action, there is no fee for the review process for European HIV prevention projects and programmes. Apart from any organisational expenses required for facilities, the application of the tool itself need not require additional resources. QIP results may however point to the need for additional resources for the improvement of the project itself.

People: As the application of QIP is quite detailed, it is important to delegate duties and responsibilities. See section on Stakeholders involved for further information on who to involve.

What are the challenges of using QIP?

Some people may be resistant to applying a more structured way of thinking and working. Here, it helps to establish a positive and open atmosphere for reflection.

Some participants may feel intimidated by the questionnaire as it requires time and a level of detail that can be off-putting initially. Consider breaking up the task or use Succeed, as a more accessible tool to start with.

QIP may highlight serious deficiencies and/or lack of sufficient data to support the intervention. This could impact on morale unless there was a positive commitment to the challenge of quality improvement beforehand. It is better to keep things simple in the early days of quality improvement than lose the support of important stakeholders.

QIP reviews the quality of the intervention – It does not assess the entire organisation.

Checklist for implementing QIP