Policy and Program Evaluation
Policy Development + Program Evaluation
Our mission is to make federal government programs more effective, efficient, and valued. Our streamlined evaluation methodologies, data collection, and rigorous analysis techniques seek to both answer a question and provide actionable strategies in which they can be realized.
Our program evaluation consultants have extensive experience designing and implementing both formative (process) and summative (outcome) evaluations at the project, program, portfolio, and organization levels of analysis, for government agencies.
We can also help determine the extent to which an evaluation is feasible or necessary.
We have substantial experience designing and instigating program evaluations for non-profits and government agencies implementing projects and programs aimed at addressing complex issues including mental health, human capital programs,
health outcomes, behavioral health, diversity, and child welfare.
Our work has fueled insights and policy directives into some of the most vexing issues faced by federal clients.
Medicine
Ethical Issues in the Use of Consumer Genetic Testing | Low-Volume High-Risk Surgical Procedures |
Measles, Mumps, and Rubella Booster Immunization Practices
Health
Psychological and Family Stressors Associated with Deployment and the Services | Effective Government
Tobacco Use and Mitigation within the Military | NDAA Evaluation of the James A. Lovell Federal Healthcare Center
Human Capital
Active Duty Women’s Health and Transition Services | Workplace Bullying Policy | Child Abuse and Neglect
Directive on Transgender Service members | Multilingual and Multiethnic Military Demographics | Program Efficiencies |
Exceptional (Special Needs) Family Member | Intimate Partner Violence Reduction Strategies | Rural Population Equity Studies
Most high visibility or underperforming programs have been studied and analyzed at least to some point, leading to numerous recommendations about their operations, policy, or effectiveness. Often, attempts to evaluate these programs are conducted in
a deductive manner, focusing on an exhaustive re-examination of the data, interviews, and findings of past efforts; only to
realize what the organization intrinsically knows.
Knowesis proposes a different approach— a hypothesis-based inductive analysis—known as Inductive Solution Approach (ISA™). ISA is a desirable option when: there is a well-defined opportunity, an organization is trying to develop long-term plans, there is an established body of knowledge or a more creative approach is required. ISA is founded in evaluating the intended benefit and focuses on real world application. Our approach is designed to work in concert with agile development constructs and patterned from the American Evaluation Association’s guidelines to reinforce accountability, validity, translation and relevance. Together with our measurement models, information collection, and analytic methods, ISA seeks to close the gap between intended and actual benefit.
Our approach uses multiple techniques to include:
Quantitative Analysis
Our analysts apply cutting edge analytic techniques from applied economics, computer science, and research psychology
to help develop an intimate understanding of your customers, stakeholders or competition both now and into the future.
Knowesis ensures that as-is and what-if questions will be articulated and addressed properly during the research process,
that you’ll have an appropriate sample size to obtain robust results, and that the collected data will be analyzed optimally.
We assist our clients the design of the project - initial methodology and survey development - through designing and implementing the optimal analysis plan, performing the analysis, and providing a comprehensive, publication - ready reporting of the results.
In our biostatistics and epidemiological consulting work draws on a team of highly skilled biostatisticians and epidemiologists who are veterans of government sponsored research programs. Our biostatistics and epidemiology consultants offer end to end or specific guidence on a range of relevant areas throughout the research and clinical trial processes, including effective data safety monitoring.
Qualitative Analysis
Literature Reviews | Environmental Scans | Focus Group | Key Informant Interviews | Assessments and Surveys
Literature reviews can inform best practices and cutting edge thought leadership on the topic under assessment and provide
a starting point for virtually any endeavor. Environmental scans are most helpful providing a well - known and established body of knowledge. These can include existing standards, national programs with metrics etc. Knowesis has used a combination of
in-person focus groups and virtual focus groups (VFGs). Research shows that VFGs perform as well as traditional face-to-face focus groups in eliciting information from participants and that virtual interaction is very similar to that in face-to-face discussions. Using a stratified sampling method, we will conduct, in-depth interviews with approximately 15 to 20 key informants. Key informants will be selected for their firsthand knowledge and unique perspectives of the topics and challenges.
Mixed-Methods
A mixed-methods research design provides a richer result than a single method alone. Relevant knowledge can be found in both data and discussions. We develop research and evaluation plans that incorporate qualitative research (e.g., interviews, focus groups, big data) and quantitative research (e.g., structured data stores, surveys, performance measures, program data analysis). Knowesis employs both qualitative and quantitative techniques to ensure robust understanding of the issues. Knowesis’ community assessment capabilities help communities understand the “as-is” state, identify gaps, and gauge and plan for improvements to be achieved.
Performance Measurement and Benefits Realization
To formulate conclusions and realize benefits, we first identify measurement gaps; develop, train on, and monitor measures; and evaluate usage to provide critical information for research and evaluation studies.
Policy Development
Our SMEs research, coordinate, and draft policy for the largest and most high - visibility programs in the Federal space.
We operate within the Doctrine, Organization, Training, Materiel, Leadership and Education, Personnel, Facilities, and Policy (DODMLPF-P) to govern national security. Our policy drafts align with National Strategic Objectives and interoperability and transparency requirements. Our work is strategically coordinated through the functional, legal, and technical community to ensure robust and actionable program outcomes. Our policy experience covers an array of subjects to include Military Force Health Protection; Chemical, Biological, Radiological, Nuclear, and Explosives (CBRNE); Behavioral Health; Clinical Operations; Patient Centered Care; and emerging Federal workforce policies such as Transgender Military Service members and Workplace Bullying at the highest levels of the Federal Government.
Health and Medical Support | Health Outcomes Research | Psychological and Behavioral Health Support |
Benefits Realization | Diversity, Equity, and Inclusion Program Management | Rural Population Equity Studies | Congressional Mandate Compliance Interdepartmental Program Support | Human Performance Programs |
Performance Measurement
Applied Areas of Expertise