Practical guidance for engaging end-users and experts in developing scientific tools
This report provides actionable guidance for scientists developing scientific tools that inform on-the-ground decision making. Scientific tools, in the context of this report, are technology or protocols that help practitioners collect and analyze their own data, and information products and web tools that practitioners could use to inform decisions. Engaging end-users and fellow experts is fundamental to the creation of useful scientific tools. Scientists can use clear and specific direction on action steps and activities to effectively engage with end-users and fellow experts during development. Our study explores lessons learned from six U.S. Geological Survey projects that designed and implemented engagement activities with end-users and experts to coproduce scientific tools for natural resource managers. U.S. Geological Survey teams engaged end-users and experts across the United States from Federal, State, and local governments; universities; Tribes; territories; and nongovernmental organizations in designing and developing scientific tools intended to support end-users in their work. An online survey with 98 participants measured satisfaction across several indicators of successful engagement, including engagement activity frequency, sufficient opportunities to provide feedback, feedback implementation, inclusion of necessary perspectives, and functionality of the tool for end-users. Semistructured interviews were held with project leads, during which the project leads reviewed a summary of the survey results. The project leads reflected on the engagement efforts used in their project, then described lessons learned from the engagement experience and participant feedback. Common themes for ensuring effective engagement identified through thematic analysis included engaging end-users during product conceptualization; establishing clear roles and expectations; considering who end-users are and how end-users may use the tool; recruiting participants through your network, boundary spanners, and leadership; understanding individual use cases; communicating how feedback was integrated into the product; and strategically using virtual meeting tools. This guide shares practical steps and exercises for planning and facilitating effective engagement based on lessons learned from project leads and case study summaries of each project.