The Department of Innovation and Technology is seeking a Research and Evaluation Manager to join our growing Analytics Team and support the City of Boston's comprehensive efforts in evidence-based decision-making and rigorous policy evaluation. As part of a highly collaborative group using data to improve all aspects of city government, the Research and Evaluation Manager will build and maintain a diverse portfolio of research and evaluation projects, coordinate evaluation processes and methodologies, and support the implementation of the City's overarching research and evaluation strategies.

Successful candidates will work closely with city leaders, develop research tools and best practices that can be implemented across the organization, and manage evaluation projects that inform performance management and policy decisions. This role embodies the department's mission to enable better government for every constituent through innovation, technology, equity, effectiveness, and efficiency.

The Citywide Analytics team is a diverse group of analysts, data scientists, project managers, developers, and engineers with a range of skills and backgrounds, working together to use data to improve life for those who live and work in Boston. The Research and Evaluation Manager will fulfill the responsibilities listed below and bring a collaborative spirit that will strengthen and expand the team's overall range of abilities.

Research and Evaluation Project Management

• Plans, implements, and maintains research and evaluation projects in support of partners throughout city government, with emphasis on rigorous impact assessments and policy evaluations.
• Manages and supports evaluation projects led by members of the Citywide Analytics Team and collaborating departments.
• Develops in-depth understanding of the workflows, challenges, and stakeholders of specific City departments and programs to successfully execute existing projects and identify future research opportunities.
• Coordinates evaluation timelines and deliverables to ensure research findings inform decision-making and resource allocation.
• Provides expert guidance and assistance in training, mentoring, and hands-on support to members of the Citywide Analytics Team on evaluation methodologies.

Research Methodology and Analysis

• Manages data collection, performs rigorous analyses, and develops visualizations as required to facilitate both internal and external evaluation projects.
• Applies experimental and quasi-experimental research methods to assess program effectiveness and policy impacts.
• Collaborates with technical staff on projects requiring specialized research skills, including survey design, qualitative methods, and mixed-methods approaches.
• Ensures ethical standards in research practices, data collection, and analysis, promoting best practices for data privacy and equity.
• Develops and maintains research protocols and methodologies that can be replicated across city departments.

Coordinated Research and Evaluation Systems

• Supports the coordination of citywide research and evaluation activities, including annual collection and review of evaluation findings.
• Assists in developing research frameworks that strategically connect evaluation outcomes to performance measurement and resource allocation through the city's budget process.
• Manages research databases and maintains documentation on evaluation methodologies, findings, and best practices.
• Coordinates the implementation of surveys and other data collection instruments for evaluation purposes.
• Identifies opportunities to leverage third-party data sources to enhance evaluation capacity.

Strategic Research Support

• Supports the Director of Research and Evaluation in the development and implementation of citywide research and evaluation strategies.
• Participates in the hiring and recruitment of Analytics Team members as requested by the Chief Data Officer.
• Coordinates collaborations with academic and non-profit partners related to impact evaluations, policy analyses, and research methodologies.
• Assists in building evaluation capacity across city departments through training and technical assistance.
• Contributes to the development of reusable research resources, templates, and best practice guides.

Communication and Knowledge Management

• Prepares research reports, presentations, and visualizations to communicate evaluation findings to City leaders, stakeholders, and department staff.
• Creates and maintains comprehensive documentation on research data, methodologies, and procedures.
• Supports the dissemination of evaluation findings to inform policy decisions and program improvements.
• Facilitates knowledge sharing across departments to reduce duplication of research efforts and coordinate evaluation priorities.
• Contributes to the City's transparency initiatives by ensuring research findings are accessible and actionable.

Additional Responsibilities

• Perform additional duties as assigned by the Director of Research and Evaluation, Chief Data Officer, and the Mayor's Office.
• Support curriculum development for building research and evaluation literacy across the city government.
• Assist in establishing research partnerships that advance the city's capacity for evidence-based governance.

Required Experience and Education

• At least four (4) years of full-time, or equivalent part-time, experience working on research, evaluation, or data analysis projects in a business, government, or nonprofit setting.
• A bachelor's degree in economics, social science, mathematics, public policy, business, statistics, or a related field is preferred and may be substituted for up to two (2) years of the required experience (master's degree highly preferred).

Research and Technical Skills

• Knowledge of research and evaluation methodologies, including experimental and quasi-experimental design.
• Experience with survey design and implementation, including both quantitative and qualitative data collection methods.
• Proficiency in statistical data analysis and visualization using Python, R, Stata, or similar tools.
• Experience using Tableau or other similar data visualization platforms.
• Familiarity with relational database systems such as PostgreSQL, MySQL, or Microsoft SQL Server.
• Understanding of research ethics and best practices for data privacy and responsible data use.

Project Management and Communication

• Experience in planning and executing collaborative research projects from start to finish under time and resource constraints.
• Strong analytical, problem-solving, and communication skills, including mapping of research questions to appropriate methodological solutions.
• Demonstrated success in learning new research skills as needed to succeed in a fast-paced environment.
• Talent for explaining complex research findings and methodologies to both technical and non-technical audiences.
• Ability to communicate the results of evaluations in a clear and effective manner that informs decision-making.

Preferred Qualifications

• Experience in policy evaluation or program assessment, particularly using rigorous impact evaluation methods.
• Knowledge of performance management practices and how evaluation findings inform organizational improvement.
• Experience in the public sector (especially in local government) is highly desirable.
• Familiarity with mixed-methods research approaches combining quantitative and qualitative analysis.
• Understanding of equity frameworks and inclusive research practices.
• Experience with academic or research partnerships.

Personal Attributes

• Ability to exercise good judgment and focus on detail as required by research and evaluation work.
• Collaborative spirit and ability to work effectively across departments and with diverse stakeholders.
• Commitment to ethical research practices and evidence-based decision-making.
• Performs other related duties as required.

Boston Residency Required.

Terms:

Non union MM2/8 

35 hour work week