Job Description
Location: Chicago, Illinois
Business Unit: Rush Medical Center
Hospital: Rush University Medical Center
Department: UME - Curriculum-Assessment
Work Type: Full Time (Total FTE between 0.9 and 1.0)
Shift: Shift 1
Work Schedule: 8 Hr (7:00:00 AM - 3:00:00 PM)
Rush offers exceptional rewards and benefits learn more at our Rush benefits page (https://www.rush.edu/rush-careers/employee-benefits).
Pay Range: $43.10 - $64.22 per hour
Rush salaries are determined by many factors including, but not limited to, education, job-related experience and skills, as well as internal equity and industry specific market data. The pay range for each role reflects Rush's anticipated wage or salary reasonably expected to be offered for the position. Offers may vary depending on the circumstances of each case.
Summary:
The Director of Educational Assessment ensures that Rush Medical College meets its mission and program objectives through the development, implementation, and continuous improvement of a comprehensive, learner-centered assessment strategy. This strategy includes formative, summative, and narrative assessment; knowledge and behavior-based assessment; regular quantitative and qualitative feedback; and individualized learner enrichment and support.
The Director provides strategic and operational leadership for educational assessment across all phases of undergraduate medical education (pre-clerkship and clerkship), ensuring alignment between course-, program-, and institutional outcomes. The role promotes a culture of master adaptive learning among students, faculty, and administrators and serves as a senior institutional expert in assessment design, implementation, analysis, and policy.
Required Job Qualifications:
Advanced degree, PhD or MD equivalent
2 - 5 years of management experience.
Significant experience in educational assessment, program evaluation, or medical education.
Demonstrated technical expertise in:
Assessment blueprinting
Written, simulation, and workplace-based assessment
Behavioral assessment design and evaluation
Standard setting methodologies
Proven people leadership and management experience.
Strong analytical, communication, and stakeholder engagement skills.
Preferred Qualifications
Advanced training or certification in assessment, medical education, or psychometrics.
Experience working with NBME, AAMC, or comparable national assessment bodies.
Experience overseeing complex academic or clinical education operations.
Responsibilities:
Strategic Assessment Leadership
Design and implement an integrated, learner-centered assessment strategy across all four years of medical school.
Ensure alignment of assessment practices with program objectives, institutional mission, accreditation standards, and strategic priorities.
Balance knowledge-based and behavioral assessments based on curricular goals, learner progression, and available resources.
Promote ethical, equitable, and defensible assessment practices across programs and courses.
Assessment Design & Technical Expertise
Translate desired learner outcomes into measurable performance indicators (e.g., session objectives, course objectives, program objectives, milestones, entrustable professional activities).
Develop and oversee assessment blueprints at the program, course, and individual learner levels.
Provide expert guidance on written assessments, simulation-based assessments, workplace-based assessments, grading rubrics, and standard setting.
Build frameworks and tools to support course directors and faculty in assessment design and implementation.
Align internal performance measures with external benchmarks, including USMLE, NBME examinations, and national survey data.
Learner Progression & Outcomes
Develop equitable thresholds for learner progression, enrichment, and remediation.
Create strategies to identify struggling and off-track learners and assess both short and long-term outcomes of remediation efforts.
Collaborate with Medical Student Affairs and Student Accessibility Services to ensure appropriate support and accommodations.
Assess long-term outcomes of the curriculum, including predictive indicators of student success.
Data Analysis, Reporting & Continuous Improvement
Analyze and interpret assessment data at the learner, course, and program levels.
Analyze external assessment and evaluation data (e.g., NBME, AAMC).
Communicate assessment findings to stakeholders through reports, dashboards, and presentations tailored to audience needs.
Use assessment data to inform curricular improvement and institutional decision-making.
Faculty Development & Scholarship
Develop and deliver faculty development programs on best practices in assessment.
Collaborate with faculty and leadership to publish and present innovations in medical education assessment.
Foster a culture of self-regulated and self-directed learning among learners and faculty.
Operational & Administrative Leadership
Lead and manage the day-to-day operations of the educational assessment enterprise.
Oversee assessment calendars, logistics, policies, procedures, scoring processes, and data maintenance.
Prepare, manage, and oversee budgets related to assessment operations.
Identify, evaluate, and manage external assessment vendors and contracts in collaboration with institutional purchasing teams.
Coordinate assessment activities with the Rush Clinical Skills and Simulation Center.
People Leadership
Provide direct supervision, mentorship, and professional development for assessment staff, including managers, coordinators, contractors, and student workers.
Oversee staffing, hiring, onboarding, and performance management.
Promote a culture of service, teamwork, learning, accountability, and continuous quality improvement.
Rush is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, and other legally protected characteristics.
Position Director of Educational Assessment
Location US:IL:Chicago
Req ID 27846