- 6 Sections
- 42 Lessons
- Lifetime
Expand all sectionsCollapse all sections
- MODULE 1: Foundations of AI Agents for Evaluators6
- MODULE 2: DESIGN & SPECIFICATION6
- 2.1Lesson 2.1 — Mapping Workflows & Risk Assessment
- 2.2Lesson 2.2 — AI Agent Suitability Scorecard
- 2.3Lesson 2.3 — Designing Inputs & Outputs for Validation
- 2.4Lesson 2.4 — Prompt Engineering with Validation
- 2.5Lesson 2.5 — Designing Agents for Evaluability
- 2.6Lesson 2.6 — Assignment: Complete Agent Design
- MODULE 3: IMPLEMENTATION & DEPLOYMENT7
- 3.1Lesson 3.1 — Build with ChatGPT
- 3.2Lesson 3.2 — Workflows in Make.com
- 3.3Lesson 3.3 — Debugging & Failure Points
- 3.4Lesson 3.4 Observability: How to See What Your AI Agent Actually Did
- 3.5Lesson 3.5 — Daily Use & When NOT to Trust AI
- 3.6Lesson 3.6 — Claude Skills: Automated Document Generation for M&E (Word, Excel, PowerPoint, PDF)
- 3.7Lesson 3.7 — Giving Claude a Crop Tool for Better Image Analysis (Charts, Forms, Maps)
- MODULE 4: VERIFICATION & RELIABILITY9
- 4.1Lesson 4.1 — From Prompts to Systems: How AI Agents Actually Think
- 4.2Lesson 4.2 – Why AI Agents Need Verification
- 4.3Lesson 4.3 – Checking Outputs Against Source Evidence
- 4.4Lesson 4.4 – Context Engineering for Reliable M&E Agents
- 4.5Lesson 4.5 – Building Validation Checklists and Quality Gates
- 4.6Lesson 4.6 Error Analysis: Finding and Classifying Agent Failures
- 4.7Lesson 4.7 — Building Evaluators: LLM-as-Judge and Human Validation
- 4.8Lesson 4.8 — Regression Testing & Continuous Evaluation
- 4.9Lesson 4.9 — Test and Improve Your AI Evaluation Agent
- MODULE 5: Practical AI Agents for M&E Workflows8
- 5.1Lesson 5.1 Evaluation Design Agent
- 5.2Lesson 5.2 Reporting Agent
- 5.3Lesson 5.3 — Qualitative Coding Agent
- 5.4Lesson 5.4 — Quantitative Analysis Agent
- 5.5Lesson 5.5 — Data Quality Agent
- 5.6Lesson 5.6 — Indicator Tracking and Donor Update Agent
- 5.7Lesson 5.7 — Learning, Recommendations, and Follow-Up Agent
- 5.8Lesson 5.8 — Accuracy, Reliability & Cost Optimisation
- PROJECTS, LABS AND QUIZ7
- 6.1Project I : Build, Evaluate & Improve an M&E AI Agent
- 6.2Project II: Daily M&E Intelligence Agent through Gmail
- 6.3Project III: AI-Assisted M&E Lifecycle
- 6.4Project IV: Build an AI Work Assistant in Hermes for Evaluators
- 6.5Application Labs & Case Studies
- 6.6Tutorials
- 6.7Quiz: Ai Agents for Evaluators10 Questions