DigiCollab Logo

From Feedback to Improvement

Measuring what matters

Evaluation closes the loop between planning and improvement. It transforms individual impressions into actionable insights, demonstrates impact to funders, and ensures every hackathon is better than the last.


END OF DAY 2 · 5–10 MIN

Experiences still vivid; highest response rate. Used to confirm findings and gather raw reactions.

3–7 DAYS AFTER

More considered responses on learning outcomes, skill development, and suggestions for improvement.

1–3 MONTHS AFTER

Captures whether skills were actually applied; career and educational changes; lasting attitude shifts.

FOUR ASSESMENT METHODS

Participants rate their own skills before and after using the DigComp framework.


Best for: self-perceived growth

Participants compile project artefacts, reflections, and documentation into a learning portfolio.


Best for: evidence of applied skills

Team members assess each other; mentors complete observation rubrics at end of each day.


Best for: collaborative skills

Short quiz before and after on theme-specific content; objective, comparable across cohorts.


Best for: conceptual learning

DIGICOLLAB CORE LEARNING OUTCOMES

Can use collaborative digital tools; created a digital prototype or presentation.

Applied a structured framework; iterated based on feedback.

Contributed to team decisions; presented work to a wider audience.

Considered environmental impact in solution design.

Designed for diverse user groups; considered accessibility.

Expressed increased confidence in ability to tackle open-ended challenges.

KEY PRINCIPLE

Impact occurs at multiple levels — individual, institutional, community, and systemic. Comprehensive impact analysis captures changes across all levels over time.

FIVE LEVELS OF IMPACT

Level 01

Individual

Skill development, confidence, career awareness, changed attitudes. Time horizon: Immediate – 12+ months.

Level 02

Team

Collaborative problem-solving, cross-cultural understanding, peer learning. Time horizon: Immediate – 6+ months.

Level 03

Institutional

Changes in pedagogy, new partnerships, adoption as a recurring format. Time horizon: 3 months – 2+ years.

Level 04

Community

Solutions addressing real local needs; VET–community connections. Time horizon: 6 months – 3+ years.

Level 05

Systemic

Contribution to European VET policy goals; replication; open dissemination. Time horizon: 1 year – 5+ years.

FEEDBACK AREAS

WHAT TO ASK

Overall rating (1–10) · Would you recommend this hackathon? · Best moment of the event?

Which skills did you develop? · Confidence before vs. after (1–5) · What surprised you most?

Which theme did your team focus on? · How well did you understand the challenge brief?

Team collaboration rating (1–10) · Did everyone contribute? · What made teamwork effective?

Mentor helpfulness (1–10) · Was guidance given at the right moments?

Venue and catering ratings · Was the schedule well-paced? · Were materials adequate?

Was the challenge clear and well-defined? · Was difficulty level appropriate?

What should we definitely keep? · What should we change? · What was missing?

DOCUMENTATION CHECKLIST

CAPTURE EVERYTHING

Thorough documentation ensures that the lessons, outputs, and memories of your hackathon outlast the event itself. Assign ownership for each category before the event begins.

FOUR DOCUMENTATION PHASES

Phase 01

Pre-Event

Objectives, budget, team roles, timeline, challenge briefs. Format: Planning folder · Shared cloud drive.

Phase 02

During

Photos, video of presentations, mentor logs, attendance records. Format: Photographer assigned · Cloud upload in real time.

Phase 03

Post-Event

Feedback forms, judging scoresheets, participant submissions, certificates. Format: Secure folder · GDPR-compliant storage.

Phase 04

Report

Executive summary, learning outcomes data, impact indicators, lessons learned. Format: Final Event Report (template in Annex).

FULL EVALUATION GUIDE

The Evaluation Phase is where learning becomes visible, impact is measured, and continuous improvement begins. Effective evaluation transforms a one-time event into a catalyst for ongoing innovation in VET education.

Evaluation is not an afterthought — it is an integral part of the learning cycle. What gets measured gets improved, and what gets documented gets shared and replicated.