Ukraine - Diia app and AI for identity verification
What Happened
The Ukrainian government deployed an advanced AI-driven facial recognition and identity verification system integrated into the national public services application "Diia." During the outbreak of the war in 2022, the system was used for critical citizen verification, digital signatures, and access to state compensation programs. The system was criticized after investigations revealed that it frequently misidentified citizens with facial injuries, older populations, and those in low-light conditions, leading to their immediate lockout from essential state compensation and emergency aid programs without accessible human appeal paths.
How MEG 1 would have acted
The facial recognition system failed the Dynamic Accuracy Index (DAI) audit due to its high error rate under low-light or stressful conditions and lack of reliable visual validation, violating the requirements of systemic accuracy and procedural fairness.
MEG 2 Analysis - Legal Framework
Agent level: N2 (management) - automated identification and decision-making system used by a public authority to verify identities and allocate emergency resources.
Cause (6.1):
(a) system defect - computer vision and classification flaws in the model leading to high false positive rates and lockout of vulnerable populations (design defect).
(b) autonomous decision error - the system's decision to lock out citizens based on opaque, unverified matching scores.
Attachment of liability: The public operator (Ministry of Digital Transformation) is fully liable for the wrongful lockout and denial of service caused by deploying an unverified, opaque system.
Procedural Mechanism
6.2 (architectural human confirmation): Decisions involving the denial or lockout of emergency benefits or national identity status must require architectural human confirmation. The AI can only suggest matches; a human officer must verify the identity before any lockout is finalized.
7.1 (independent forensics): The matching scores, original images, and the system's decision path must be securely logged in an unalterable ledger to allow for human rights and judicial audits.
9.4 (least privilege): The identification system was granted direct authority over citizen status without independent validation layers, violating safe operational boundaries.