AI and children's communication: criteria for respectful tool design

AI-generated image; illustrative scene.
A tool intended to support children’s communication should start with a concrete need and the participation of the person who will use it. Children do not all communicate in the same way or need the same features. A visual routine or synthesized voice may be options to explore; they do not necessarily require AI and are not appropriate for everyone.
UNICEF’s guidance on AI and children includes protecting data, involving children, explaining how systems work and supporting their well-being among its principles. These recommendations do not certify any particular application.
Before designing: what need are we supporting?
Talk with children, families and professionals who know the context; adapt participation to each child’s age and way of communicating. Describe an observable task, such as choosing between activities or preparing a phrase, and ask which tools already work. An application should not impose one way to communicate.
If considering a generative assistant, identify what it does, what information it receives, what errors it can produce and how a person can intervene. Explain understandably that the user is interacting with an AI system. Do not present its answers as a clinical assessment or a substitute for professional support arranged with the family.
Privacy and control: questions before a trial
- Data: What text, images or audio are collected, and why? Can the feature be used without unnecessary information?
- Sharing: What is processed on the device and what is sent to third parties? Check each feature; a “local” label does not guarantee the whole application works without a network.
- Access and withdrawal: Who can see the information, how long is it kept and how can it be corrected or deleted? Check terms and permissions before enabling an account.
- Errors: How can someone correct an incorrect output, stop the feature or continue without it? Keep an accessible alternative and a support person available where appropriate.
Adapt family or educator controls to the child’s age, needs and autonomy without turning support into unnecessary surveillance. Before testing with real data, involve responsible adults and check requirements applicable to the service and place of use.
A limit on our products
These are general design suggestions, not a list of features available in every IliciLabs application. ConversaYoung is presented as an application for caregivers in preparation; it does not diagnose or replace professional support; its product information does not describe it as an augmentative communication tool. Check its product page for its current status.
The useful test is not whether an AI sounds convincing, but whether a person can understand, correct or stop using the tool and whether it respects their needs and privacy.