banner
MIDS Capstone Project Fall 2024

AI ArtBuddy

ArtBuddy is a personalized AI art tutor that makes creative education accessible to children ages 8-10. The platform enables kids to upload artwork, practice storytelling through art, and develop visualization techniques with AI guidance. Parents can monitor progress and manage data, ensuring a safe learning environment. Our mission is to democratize art education, fostering creativity and self-expression for the next generation.

Problem and Motivation

Art education is a powerful tool for developing children’s creative confidence, technical skills, and cultural awareness. However, personalized art instruction remains inaccessible to many children.

Research shows that 1-on-1 tutoring can significantly enhance learning outcomes, improving results by up to two standard deviations (two-sigma problem). Yet, children often miss out on the benefits of personalized art education due to:

  1. High costs: Art tutoring can be 20-30% more expensive than tutoring in other subjects, creating financial barriers.
  2. Limited access to skilled art instructors: Qualified art teachers are in short supply, making 1-on-1 instruction rare.

Without accessible, individualized tutoring, children lack opportunities for tailored skill development, creative risk-taking, and building attention and focus—all of which are critical for fostering artistic growth and confidence. This project seeks to bridge this gap, making personalized art education accessible to all children, regardless of socioeconomic background.

Solution & Data Science Approach

Prompt engineering plays a crucial role in creating a personalized interaction for users, as various AI agents collaborate to deliver a tailored art experience aligned with individual goals and artistic styles. Each agent, including the Router, Critic, Storyteller, and Visual Artist, employs specialized prompts designed to suit its specific function, ensuring optimal responses and enhancing the overall user experience. The use of positive feedback reinforces creativity and encourages active participation, while the Semantic Router intelligently directs users to the most suitable specialized agent based on their objectives, facilitating a seamless and enjoyable artistic journey.

Evaluation

The AI ArtBuddy application underwent a two-phased evaluation process. Initially, during the development phase, individual AI agents (Supervisor, Storyteller, Critic, and Visual Artist) were assessed using performance metrics tailored to their specific functions. Following the development phase, once a beta version of the application was released, we collected comprehensive feedback from both parents and children through dedicated surveys. These surveys captured a holistic view of the user experience, encompassing overall satisfaction, engagement levels, the perceived clarity and helpfulness of the AI tutor's feedback and suggestions, and the ease of using the application's features. The results of these parent and child surveys provided invaluable insights into the application's effectiveness.

Of the 6 participants, from the child survey, 100% enjoyed and liked their art from the art session. Also, 100% of them would be interested in doing another session in the near future.

Number of Child Users (Beta Testing)

Age8910
# of Users212

Parent Survey (5 responses)

  • Rating child's experience
    • 80% - Excellent
    • 20% - Good
  • Checking for engagement and interest throughout the session
    • 80% - Very engaged
    • 20% - Somewhat engaged
  • Checking if AI tutor provided helpful feedback and suggestions to the child
    • 100% - Very helpful
  • Would recommend AI art tutoring application to other parents
    • 80% - Yes, definitely
    • 20% - Yes, probably
  • Ease of use, rating from 1-5 (1 = very hard / 5 = very easy)
    • 80% - 4 (Easy)
    • 20% - 3 (Moderate)

Key Learnings & Impact

Throughout this project, we learned several key lessons on development of an AI application specifically designed for children. We learned that prompt engineering and few shot prompting is an efficient and cost effective way to specialize generative AI models without requiring large amounts of computational power or full model retraining. We also found that parental controls and privacy are not merely additional features but fundamental requirements for child application design, including consent management, data transparency, data updates, and data deletion. A significant technical challenge we addressed was managing conversational context limits, which required developing strategies to handle extended interactions without losing necessary contextual information. These insights have broad implications for future development of AI-powered educational tools, particularly those aimed at young users.

Future Work

Looking ahead, several potential enhancements could be explored with additional time and resources. Integrating audio and voice capabilities would make the application accessible to pre-reading age children, significantly expanding its reach. More sophisticated features could include dynamic difficulty adjustment that responds to individual user progress and learning patterns. Technical refinements would ideally focus on optimizing the LLM packages for better efficiency and reducing memory usage. Additionally, collaboration with an art professional could enhance the visual elements, while the integration of a direct drawing canvas would allow for more natural artistic interaction.

Acknowledgements

We extend our heartfelt gratitude to our capstone instructors, Zona Kostic and Morgan Ames, for their invaluable feedback and guidance throughout the semester. Additionally, we are deeply thankful to the parents who allowed their child(ren) to test our application. Their participation in our beta testing phase was instrumental to our success. This project would not have been possible without their support and active involvement at every stage.

Privacy

The application serves as an interactive art tutor, accessible online with or without adult supervision. It collects a range of data, including user registration details, artwork submissions, and user interactions, to tailor educational experiences. This Privacy Impact Assessment addresses potential risks associated with data breaches, misuse, algorithmic bias, and inappropriate content, and outlines mitigation strategies such as securing parental consent, ensuring data transparency, and implementing protective measures to comply with regulations like COPPA, CCPA, and SOPIPA. Through robust data protection and transparency, the application aims to foster a safe and enriching learning environment for young artists.

For more details, please click on the 'Privacy Impact Assessment' link at the bottom of the page in the 'More Information' section.

Last updated: December 20, 2024