Visle
A visual learning tool that generates images in real-time as the teacher speaks
Created on 10th October 2020
•
Visle
A visual learning tool that generates images in real-time as the teacher speaks
The problem Visle solves
Researchers say visual memory is 60,000x times powerful than text/auditory memory and something which is grasped visually remains in our mind for very long time. Our current education system has become outdated and methodological, where teachers prepare their non-interactive lessons and present them in a lecturing and boring fashion. Inspired by the power of visual learning we wanted to create a tool that could converts teacher's lessons into easy to grasp Cliparts as the teacher speaks dynamically, to provide most immersive, engaging and visually enhanced learning experience to students. Hence, we created Visle, a visual learning tool. Let us now understand how our product is useful with a story.
Mr Lal is a primary class English teacher. One day he was teaching his students about different kind of birds. He started with the king of birds, Kingfisher🦆 and the conversation went like
Mr Lal: "Oncle lived a beautiful kingfisher on a big green tree..." Hearing this a lot of students raised questions and asked Student1: "Sir, how beautiful was the bird, the Kingfisher?" Student2: "Sir, did it have big wings?"
Hearing these questions, Mr Lal decided to take help of our visual assistant Visle. As he started teaching again, our tool listened to Mr lal and created cliparts having a beautiful kingfisher, a green tree and a big jungle in the background.
Mr Lal then said "When you learn, you visualize, when you visualize you remember!"
Challenges we ran into
Our main challenge was to design a generative neural network with following features
- Generate images suitable for illustration and teaching
- Generate images for a synonymous words for a rich visual experience
- Generate them rapidly for making it work in real-time
- To make images appropriate to display it to children
The next challenge was to make use of web sockets extensively in variety of tech stacks to make the whole thing work in real-time. Using sockets at such a degree also created a problem of securing them and their connection channels.