I

icWeb

An automated virtual assistant for people with visual impairements

I

icWeb

An automated virtual assistant for people with visual impairements

The problem icWeb solves

People with visual impairements are restricted in tasks that are common-place for other people, web browsing is one of them. There are some solutions on the market, but all of these rely on screen readers and heavily use a keyboard interace for user commands, for these people lerning the keyboard shortcuts is a real challenge, we aim to create an entirely voice based interface to access the most popular websites on the internet. Users will be able to issue voice commands to control the browser, the contents of which will be read out to them. We have added convenient features like - Wikipedia articles can be queried using a state of the art machine learning model for question answering, and they can also be summarised.

Challenges we ran into

  1. Scraping websites to gather only useful data which can be presented in a meaningful way to the user
  2. As we could find no screen reader that could be programatically controlled by python scripts, we had to scrape each website and basically create our own screen reader.
  3. We could find no research articles for this topic online, thus, we had to ideate and plan everything ourselves and hope that it would work out.

Discussion