The problem Talk To Videos solves

Learning on YouTube is now easier. You can directly ask questions to a video or playlist and then get them answered as well as get the appropriate timestamp to jump to and get the full context. This will save 100s of hours for people who use YouTube as a study or learning tool.

You can also use the tool to find a particular timestamp you're looking for in a video or playlist.

tl;dr:
A search engine that works inside YouTube videos.

• Learn from videos and playlists on YouTube quickly and effectively
• Find the exact timestamp in a video you are looking for easily

Challenges I ran into

• Working with Chrome extensions is a pain in general :/ Spent most of my time making it work there. DX for extensions needs to be severely improved.
• Another issue was feeding large videos into the model (attention limitation). Workaround was to feed the video via a map reducer.