The problem Soothsayer solves

CCTV footage or videos recorded by individuals are available for a lot crimes. But they are not utilized to their full potential. A few of these footages might directly be labelled as unusable because of low resolution or too much background noise and a lot of other factors.

Soothsayer will help you analyze a video using the following methods:

• You have a video(even a low resolution one), and you're sure you might find some object of interest in the video, but you're too busy to sit and watch the entire video. Even if you sit and watch the video, you might skip something by mistake, because after all, you're human. So we have provided an option to perform object detection on the entire video, in real-time which stores all frames with objects of interest.

• Now, you did get an object of interest, but since you're not a computer, you still feel it could have a higher resolution. So used those saved frames and increase their resolution using our super-resolution technique. It works almost in real-time, taking just 4-6 seconds to perform the operation on a frame.

• You already have a few images you want to analyze. Select them and run the super-resolution on your own custom images.

• And finally, you might have a video recording with sound in it too. Now there's a lot of interference in the background, a lot of sound sources. So, select the video and Soothsayer will extract the audio and split into sources so you can clearly hear the vocals and the background noise separately for gathering more information.

Challenges we ran into

• Training models from scratch took us a lot more time than we expected.
• We studied how super resolution actually works and implemented it ourselves which took a bit of time.
• We wanted a completely offline solution, a desktop app that could be used anytime, on any system, so we decided to make a GUI in python itself, which was the first time we used a package called PySimpleGUI for such a project. This part of making UI in python itself was one of the most challenging tasks.