Khet Sarathi - The all-in-one Agentic Farm Assistant

Khet Sarathi is an intelligent WhatsApp-based farming assistant that helps Indian farmers with crop advisory, market prices, weather information, government schemes, and image analysis of Mandi receipts, legal document understanding, fertilizer component analysis and many more features using Sarvam AI and Gemini technologies.

Features

🌾 Core Capabilities

• Multi-language Support: Hindi, Bengali, Tamil, Telugu, Kannada, Malayalam, Gujarati, Punjabi, Marathi, Urdu, and English
• Voice & Text Communication: Speech-to-text and text-to-speech in Indian languages
• Image Analysis: Fertilizer packet component analysis, soil test reports, mandi receipts, and crop photos to check for pests and diseases.
• Market Intelligence: Real-time mandi prices and MSP comparisons using custom tool calling.
• Weather Advisory: Location-based weather forecasts with farming recommendations.
• Government Schemes: Information about PM-KISAN, crop insurance, and credit schemes.

• The biggest hurdle was the Twillio Whatsapp API highly restrictive 24 hour rate limits of just 9 messages. This made prototyping and testing of responses hard.

• Twilio Whatsapp Outgoing messages kept failing continuously for a long time due to not being able to deliver the entire Audio response. The main USP of my project is that it has multimodal input but audio responses to make the UX more intuitive and easy for the time crunched farmers. I had to come up with a chunking scheme in order to maintain the audio formating without compromising on the Audio quality by highly conservative compression (I had tried the compression method but it degraded the quality of the audio by a lot).