The problem Saarthi: Q&A System solves

Saarthi is an end to end LLM project based on Google Palm and Langchain. We are building a Q&A system for tech enthusiasts for personalized guidance /ed tech company Which sells data related courses and bootcamps.There are several use cases associated with this FAQ System.WE can reduce the manual work and websites do not have to rely upon emails for extended support.

Challenges we ran into

Securing and managing the Google API key for access to the language model was a security and operational challenge.
How We Overcame It: We implemented secure key management practices, including encryption and access control. Regular monitoring and auditing of key usage helped maintain security.

Integration with Langchain and Google Palm: Integrating and fine-tuning Langchain and Google Palm models presented another challenge. These cutting-edge models require careful configuration and parameter tuning to achieve optimal performance.
How We Overcame It: We extensively tested various configurations to fine-tune the models. This process involved adjusting hyperparameters, experimenting with different embeddings, and optimizing the models to ensure they provided accurate and relevant answers. we have also used prompt responses to eliminate hallucination with the model.