Evaluating Nepali Sexual, Reproductive and Maternal Health Chatbot with LLMs(Large Language Models)
The primary objective of the 'AI for SRMH' project is to engage individuals through various chatbots. This intends to assess the ability, gaps, and risks of existing ChatGPT and similar open source LLMs in providing reliable responses to SRMH topics when chatting in Nepali language by two kinds of users in two settings: the General Public for their personal SRMH-related queries, and Female Community Health Volunteers (FCHVs) for providing counseling to their patients. This helps to find ways in bringing correctness, cultural sensitivities, and safety measures into the bot responses. The project aims to engage more than five thousand participants from diverse communities across different provinces of Nepal.