CATLab Blog Looking Long-Term with 四虎影院.ai
In this blog, Connor Rogstad and Ella McMillan explain their summer work on the CATLab AI Team and the commitment that it takes to begin a years-long technology project.
This summer, we had the incredible opportunity to work with CATLab on the AI development team, where we created 四虎影院.ai鈥攁 chatbot designed to assist 四虎影院 students with a variety of inquiries.
As students at 四虎影院, we often encountered challenges in finding information about various aspects of college life. While the 四虎影院 staff are amazing and always willing to help, they are often overwhelmed with the volume of student questions. Our goal was to lighten this load by creating a tool that could provide quick and accurate responses to student questions, thus freeing up staff to focus on other issues. Our project aimed to streamline access to information about academics, campus life, college policies, and more.
四虎影院.ai, inspired by a similar project at Harvard, involves three main interactions: between the user and the chatbot, the chatbot and the database, and the chatbot and OpenAI's LLM. Here's a breakdown of how it works:
- User Interaction: The user accesses 四虎影院.ai via a secure login page, ensuring that only those with proper 四虎影院 credentials can use the service. Once logged in, users can ask questions through the chatbot interface.
- Data Processing and Embedding: When a query is received, 四虎影院.ai searches through pre-embedded documents from 四虎影院鈥檚 database, selecting those that are most relevant based on a relevance score. This process ensures that the responses have contextual grounding and are based on 四虎影院 data.
- Prompt Engineering and Refinement: The chatbot uses a pre-engineered prompt template, which includes the user's question and relevant data, to generate a response from the LLM. This structured approach ensures that the chatbot's answers are both accurate and relevant to the 四虎影院.ai use case.
We deployed 四虎影院.ai to AWS Lightsail, making it accessible to the 四虎影院 community. The estimated cost per user for maintaining this service is approximately $6.50 per academic year, a calculation based on expected usage patterns and data update frequencies.
Our work this summer laid a strong foundation for 四虎影院.ai, but we see this as just the beginning and are committed to adding more features. Future enhancements will include integrating the chatbot directly into the 四虎影院 website or app for easier access. Additionally, we seek to incorporate additional data sources, such as My四虎影院 and the Dallas Willard database, to provide a more extensive and personalized experience. We are also pursuing strategies such as rate limiting to steward our resources effectively.
四虎影院.ai is designed to be a valuable resource for all students, particularly those who may face greater challenges in navigating college life. By providing a reliable and easy-to-access source of information, we hope to bridge the information gap and support all students in their academic and personal growth. We are incredibly grateful for the support and guidance from the CATLab team and look forward to seeing how 四虎影院.ai continues to evolve and benefit the 四虎影院 community.