Snipiddy
Main Dev · AI
AI-powered dietary assistant for safer dining decisions.
- Client
- CS 411
- Timeline
- Jan to Mar 2025
- Stack
- Next.js (Frontend), FastAPI (Backend), Typescript, Supabase with raw SQL (Database), OpenAI-Vision (OCR), Large Language Models (LLM) for RAG
Overview
Snipiddy is a cutting-edge web application designed to empower users to make informed and safe dietary choices, especially when dining out. By leveraging advanced Artificial Intelligence, Snipiddy goes beyond basic allergy warnings, offering comprehensive insights into menu items tailored to individual needs.
Users simply input their dietary restrictions (such as specific food allergies or irritating ingredients) along with dietary preferences, specific diets (e.g., vegan, keto), or caloric goals. They then capture a photo of a menu, and Snipiddy's AI-powered scanner takes over. Within seconds, the application identifies potential allergens, analyzes nutritional content, and provides personalized dietary recommendations, ensuring users can confidently select their meals.
The core functionality involves Optical Character Recognition (OCR) to extract text from menu images, followed by an Augmented Retrieval Generation (RAG) search utilizing both a local comprehensive allergen database and a Large Language Model (LLM). This dual approach ensures highly accurate and contextually rich information regarding ingredients, potential allergens, and macronutrient content.
What I built
- Users can define specific food allergies, intolerances, dietary preferences (e.g., vegetarian, gluten-free), and macronutrient goals through personalized dietary profiles
- Advanced OCR (OpenAI-Vision) to accurately extract text and relevant data from menu images powers menu scanning
- Supabase authentication with Google OAuth, allowing users to quickly and securely sign in with their Google accounts
Tech
Product flow
Welcome
Welcome to Snipiddy! Let's help you make safer dining choices
1. Sign Up with Email
Enter your email address and we'll send you a verification code to complete your registration
2. Set Up Your Profile
Customize your dietary profile by selecting allergens, dietary preferences (like vegan or keto), and set your macro nutrient goals for personalized recommendations
3. Just Scan
Simply point your camera at any restaurant menu and wait a few seconds while our AI analyzes the items and provides personalized recommendations based on your dietary profile
That's it!
Search through the menu, apply filters, and instantly see which items match your dietary restrictions. That simple!
Important Health Disclaimer
Snipiddy is not FDA approved and should not replace professional medical advice. Always consult a healthcare professional or allergist and verify information directly with restaurants for your safety.
Video
CS 411 Project Demo
Screens
Next project
Smart Bike Lock · IoT