Fall quarter 2022 CS147 project by Amrita, Defne, Kyla, Janet
Dishcovery is a mobile app that helps users identify, learn about, and cook with foreign ingredients.
Using an image recognition API within the app’s central scan function, it can identify ingredients that users cannot yet recognise. A user can leverage the “scan” button in the navigation bar to scan an ingredient they would like to learn more about.
Upon scanning an ingredient, the user will be able to view information about the ingredient’s origins, its flavour profile, its cultural context, and its health benefits. They can also access recipes using that ingredient and request recipes should they find that they cannot see a recipe they would like to use.
Some additional use cases for the app are: searching for dishes or recipes, searching by cuisine, manually searching by the name of an ingredient, and saving recipes they like for later use.
We anticipate that individuals may leverage this app in the grocery store or farmer’s market when they encounter an ingredient that they are unfamiliar with in order to learn more about it. We also support the use case of exploring new foreign foods to cook, both through keyword and filter search as well as based on an ingredient that they have scanned.
See the course website here: https://web.stanford.edu/class/cs147/projects/KeepingCultureAlive/Dishcovery/ See demo video here: https://www.youtube.com/watch?v=DagL9r_Kp08
This is a hi-fi prototype and not all features are complete.
- The list of recipes are hard-coded
- The cultural context for the ingredients is manually sourced
- The liked feature is not yet functional
- Not all recipe information has been added
- The image recognition is fully functional with Clarifai AI's food recognition library (~500 food items) but we have limited the results to those available in our cultural context dictionary (bitter melon, cardamom and lemongrass) for demo purposes. Ideally one could train a model specifically for ethnic ingredients
- The dietary preferences in the profile, filter and search features are not yet functional
https://medium.com/@danielsimandl/easy-object-detection-with-react-native-7c2e3f1b56a6 https://www.youtube.com/watch?v=W-Oqe8Ph_eM https://github.com/instamobile/recipes-app-react-native
