Frision Is an app that allows users to take photos of their fridges. It uses Computer vision to analyze everything in their and then find recipes the user can make with that. Hence the name frision, Fridge+vision = Frision
Added an Object classifier
Once the object detector detects the images I use pillow to crop into them and use a classifier with 900 items to classify that food it has really good accuracy, an average photo of a fridge has about 50+ items
Breakthrough in my project :)
I am finally able to detect a lot of objects clustered together easily, now the next phase is actually checking what each of those objects are
Managed to figure out how to get a Computer Vision Model Working on my computer
after ages of searching for pretrained models that are fast, free and can detect a large number of classes. I found a YouTube video explaining Grounding Dino. I think it might be the savior of all of computer vision or at least my project, i managed to install the hugging face version of it to be able to analyze images of fridges and list out all items currently in it. Had to find a list of foods which I found on USDA as there common grocery foods. Around 900 of the most common foods, I tried using AI models, such as qwen or gemini, but they took way to long and burned through tokens.
Right now Grounding Dino is not able to handle 900 inputs so I will have to figure out how to batch the classes.
