Project Summary
This research paper describes the architecture of CoShopper, a prototype of a system that employs AR as an intelligent guide that transforms the traditional grocery shopping into a personalized and rich user experience. CoShopper system adds a real-time digital layer to the traditional grocery store environment through the use of smart glasses. The main intention of our proposed system is to analyze the health status of the user then provide assistance in making healthy food choices to the fullest extent possible directly at the grocery store. Besides, CoShopper framework improves cost efficiency by featuring current discount deals offered by each individual grocery store.

Key Components
Our system involves several components that are collaboratively functioning to provide user-centric assistance while at the grocery store. These components are, first and foremost, the health organization that will be feeding our databases with up-to-date medical information including medical reports and lab results specific to every user of our system. Accessing such information allows CoShopper to become aware of the amount of each nutritional element that the user needs to maintain a healthy diet. Our intelligent system will also consider all the diagnosed food allergies data, and use them to warn the user from purchasing certain products. In other words, when facing products at the grocery store, our state-of-the-art system has the ability to directly distinguish between healthy and unhealthy products based on the user’s own health records. This feature is achieved through the integration between the user’s medical database and Nutritionix.com, which is the second component of CoShopper and the largest verified database of nutrition information in the world. Saving money is another feature that we considered in the development process. The usefulness of our system extends to display weekly-deals applied on certain items in real-time while at the grocery store. The autonomous flow of such data is derived from the connection between our system and each individual store’s up-to-date discount deals.
Augmented Reality (AR) Grocery Shopping - CoShopper Framework
Augmented Reality Grocery Shopping - Artifacts From The Future