Overall System Performance
To quantify system performance, we developed a script to automatically log each sandwich assembly and, using the sensing placement check functionality, determine if the assembly meets our performance requirements or not. This data is saved to a csv file for later analysis. A snippet from this logging file is shown in Figure 1.
After perming 155 assemblies, we consolidated the results into the metrics displayed in Figure 2. Note that the success rate displayed here is most likely lower than reality, as this log includes many failure cases that we induced intentionally. Even still, the success rate of 72.9% is well above the 66% threshold.
In addition to the system performance, we built the kiosk to accommodate our non-functional requirements. The system is portable, as it sits on wheels, and is food safe, as all materials used in the assembly are food grade. However, we have not yet gotten the system NSF certified, and will make the determination whether or not to pursue this in the fall semester.
SVD and SVD Encore Performance
In Table 1 below, we capture the desired and actual ingredients placed for each demonstration we performed. While we had three demonstrations during both SVD and SVD Encore, the third demo involved intentionally inducing failure cases, so those assemblies will not be included. All other demonstrations were successful, giving the system a 100% sandwich assembly success rate, which is greater than the 66% threshold we had set for a successful system.
| Desired Ingredient Placements | Successful Ingredient Placements | Meets Success Criteria (75%)? | ||
| SVD | Demo 1 | 2 | 2 | Y |
| Demo 2 | 4 | 4 | Y | |
| SVD Encore | Demo 1 | 4 | 4 | Y |
| Demo 2 | 4 | 3 | Y |