{"id":284,"date":"2015-10-23T14:02:16","date_gmt":"2015-10-23T18:02:16","guid":{"rendered":"http:\/\/mrsdprojects.ri.cmu.edu\/2015teami\/?page_id=284"},"modified":"2015-12-17T19:28:50","modified_gmt":"2015-12-18T00:28:50","slug":"fall-system-validation-experiments","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teami\/fall-system-validation-experiments\/","title":{"rendered":"Fall Validation Experiments"},"content":{"rendered":"<h1><\/h1>\n<h2>Fall Performance<\/h2>\n<h3>Demo 1<\/h3>\n<h3>\n<table id=\"tablepress-13\" class=\"tablepress tablepress-id-13\">\n<thead>\n<tr class=\"row-1\">\n\t<th class=\"column-1\">Task<\/th><th class=\"column-2\">Success Criteria<\/th><th class=\"column-3\">FVE Performance<\/th>\n<\/tr>\n<\/thead>\n<tbody class=\"row-striping row-hover\">\n<tr class=\"row-2\">\n\t<td class=\"column-1\">\u201cPark\u201d command sent to the mobile platform using the Android app<\/td><td class=\"column-2\">LED blinks to indicate command received<\/td><td class=\"column-3\">Task completed successfully at FVE Encore<\/td>\n<\/tr>\n<tr class=\"row-3\">\n\t<td class=\"column-1\">Vehicle begins locomotion upon receiving the command<\/td><td class=\"column-2\">Vehicle moves forward<\/td><td class=\"column-3\">Task completed successfully at FVE Encore<\/td>\n<\/tr>\n<tr class=\"row-4\">\n\t<td class=\"column-1\">\u201cReturn\u201d command sent to the mobile platform via the Android app<\/td><td class=\"column-2\">Vehicle moves backward to original location<\/td><td class=\"column-3\">Task completed successfully at FVE Encore<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<!-- #tablepress-13 from cache --><\/h3>\n<h3>Demo 2<\/h3>\n<h3>\n<table id=\"tablepress-14\" class=\"tablepress tablepress-id-14\">\n<thead>\n<tr class=\"row-1\">\n\t<th class=\"column-1\">Task<\/th><th class=\"column-2\">Success Criteria<\/th><th class=\"column-3\">FVE Performance<\/th>\n<\/tr>\n<\/thead>\n<tbody class=\"row-striping row-hover\">\n<tr class=\"row-2\">\n\t<td class=\"column-1\">\u201cPark\u201d command sent to the mobile platform using the Android app<\/td><td class=\"column-2\">LED blinks to indicate command received<\/td><td class=\"column-3\">Task completed successfully at FVE Encore<\/td>\n<\/tr>\n<tr class=\"row-3\">\n\t<td class=\"column-1\">Navigation direction set on second SBC<\/td><td class=\"column-2\">Platform moves according to set direction<\/td><td class=\"column-3\">Collaboration using XBees working as a complete subsystem<\/td>\n<\/tr>\n<tr class=\"row-4\">\n\t<td class=\"column-1\">Platform navigates to second position<\/td><td class=\"column-2\">Vehicle moves forward or backward, as appropriate<\/td><td class=\"column-3\">Not demonstrated, as it is dependent on XBee collaboration<\/td>\n<\/tr>\n<tr class=\"row-5\">\n\t<td class=\"column-1\">While navigating to the spot, the vehicle will encounter an obstacle and stop within a safe distance of the obstacle<\/td><td class=\"column-2\">Vehicle does not collide with obstacle<\/td><td class=\"column-3\">Task completed successfully at FVE Encore<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<!-- #tablepress-14 from cache --><\/h3>\n<p>&nbsp;<\/p>\n<h2>\u00a0Validation Experiments<\/h2>\n<p>The system validation experiments are used to ensure that all system-level requirements are met.\u00a0 Below, experiments are divided by the component that they will be validating.<\/p>\n<h2><a name=\"_Toc433289587\"><\/a>Sensor<\/h2>\n<h3><strong>IR<\/strong><\/h3>\n<ul>\n<li><strong>Test:<\/strong> Place pre-defined obstacles at different orientations, distances, and angles with respect to the sensor and log the readings. Confirm that the readings match the correct orientations, distances, and angles.<br \/>\n<strong>Requirement Validated<\/strong>: MF.9<\/li>\n<\/ul>\n<h3><strong>Kinect<\/strong><\/h3>\n<ul>\n<li><strong>Test:<\/strong> Map a known environment and note the discrepancies between the actual and logged data. Note the resolution of the map.<br \/>\n<strong>Requirement Validated<\/strong>: MF.8<\/li>\n<\/ul>\n<h2><a name=\"_Toc433289588\"><\/a>Communication<\/h2>\n<h3><strong>Bluetooth<\/strong><\/h3>\n<ul>\n<li><strong>Test:<\/strong> Ensure Bluetooth device is recognized by the smartphone. Transmit serial data between phone and the microcontroller and confirm that it receives the transmissions correctly.<br \/>\n<strong>Requirement(s) Validated<\/strong>: MF.1<\/li>\n<\/ul>\n<h3><strong>Wireless Network<\/strong><\/h3>\n<ul>\n<li><strong>Test 1:<\/strong> Transmit a list of 10 elements between multiple ROS-masters over a Wi-Fi network. Each ROS master will change a different element in the list.\u00a0 Each ROS will receive the updates and will have identical lists.<br \/>\n<strong>Requirement(s) Validated<\/strong>: MF.2, MN.1, MN.5, DN.1<\/li>\n<\/ul>\n<ul>\n<li><strong>Test 2:<\/strong> Send vehicle to parking spot. Turn off Bluetooth and Wi-Fi.\u00a0 Vehicle attempts to reconnect while maintaining course.\u00a0 After 25 seconds, turn on Bluetooth and Wi-Fi.\u00a0 Vehicle reconnects successfully and maintains course.<br \/>\n<strong>Requirement(s) Validated<\/strong>: MN.2<\/li>\n<\/ul>\n<ul>\n<li><strong>Test 3:<\/strong> Send vehicle to parking spot. Turn off Bluetooth and Wi-Fi.\u00a0 Vehicle attempts to reconnect while maintaining course.\u00a0 After 30 seconds of no connection, vehicle changes course to exit queue. Vehicle continues to attempt to connect at longer intervals.<br \/>\n<strong>Requirement(s) Validated<\/strong>: MN.2<\/li>\n<\/ul>\n<h3><strong>Parking Spot Matrix<\/strong><\/h3>\n<ul>\n<li><strong>Test:<\/strong> Transfer a multidimensional array representing the parking spots in the lot between the single board computers and populate it with relevant data. Make some changes to the matrix and log how that affects the contents of the matrix.\u00a0 Ensure that the changes made on one board are carried over to the other boards.<br \/>\n<strong>Requirement(s) Validated<\/strong>: MF.2, DF.1<\/li>\n<\/ul>\n<h2><a name=\"_Toc433289589\"><\/a>Android App <strong>Interface<\/strong><\/h2>\n<h3><strong>Phone to Car<\/strong><\/h3>\n<ul>\n<li><strong>Test:<\/strong> Transmit a command, either \u201cPark\u201d or \u201cReturn\u201d from the Android App to the microcontroller by pressing the appropriate button from the app. Ensure that the command is received at the other end and that the appropriate vehicle responds in the appropriate manner.<br \/>\n<strong>Requirement(s) Validated<\/strong>: MF.1<\/li>\n<\/ul>\n<h2><a name=\"_Toc433289590\"><\/a>Locomotion<\/h2>\n<h3><strong>Acceleration Control<\/strong><\/h3>\n<ul>\n<li><strong>Test:<\/strong> Make the vehicle move slowly, normally, and quickly. Note the time taken and distance travelled.\u00a0 Make the vehicle come to a complete stop quickly and slowly.\u00a0 Note the nature between speed control commands and how they affect actual speed of the system.<br \/>\n<strong>Requirement(s) Validated<\/strong>: DF.4<\/li>\n<\/ul>\n<h3><strong>Deviation between instructed and actual motion<\/strong><\/h3>\n<ul>\n<li><strong>Test:<\/strong> Give a combination of commands to the platform and note the deviation from the desired position. Iterate multiple times and see if there is some predictable trend.<br \/>\n<strong>Requirement(s) Validated<\/strong>: MF.3<\/li>\n<\/ul>\n<h2><a name=\"_Toc433289591\"><\/a>Parking Spot \u2013 Entering and Exiting<\/h2>\n<ul>\n<li><strong>Test 1<\/strong>: Send the vehicle to a spot with both adjacent spots occupied. The vehicle backs into the space within two tries.\u00a0 When the vehicle is parked, it is 100% within the parking spot boundaries and within 35\u00ba of parallel to both the neighboring vehicles.\u00a0 Send the vehicle to the exit.\u00a0 The vehicle exits the spot within two attempts without coming into contact with nearby vehicles or the infrastructure.<br \/>\n<strong>Requirement(s) Validated<\/strong>: MF.6, MF.7, MN.3, MN.4, DN.3<\/li>\n<li><strong>Test 2<\/strong>: Send the vehicle to a spot with one adjacent spot occupied. The vehicle backs into the space within two tries.\u00a0 When the vehicle is parked, it is 100% within the parking spot boundaries and within 35\u00ba of parallel to the neighboring vehicle on one side and the parking spot line on the other side.\u00a0 Send the vehicle to the exit.\u00a0 The vehicle exits the spot within two attempts without coming into contact with nearby vehicles or the infrastructure.<br \/>\n<strong>Requirement(s) Validated<\/strong>: MF.6, MF.7, MN.3, MN.4, DN.3<\/li>\n<li><strong>Test 3<\/strong>: Send the vehicle to a spot with both adjacent spots unoccupied. The vehicle backs into the space within two tries.\u00a0 When the vehicle is parked, it is 100% within the parking spot boundaries and within 35\u00ba of parallel to the parking spot boundaries.\u00a0 Send the vehicle to the exit.\u00a0 The vehicle exits the spot within two attempts without coming into contact with nearby vehicles or the infrastructure.<br \/>\n<strong>Requirement(s) Validated<\/strong>: MF.6, MF.7, MN.3, MN.4, DN.3<\/li>\n<\/ul>\n<h2><a name=\"_Toc433289592\"><\/a>Power Subsystem<\/h2>\n<h3><strong>Connections to PCB are secure<\/strong><\/h3>\n<ul>\n<li><strong>Test:<\/strong> Use a multimeter to check all the connections.<br \/>\n<strong>Requirement(s) Validated<\/strong>: MN.7<\/li>\n<\/ul>\n<h3><strong>Power is constant with no fluctuation<\/strong><\/h3>\n<ul>\n<li><strong>Test:<\/strong> Note the nature of voltage being supplied through an oscilloscope. Ensure there are no fluctuations.<br \/>\n<strong>Requirement(s) Validated<\/strong>: MN.7<\/li>\n<\/ul>\n<h2><a name=\"_Toc433289593\"><\/a>Mapping<\/h2>\n<ul>\n<li><strong>Test 1:<\/strong> Place markers at predefined locations and map the area. Compare their position in the map to their actual physical location and ensure it is correct.<br \/>\n<strong>Requirement(s) Validated<\/strong>: MF.8<\/li>\n<li><strong>Test 2:<\/strong> Upload the map generated to the SBC and visualize with RViz.<br \/>\n<strong>Requirement(s) Validated<\/strong>: MF.8<\/li>\n<\/ul>\n<h2><a name=\"_Toc433289594\"><\/a>Localization<\/h2>\n<ul>\n<li><strong>Test 1:<\/strong> Have the vehicle circle the parking lot. Compare actual location to computed location every 30 seconds to ensure there are minimal errors.\u00a0 Continue to have the vehicle circle for approximately 10 minutes to ensure there are no compounded errors.<br \/>\n<strong>Requirement(s) Validated<\/strong>: MF.3, DN.2<\/li>\n<li><strong>Test 2:<\/strong> Place the vehicle at different locations and note the localization readings. Make the vehicle move to different locations and note the localization readings.<br \/>\n<strong>Requirement(s) Validated<\/strong>: MF.3, DN.2<\/li>\n<\/ul>\n<h2><a name=\"_Toc433289596\"><\/a>Obstacle Detection<\/h2>\n<h3><strong>Send and Receive Movement Information<\/strong><\/h3>\n<ul>\n<li><strong>Test 1:<\/strong> Send a Return command to a vehicle. Ensure that the vehicle publishes a message to other vehicles on the network that it is exiting the parking spot.\u00a0 Nearby vehicles that are parking will yield right of way to the exiting vehicle, allowing it enough space to exit the spot safely and efficiently.<br \/>\n<strong>Requirement(s) Validated<\/strong>: MF.2<\/li>\n<li><strong>Test 2:<\/strong> When a vehicle is entering a parking spot, nearby vehicles maintain a safe distance to avoid collision and give the parking vehicle adequate space to park safely and efficiently.<br \/>\n<strong>Requirement(s) Validated<\/strong>: MF.2<\/li>\n<\/ul>\n<h3><strong>Avoid Infrastructure<\/strong><\/h3>\n<ul>\n<li><strong>Test<\/strong>: Have the vehicle circle the parking lot. The vehicle maintains a safe distance from the infrastructure of the parking lot and parked vehicles.\u00a0 Place an object in the vehicles path.\u00a0 The vehicle stops within 3 seconds of detecting the obstacle.<br \/>\n<strong>Requirement(s) Validated<\/strong>: MF.8, MF.9, MF.10, DF.4<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Fall Performance Demo 1 Demo 2 &nbsp; \u00a0Validation Experiments The system validation experiments are used to ensure that all system-level requirements are met.\u00a0 Below, experiments are divided by the component that they will be validating. Sensor IR Test: Place pre-defined obstacles at different orientations, distances, and angles with respect to the sensor and log the<br \/><a class=\"moretag\" href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2015teami\/fall-system-validation-experiments\/\">+ Read More<\/a><\/p>\n","protected":false},"author":12,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"template_parts\/page-fullwidth_template.php","meta":{"footnotes":""},"class_list":["post-284","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teami\/wp-json\/wp\/v2\/pages\/284","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teami\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teami\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teami\/wp-json\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teami\/wp-json\/wp\/v2\/comments?post=284"}],"version-history":[{"count":6,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teami\/wp-json\/wp\/v2\/pages\/284\/revisions"}],"predecessor-version":[{"id":518,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teami\/wp-json\/wp\/v2\/pages\/284\/revisions\/518"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teami\/wp-json\/wp\/v2\/media?parent=284"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}