title: Test Methods for Robot Agility in Manufacturing.
abstract: OBJECTIVE
  The paper aims to define and describe test methods and metrics to assess industrial robot system agility in both simulation and in reality.
  
  
  METHODS
  The paper describes test methods and associated quantitative and qualitative metrics for assessing robot system efficiency and effectiveness which can then be used for the assessment of system agility.
  
  
  RESULTS
  The paper describes how the test methods were implemented in a simulation environment and real world environment. It also shows how the metrics are measured and assessed as they would be in a future competition.
  
  
  CONCLUSIONS
  The test methods described in this paper will push forward the state of the art in software agility for manufacturing robots, allowing small and medium manufacturers to better utilize robotic systems.
  The paper fulfills the identified need for standard test methods to measure and allow for improvement in software agility for manufacturing robots.
authors.affiliation: Intelligent Systems Division, National Institute of Standards and Technology, 100 Bureau Drive, Gaithersburg, MD 20899.
authors.forename: Anthony
authors.initials: A
authors.lastname: Downs
authors.affiliation: Intelligent Systems Division, National Institute of Standards and Technology, 100 Bureau Drive, Gaithersburg, MD 20899.
authors.forename: William
authors.initials: W
authors.lastname: Harrison
authors.affiliation: Intelligent Systems Division, National Institute of Standards and Technology, 100 Bureau Drive, Gaithersburg, MD 20899.
authors.forename: Craig
authors.initials: C
authors.lastname: Schlenoff