RSS 2022 Workshop

Envisioning an Infrastructure for Multi-Robot and Collaborative Autonomy Testing and Evaluation


Recent years have seen significant progress made in standardizing robot software, thanks to ROS and its associated simulation tools such as Gazebo. This has enabled researchers to build on each other’s work without having to reinvent the wheel. Nevertheless, there is a critical lack of infrastructure when it comes to multi-robot systems and collaborative autonomy. The key question that we would like to discuss at this workshop is: what should the testing and validation infrastructure for multi-robot and collaborative autonomy look like.

Researchers who are inventing and enhancing new collaboration algorithms sometimes resort to testing their innovations on a small set of simplified scenarios that they have used in their previous work in order to reduce the time and cost of testing. Such testing may be merely a demonstration that the collaboration algorithm works; it may not yield comparisons with existing algorithms that generate insights into the performance and cost tradeoffs; and it may not consider a broad enough set of missions and scenarios needed for test and evaluation, validation and verification (TEVV). The multi-robot systems community needs an infrastructure that supports system development and testing from concept to realization in multiple domains. The goal of this workshop is to bring together researchers and practitioners to understand the infrastructure needs of collaborative autonomy testing.

The University of Maryland recently received a planning grant from the CISE Community Research Infrastructure (CCRI) program to envision what an Infrastructure for Collaborative Autonomy Testing (ICAT) would look like. Through this workshop, we seek to foster a discussion with the broader community, understand the needs of the stakeholders, and identify effective resources that might be incorporated into ICAT. Through this workshop, a larger portion of the CISE MRS research community will be able to participate in the design of ICAT.

Invited Speakers

Prof. Sebastian Elbaum

University of Virginia

Dr. Simon Jones

University of Bristol

Dr. Wolfgang Hönig

TU Berlin

Dr. James Michaelis

Army Research Lab

Prof. Amanda Prorok

Cambridge University

Dr. Morgan Quigley

Open Robotics

Call for Contributions

We invite participants to submit their research in RSS format (up to 4 pages including figures, excluding references). We encourage the submission of early ideas, late-breaking results, position papers, or open research questions that are likely to generate interesting discussions. Accepted papers will be presented in a poster session and selected papers as spotlight talks. All submitted contributions will go through a single blind review process.

Discussion Topics

The specific goals of the workshop will be to discuss ideas around following topics:

  • The need for infrastructure for multi-robot systems (MRS) research and collaborative autonomy test and evaluation;
  • Hardware and software system architecture for Infrastructure for Collaborative Autonomy Testing (ICAT) and use cases for the infrastructure;
  • Technologies that can be used as part of the ICAT; their strengths and opportunities for improvement.


Please email submissions (in PDF format) to:

RSS Submission Template:

For more information, see

Important Dates

  • Submission deadline: May 30, 2022 (Anywhere on Earth).
  • Notification of acceptance (rolling basis): June 10, 2022.
  • Camera Ready Submission: June 22, 2022.
  • Workshop day: July 1, 2022.


Jeffrey Herrmann

University of Maryland

Craig Lawrence

Applied Research Laboratory
for Intelligence and Security

Dinesh Manocha

University of Maryland

Derek Paley

University of Maryland

Adam Porter

University of Maryland

Pratap Tokekar

University of Maryland

Nare Karapetyan

University of Maryland