The Development, Test, Evaluation, Verification & Validation (DTEVV) Workshop

DTEVV Workshop
February 4-5, 2026
California, MD

Please Note: Due to the government shutdown, this workshop (originally scheduled for November 17-18, 2025) will now be held February 4-5, 2026.

The DTEVV Workshop will be held February 4-5, 2026 at the USMSM SMART Building.

This event will map out the priority research and workforce challenges that need to be addressed to advance the DTEVV of autonomous technologies.

You must be registered to attend. Registration closes January 21, 2026.

Technology continues to rapidly evolve, including the prominent integration of intelligent/autonomous capabilities. Systems - including those intended for the military, homeland security, and first response domains - are moving closer to greater intelligence every day. Every emergent capability and system require some form of assessment; current test and evaluation practices are unable to keep pace with this evolution. The result is a slowdown in the development, assessment, certification, and adoption of these technologies.

The Development, Test, Evaluation, Verification & Validation (DTEVV) Workshop will bring together T&E and autonomous systems professionals from the United States government, academia, and industry to map out the priority research and workforce challenges that need to be addressed to advance the DTEVV of these technologies.

As a workshop participant, you will:

Highlight existing and projected research priorities in the autonomous system landscape that will require T&E/V&V
Hear lessons learned and best practices from other DTEVV practitioners
Provide input toward a DTEVV of Autonomy curriculum that will shape the future workforce
Contribute your T&E/V&V of autonomous systems 'wants' and 'needs' to the conversation to help identify priority topic areas

You must be registered to attend. Registration closes January 21, 2026. Register Now

This workshop is being hosted by the University of Maryland MATRIX Lab in partnership with the University of Maryland Applied Research Laboratory for Intelligence and Security (ARLIS) with support from the Office of Naval Research, the University of Maryland Clark School of Engineering, and the University of Maryland Institute for Systems Research. Email matrix@umd.edu if you have any questions about this event.

Day 1: Research Day

8:00 a.m.	Registration (Coffee and light refreshments will be available)	-----
9:00 a.m.	Welcome	Reza Ghodssi Executive Director of Research and Innovation Distinguished University Professor University of Maryland MATRIX Lab
9:05 a.m.	Opening Remarks	Samuel Graham, Jr. Dean, A. James Clark School of Engineering University of Maryland
9:15 a.m.	Workshop Overview	Donald "Bucket" Costello III Director of Test and Evaluation of Autonomous Systems University of Maryland MATRIX Lab
9:30 a.m.	AM Keynote (TBA)	Speaker to be announced
10:15 a.m.	Break	-----
10:30 a.m.	AM Panel: "Emergent DTEVV Research Areas" The increasing importance of test and evaluation has bred various lines of T&E-driven research, often occurring in parallel with specific technology development. From robotics to autonomous systems, T&E/V&V practices have had to evolve to ensure they capably and rigorously assess emergent technologies. This panel will dive into some of these T&E research activities and the driving technologies along with the practical insight that they have gained in their efforts. Panelists will be further engaged on successes, even early ones, best practices they have developed along with challenges they have faced along the way.	Moderator Brian A. Weiss Research Engineer University of Maryland Applied Research Laboratory for Intelligence and Security (ARLIS) Panelists George Hwang Chief Technologist, AI/Autonomy Division, Advanced Development Department Naval Air Warfare Center Aircraft Division (NAWCAD) Additional panelists to be announced
12:00 p.m.	Lunch and PM Keynote (TBA) Lunch will be provided	Speaker to be announced
1:15 p.m.	PM Panel: "Predictions About What is Needed in T&E" The technological landscape is rapidly evolving, particularly with the exponential growth of artificial intelligence (AI), machine learning (ML), and the resultant systems they are instantiated. Even for the seasoned technologist, it was hard to predict the current state of technological development ten years ago. Considering the current state of AI and ML-driven technologies, it will likely be more difficult to predict the technological growth, and the corresponding T&E/V&V efforts, over the next ten years. This panel will explore the arc of technology, emphasizing the DTEVV of autonomous systems in recent years and discuss how the landscape will continue to evolve to meet the demand of predicted technologies.	Moderator Donald "Bucket" Costello III Director of Test and Evaluation of Autonomous Systems University of Maryland MATRIX Lab Panelists Oleg V. Sokolsky Program Director, Computer and Information Science and Engineering (CISE) U.S. National Science Foundation (NSF) Additional panelists to be announced
2:45 p.m.	Break	-----
3:00 p.m.	Discussion: "Challenges and Pitfalls for DTEVV of Intelligent Systems"	-----
4:00 p.m.	Wrapup	-----
4:15 p.m.	Networking	-----
5:30 p.m.	Evening@SMART	Alireza Khaligh Interim Director University of Maryland Institute for Systems Research

Day 2: Workforce Day

8:00 a.m.	Registration (Coffee and light refreshments will be available)	-----
9:00 a.m.	Opening Remarks	Speaker to be announced
9:15 a.m.	Day 1 Review / Overview of the DTEVV Graduate Certificate and Proposed Master's Program	Speaker to be announced
9:30 a.m.	AM Keynote (TBA)	Stephen Cricchi Executive Director Naval Air Warfare Center Aircraft Division (NAWCAD)
10:15 a.m.	Break	-----
10:30 a.m.	AM Panel: "DTEVV Best Practices" A strong influence of DTEVV Best Practices is the workforce that devises them. Although T&E/V&V is not a new phenomenon, it has undergone considerable growth and transformation both as its importance has become better understood and how critical it is to the development and adoption of intelligent systems. DTEVV professionals, from those early in their careers to seasoned practitioners, develop and continually refine best practices that guide their efforts. This panel will explore best practices and how their growth is influenced by an ever-evolving workforce. Some of the discussion will center around key skillsets that have had a positive impact on best practices.	Moderator Brian A. Weiss Research Engineer University of Maryland Applied Research Laboratory for Intelligence and Security (ARLIS) Panelists Theresa Shafer Chief Technology Officer Naval Air Warfare Center Aircraft Division (NAWCAD) Additional panelists to be announced
12:00 p.m.	Lunch and PM Keynote: "The Human Element: Preparing T&E Professionals for Tomorrow's Challenges" Lunch will be provided The T&E community serves as the cornerstone of ensuring that technologies critical to national security meet rigorous standards of safety, reliability, and effectiveness. As the Department of Homeland Security (DHS) confronts increasingly complex threats and rapidly advancing technologies, the T&E workforce must remain grounded in the fundamentals of its mission while evolving to address emerging challenges. This speech explores the foundational principles that must guide the T&E workforce, emphasizing technical expertise, systems thinking, and adaptability. By reinforcing these fundamentals, the T&E community can ensure DHS remains prepared to meet the demands of tomorrow's security landscape.	Wayne Dumais Deputy Director, Office of Test and Evaluation, Immigration and Border Security Programs U.S. Department of Homeland Security
1:15 p.m.	PM Panel: "DTEVV Skillset Needs" T&E, and the overall DTEVV community, is only as effective as their workforce capability. Some personnel enter the workforce with key T&E skills that they built through their undergraduate/graduate education or through internships. Conversely, some practitioners enter the workforce with adjacent skillsets where they dramatically build their T&E prowess through ‘on-the-job’ training and ‘getting their hands dirty’ in actual T&E efforts. Neither is better than the other - it is often that both provide complementary skills that ultimately boost the finish product, which is the successful development and assessment of an emergent technology. This panel will explore the critical DTEVV skills, either built through formal education or in the workplace, that have shaped the DTEVV community. Likewise, this panel will explore the expected skills that will be needed to develop, implement, and assess the technologies of tomorrow.	Moderator Donald "Bucket" Costello III Director of Test and Evaluation of Autonomous Systems University of Maryland MATRIX Lab Panelists Mauricio Castillo-Effen Fellow Lockheed Martin Advanced Technologies Laboratories CAPT Daniel "Tonto" Kitts, USN Commodore, Naval Test Wing Atlantic Naval Air Warfare Center Aircraft Division (NAWCAD) Additional panelists to be announced
2:45 p.m.	Break	-----
3:00 p.m.	Discussion: "DTEVV Workforce Gaps and Specific Formal Education Needs"	-----
4:00 p.m.	Wrapup	-----

Donald "Bucket" Costello III Director of Test and Evaluation of Autonomous Systems University of Maryland MATRIX Lab	Brian A. Weiss Research Engineer University of Maryland Applied Research Laboratory for Intelligence and Security (ARLIS)
Mauricio Castillo-Effen Fellow Lockheed Martin Advanced Technologies Laboratories	George Hwang Chief Technologist, AI/Autonomy Division, Advanced Development Department Naval Air Warfare Center Aircraft Division (NAWCAD)
Stephen Cricchi Executive Director Naval Air Warfare Center Aircraft Division (NAWCAD)	Alireza Khaligh Interim Director University of Maryland Institute for Systems Research
Wayne Dumais Deputy Director, Office of Test and Evaluation, Immigration and Border Security Programs U.S. Department of Homeland Security	CAPT Daniel "Tonto" Kitts, USN Commodore, Naval Test Wing Atlantic Naval Air Warfare Center Aircraft Division (NAWCAD)
Reza Ghodssi Executive Director of Research and Innovation Distinguished University Professor University of Maryland MATRIX Lab	Theresa Shafer Chief Technology Officer Naval Air Warfare Center Aircraft Division (NAWCAD)
Samuel Graham, Jr. Dean, A. James Clark School of Engineering University of Maryland	Oleg V. Sokolsky Program Director, Computer and Information Science and Engineering (CISE) U.S. National Science Foundation (NSF)

Location and Directions

USMSM SMART Building
44219 Airport Road
California, MD 20619

The MATRIX Lab has put together PDF directions to USMSM and the SMART Building for those visiting from Annapolis, Md.; from Virginia via the 301 Harry Nice Bridge, and from the I-495 Washington Beltway.

You also can view the location and get directions from your location on Google Maps.

Ample, free parking is available onsite at the SMART Building (Building 3). There are also parking spots around Buildings 1 and 2 on the USMSM campus.

Hotel Accommodations

The listed establishments have worked with the MATRIX Lab in the past.

Home2 Suites by Hilton (Preferred - Book MATRIX Rate Here) 301-866-1416 46058 Valley Drive Lexington Park, MD 20653 6.3 mile drive from the USMSM campus	Hampton Inn 301-863-3200 22211 Three Notch Road Lexington Park, MD 20653 5.9 mile drive from the USMSM campus	La Quinta Inn & Suites by Wyndham 301-678-9847 22769 Three Notch Road California, MD 20619 3.8 mile drive from the USMSM campus
Extended Stay America 240-725-0100 46565 Expedition Park Drive Lexington Park, MD 20653 5.4 mile drive from the USMSM campus	Holiday Inn Express & Suites 240-237-1444 45260 Abell House Lane California, MD 20619 2.6 mile drive from the USMSM campus	TownePlace Suites 301-863-1111 22520 Three Notch Road Lexington Park, MD 20653 4.6 mile drive from the USMSM campus
Fairfield Inn 301-863-0203 22119 Three Notch Road Lexington Park, MD 20653 6.4 mile drive from the USMSM campus	The Inn at Leonardtown 301-475-0187 41655 Park Avenue Leonardtown, MD 20650 8.6 mile drive from the USMSM campus

Top

DTEVV Workshop
February 4-5, 2026
California, MD

The Development, Test, Evaluation, Verification & Validation (DTEVV) Workshop

Please Note: Due to the government shutdown, this workshop (originally scheduled for November 17-18, 2025) will now be held February 4-5, 2026.

The DTEVV Workshop will be held February 4-5, 2026 at the USMSM SMART Building.

This event will map out the priority research and workforce challenges that need to be addressed to advance the DTEVV of autonomous technologies.