국방획득체계와 연계한 국방 인공지능(AI) 체계 시험평가 방안

• 영문명: Test and Evaluation Procedures of Defense AI System linked to the ROK Defense Acquisition System
• 발행기관: 한국산업경영시스템학회
• 저자명: 이용복 최민우 이민호
• 간행물 정보: 『산업경영시스템학회지』제46권 제4호, 229~237쪽, 전체 9쪽
• 주제분류: 공학 > 산업공학
• 파일형태: PDF
• 발행일자: 2023.12.31

영문 초록

In this research, a new Test and Evaluation (T&E) procedure for defense AI systems is proposed to fill the existing gap in established methodologies. This proposed concept incorporates a data-based performance evaluation, allowing for independent assessment of AI model efficacy. It then follows with an on-site T&E using the actual AI system. The performance evaluation approach adopts the project promotion framework from the defense acquisition system, outlining 10 steps for R&D projects and 9 steps for procurement projects. This procedure was crafted after examining AI system testing standards and guidelines from both domestic and international civilian sectors. The validity of each step in the procedure was confirmed using real-world data. This study's findings aim to offer insightful guidance in defense T&E, particularly in developing robust T&E procedures for defense AI systems.

목차

1. 서론

2. AI 시스템 시험 관련 문헌연구

3. 국방 인공지능(AI) 체계 시험평가 개념

4. 연구개발사업에서 데이터 기반 성능평가 절차

4. 구매사업에서 데이터 기반 성능평가 절차

5. 결론 및 향후 연구방향

키워드

Defense Test and Evaluation(T&E) Data-based Performance Evaluation Procedure Defense AI System