Implementation of Melody Playback Method through Image Classification and Stroke Analysis

• 발행기관: 한국컴퓨터게임학회
• 저자명: Jae Min Kim Myoung Young Kim In Tae Hwang Won Hyung Lee
• 간행물 정보: 『한국컴퓨터게임학회논문지』제32권 2호, 83~91쪽, 전체 9쪽
• 주제분류: 공학 > 컴퓨터학
• 파일형태: PDF
• 발행일자: 2019.07.30

영문 초록

In this study, we devised a application that generates and reproduces music by analyzing images received from a user. It was aimed not only to capture the technical meaning of auditioning images, but also to express emotions and intentions in user s images. In the proposed application, a user draws a picture of a desired object. The application uses artificial intelligence to determine which object an image is. After that, the emotions that can be connected with each objects. The application determines the key that matches the mood through the emotion associated with the object. After setting a key suitable for the emotion, the user s stroke order is analyzed, and the melody is composed based on the extracted user’s stroke data. In the future, research on arts such as painting and music will be continued as well as implementing auditory expression of images. Based on this, we will present the direction to embody the artistic and intention in the image into music. It will also be a meaningful attempt as a direction of combination between engineering fields such as artificial intelligence for recognizing pictures and art fields such as picture analysis, and music production.

목차

1. Introduction

2. Related research

3. Research method

4. Results and Discussion

키워드

Music Image classification Stroke analysis Audioization CNN Google Quick Draw