氏名

コセンティノ サラ

コセンティノ サラ

職名

准教授(任期付)

所属理工学術院

(国際理工学センター)

本属以外の学内所属

学内研究所等

理工学術院総合研究所(理工学研究所)

兼任研究員 2018年-

学内研究制度

特定課題研究

Iconic facial expressions able robotic face for direct signaling in human-robot dynamic musical interaction

2016年度共同研究者:Salvatore Sessa

研究成果概要:After an extensive evaluation and recalibration of the needed hardware for the implementation of the proposed solut...After an extensive evaluation and recalibration of the needed hardware for the implementation of the proposed solution, we decided to move the focus of the facial interaction from action to recognition. We implemented a system that allows the robot, using the cloud computing and the Microsoft APIs, to recognize facial expression and emotional cues, and adapt its performance accordingly.This system would allow the robot not only to recognize specific facial expression cues from partner human players during a joint performance, but also and especially to recognize emotional expressions from the audience and respond in a tailored way.To do so, we had to implement the facial recognition software system, but also to improve the musical expressivity of the robot, by refining the hardware. We then redesigned the robot control system to produce better and more diverse sounds, allowing the robot to add specific emotional connotation to the performed piece.In the future, we are planning to redesign the entire robot hands, to be able to extend the register range of the performance and extend the possible musical emotional connotations.

現在担当している科目

科目名開講学部・研究科開講年度学期
Science and Engineering Laboratory基幹理工学部2018秋学期
理工学基礎実験1B Vブロック基幹理工学部2018秋学期
Science and Engineering Laboratory創造理工学部2018秋学期
理工学基礎実験1B Vブロック創造理工学部2018秋学期
Science and Engineering Laboratory先進理工学部2018秋学期
理工学基礎実験1B Vブロック先進理工学部2018秋学期
Fundamentals of Robotics A基幹理工学部2018秋学期
Mechatronics創造理工学部2018秋学期
Fundamentals of Robotics A創造理工学部2018秋学期
Fundamentals of Robotics B基幹理工学部2018春学期
Fundamentals of Robotics創造理工学部2018春学期
Fundamentals of Robotics B創造理工学部2018春学期
Mechatronics Laboratory Fundamentals創造理工学部2018春学期
Mechatronics Laboratory A創造理工学部2018春学期
Control Systems創造理工学部2018秋学期
Control Systems創造理工学部2018秋学期
Mechatronics Laboratory Advanced創造理工学部2018秋学期
Mechatronics Laboratory B創造理工学部2018秋学期
Mechanical Engineering Laboratory A創造理工学部2018春学期
Mechanical Engineering Laboratory B創造理工学部2018秋学期
SHIP Collaborative Workshop創造理工学部2018秋クォーター
Introduction to Mechanical Engineering創造理工学部2018秋学期
Introduction to Mechanical Engineering [S Grade]創造理工学部2018秋学期