Name

COSENTINO, Sarah

Official Title

Associate Professor(without tenure)

Affiliation

(Global Center for Science and Engineering)

Contact Information

URL

Grant-in-aids for Scientific Researcher Number
80770726

Sub-affiliation

Affiliated Institutes

理工学術院総合研究所(理工学研究所)

兼任研究員 2018-

Research Grants & Projects

Grant-in-aids for Scientific Research Adoption Situation

Research Classification:

Robot music therapy for effective social training of ASD children

2017/-0-2019/-0

Allocation Class:¥4160000

On-campus Research System

Special Research Project

Iconic facial expressions able robotic face for direct signaling in human-robot dynamic musical interaction

2016Collaborator:Salvatore Sessa

Research Results Outline:After an extensive evaluation and recalibration of the needed hardware for After an extensive evaluation and recalibration of the needed hardware for the implementation of the proposed solution, we d...After an extensive evaluation and recalibration of the needed hardware for the implementation of the proposed solution, we decided to move the focus of the facial interaction from action to recognition. We implemented a system that allows the robot, using the cloud computing and the Microsoft APIs, to recognize facial expression and emotional cues, and adapt its performance accordingly.This system would allow the robot not only to recognize specific facial expression cues from partner human players during a joint performance, but also and especially to recognize emotional expressions from the audience and respond in a tailored way.To do so, we had to implement the facial recognition software system, but also to improve the musical expressivity of the robot, by refining the hardware. We then redesigned the robot control system to produce better and more diverse sounds, allowing the robot to add specific emotional connotation to the performed piece.In the future, we are planning to redesign the entire robot hands, to be able to extend the register range of the performance and extend the possible musical emotional connotations.

Lecture Course

Course TitleSchoolYearTerm
Science and Engineering LaboratorySchool of Fundamental Science and Engineering2019fall semester
Science and Engineering Laboratory 1BSchool of Fundamental Science and Engineering2019fall semester
Science and Engineering Laboratory 1B VSchool of Fundamental Science and Engineering2019fall semester
Science and Engineering LaboratorySchool of Creative Science and Engineering2019fall semester
Science and Engineering Laboratory 1BSchool of Creative Science and Engineering2019fall semester
Science and Engineering Laboratory 1B VSchool of Creative Science and Engineering2019fall semester
Science and Engineering LaboratorySchool of Advanced Science and Engineering2019fall semester
Science and Engineering Laboratory 1BSchool of Advanced Science and Engineering2019fall semester
Science and Engineering Laboratory 1B VSchool of Advanced Science and Engineering2019fall semester
Fundamentals of Robotics BSchool of Fundamental Science and Engineering2019spring semester
Fundamentals of Robotics BSchool of Creative Science and Engineering2019spring semester
Mechanical Engineering Laboratory ASchool of Creative Science and Engineering2019spring semester
Mechanical Engineering Laboratory BSchool of Creative Science and Engineering2019fall semester
SHIP Collaborative WorkshopSchool of Creative Science and Engineering2019fall quarter
SHIP Collaborative Workshop [S Grade]School of Creative Science and Engineering2019fall quarter
Introduction to Mechanical EngineeringSchool of Creative Science and Engineering2019fall semester
Introduction to Mechanical Engineering [S Grade]School of Creative Science and Engineering2019fall semester
Fundamentals of Robotics ASchool of Fundamental Science and Engineering2019fall semester
MechatronicsSchool of Creative Science and Engineering2019fall semester
Fundamentals of Robotics ASchool of Creative Science and Engineering2019fall semester
Mechatronics [S Grade]School of Creative Science and Engineering2019fall semester
Mechatronics Laboratory FundamentalsSchool of Creative Science and Engineering2019spring semester
Mechatronics Laboratory ASchool of Creative Science and Engineering2019spring semester
Control SystemsSchool of Creative Science and Engineering2019fall semester
Control SystemsSchool of Creative Science and Engineering2019fall semester
Mechatronics Laboratory AdvancedSchool of Creative Science and Engineering2019fall semester
Mechatronics Laboratory BSchool of Creative Science and Engineering2019fall semester
Master's Thesis (Department of Modern Mechanical Engineering)Graduate School of Creative Science and Engineering2019full year
Research on BioroboticsGraduate School of Creative Science and Engineering2019full year
Research on BioroboticsGraduate School of Creative Science and Engineering2019full year
Research on BioroboticsGraduate School of Advanced Science and Engineering2019full year
Research on BioroboticsGraduate School of Advanced Science and Engineering2019full year
Master's Thesis (Department of Modern Mechanical Engineering)Graduate School of Creative Science and Engineering2019full year
Research on BioroboticsGraduate School of Creative Science and Engineering2019full year
Research on BioroboticsGraduate School of Advanced Science and Engineering2019full year
Master's Thesis (Department of Integrative Bioscience and Biomedical Engineering)Graduate School of Advanced Science and Engineering2019full year
Master's Thesis (Department of Integrative Bioscience and Biomedical Engineering)Graduate School of Advanced Science and Engineering2019full year