With a literature study on sounds and emotion, several hypotheses are stated. We linked the emotion puppets [PrEmo6] of Pieter de Smet to a sound-matrix, containing sounds with different depth and roughness. The hypotheses that [1] the pleasantness of an emotion is related to the roughness of a sound and [2] the depth of an emotion is related to the arousal of a sound, are valid. These are the main conclusions after a research with 40 respondents.