| Abstract [eng] |
Kubickas E. Speaker lip shape registration: Master thesis of electronics engineer/research advisor Assoc. Dr. G. Daunys; Šiaulių University, Technological Faculty, Electronics Department. – Šiauliai, 2007. – 67 p. The theme of Master Project of Electronics engineer is actual, because the lip is the one of the principal visual speech part. For better users instruction‘s understanding in the noisy environment, computer must rely on the visual users signs. In the theory section there is described the most important channels for communication - speech and visual signs. There is performing lip shape registration by using OpenCv and Matlab 7.0 package in this work. The approach proposed to make and to analize algorithm for more accurate lip registration. The main task is to investigate how to detect speaker lip shape robustly, when their location is different. There is presented research of four people lip‘s shape (contours). The results showed that there are few problems, related with lip registration – difficult lip extraction because of the similar skin colour, problematic lips inner contours extraction, because of the visible articulators such as teeth, tongue. Above all, that the main task was reached – there was received the robust lip registration by green colours component. Received results can be used for the further investigations such as different expression pictures research, the neural network for lip position or letters recognizing training. |
