Imagine yourself in a world where humans interact with computers. You are sitting in front of your personal computer that can listen, talk, or even scream aloud. It has the ability to gather information about you and interact with you through special techniques like facial recognition, speech recognition, etc. It can even understand your emotions at the touch of the mouse. It verifies your identity, feels your presents, and starts interacting with you.

The BLUE EYES technology aims at creating computational machines that have perceptual and sensory ability like those of human beings. It uses non-obtrusive sensing method, employing most modern video cameras and microphones to identify the user’s actions through the use of imparted sensory abilities. The machine can understand what a user wants, where he is looking at, and even realize his physical or emotional states.

It consists of two units:-

 1)Mobile measuring device (DAU) also known as Data Acquisition Unit

Data Acquisition Unit is a mobile part of the Blue eyes system. Its main task is to fetch the physiological data from the sensor and to send it to the central system to be processed.

The Data Acquisition Unit comprises several hardware modules

    • Atmel 89C52 microcontroller – system core
    • Bluetooth module (based on ROK101008)
    • HD44780 – small LCD display
    • 24C16 – I2C EEPROM (on a removable ID card) BLUE EYES TECHNOLOGY


    • MC145483 – 13bit PCM codec
    • Jazz Multisensor interface
    • Beeper and LED indicators ,6 AA batteries and voltage level monitor

2) Central System Unit (CSU)

Central System Unit hardware is the second peer of the wireless connection. The box contains a Bluetooth module and a PCM codec for voice data transmission. The module is interfaced to a PC using a parallel, serial and USB cable

Types of Emotion Sensors

For Hand:

  • Emotion Mouse

Information obtained form Emotion mouse:-

1) Behavior

a. Mouse movements

b. Button click frequency

c. Finger pressure when a user presses his/her button

 2) Physiological information

a. Heart rate (Electrocardiogram (ECG/EKG), Photoplethysmogram (PPG))

b. Skin temperature (Thermester)

c. Skin electricity (Galvanic skin response, GSR)

d. Electromyographic activity (Electromyogram, MG)

  • Sentic Mouse

It is a modified computer mouse that includes a directional pressure sensor for

aiding in recognition of emotional valence (liking/attraction vs. disliking/avoidance).

 For Eyes:

  • Expression Glasses

A wearable device which allows any viewer to visualize the confusion and interest levels of the wearer. Other recent developments in related technology are the attempt to learn the needs of the user just by following the interaction between the user and the computer in order to know what he/she is interested in at any given moment. For example, by remembering the type of websites that the user links to according to the mood and time of the day, the computer could search on related sites and suggest the results the user.

  • Magic Pointing

This work explores a new direction in utilizing eye gaze for computer input. Gaze tracking has long been considered as an alternative or potentially superior pointing method for computer input

Two specific MAGIC pointing techniques, one conservative and one liberal, were designed, analyzed, and implemented with an eye tracker developed.

 For Voice:

  • Artificial Intelligence Speech Recognition

It is important to consider the environment in which the speech recognition system has to work. The grammar used by the speaker and accepted by the system, noise level, noise type, position of the microphone, and speed and manner of the user’s speech are some factors that may affect the quality of speech recognition.

Artificial intelligence (AI) involves two basic ideas. First, it involves studying the thought processes of human beings. Second, it deals with representing those processes via machines (like computers, robots, etc).


The nineties witnessed quantum leaps interface designing for improved man machine interactions. The BLUE EYES technology ensures a convenient way of simplifying the life by providing more delicate and user friendly facilities in computing devices. Now that we have proven the method, the next step is to improve the hardware. Instead of using cumbersome modules to gather information about the user, it will be better to use smaller and less intrusive units. The day is not far when this technology will push its way into your house hold, making you more lazy. It may even reach your hand held mobile device. Any way this is only a technological forecast.



Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s