John Waterworth: pianoForte: A New Approach to Computer-Assisted Piano Education

Education is emerging as one of the most fruitful applications of multimedia computer technology; but, for all the benefits of multimedia, the educational focus is still on facts which are grounded in text. If multimedia is to be effectively exploited, we should look beyond the bounds of current limitations to other areas of education. Piano instruction is such a new area, since it involves the learning of physical actions, more than the learning of facts.

Systems are already implemented which allow a piano student to acquire notation literacy, but what happens next? Going beyond reading and playing the notes to making good music involves the acquisition of an intimate complex of physical and mental skills, and how a good teacher imparts those skills to a good student remains an art form (i.e. a mystery). I believe that multimedia technology may facilitate the relevant kind of communication between teacher and student during this poorly understood learning process.

Beyond establishing whether or not a student "gets the notes right," it is possible to use MIDI technology as a basis for capturing several aspects of a performance, including dynamics, tempo, articulation, and synchronization. If these records displayed in a suitable representation, it will be easier for a piano teacher to communicate to a student the distinction between the art of playing piano and the technique of playing the correct notes. The technology is used to translate aspects of performances into new forms; specifically, musical events are displayed as visual signs. This not only facilitates communication about otherwise ephemeral phenomena, it actually enhances listening skills.

The work reflects a concern with how IT can best support education - as a source of facts or as a behavioural coach (And more generally, what is education about - acquiring knowledge or learning how to behave?). It is based on the 'sensory ergonomics' philosophy of HCI design - the idea that the principal role of IT is to enhance perception and communication, rather than to directly support cognitive problem solving. As such, pianoFORTE can be seen as an example of the design of synaesthetic media.

Välkommna!
Kenneth Nilsson