Hearing for robots and AI

Keno Leon
8 min readJul 10, 2020

--

Teaching computers to hear like humans do.

Along with vision, hearing is one of the most beloved and useful sensory experiences we have but what would we need to do to grant this sense to a computer or Ai program. While we already have plenty of ways to interact with sound on computers I am more interested in the natural way we perceive sound and how that can be written as a software program, it’s just a fun topic.

Game plan: We will first talk about sound in general so we have something to work with and briefly delve into the biology of sound as related to us humans; we will then implement a basic digital version of whatever we found in a second part.

Sound & Hearing

Sound in its simplest form is what happens when energy travels through a physical medium like air and water creating acoustic vibrations we later perceive as sound.

Sound is usually described in wave notation which is useful to better understand and communicate concepts, let’s examine a simple beep sound and how it is represented in notation:

--

--