A Research Space for
Earable Computing

ABOUT

Sensory earables are increasingly becoming a mainstream compute platform with a promise to fundamentally transform personal-scale human sensing applications. Over the past few years, a number of research efforts in the ubiquitous computing domain have sought to achieve useful, engaging, and sometimes ambitious behavioural analytics with sensory earables including studies of the human face; of emotion and stress; continuous monitoring of cardiovascular function; oxygen consumption and blood flow; and tracking eating episodes as well as dietary and swallowing activities. At the same time, we have started seeing commercial efforts such as Bragi's The Dash, Bose SoundSport, Jabra Elite Sport, and Sony Xperia offering music experience augmented with sensory services including fitness tracking, real-time translations and conversational agents. Naturally, earables are becoming an intense interdisciplinary area of study with many and diverse applications including HCI, empathic communication, behavioural science, health and wellbeing, entertainment, education, and security.

This site, a voluntarily research service to the community, is intended to catalyse advancements in sensory earable technology by building an academic platform to bring together researchers, practitioners, and design experts from academia and industry to discuss, share, and shape this exciting new area of earable computing.

As a launchpad, we have developed an Open Earable Platform, eSense, and shared with 60+ academic institutions around the globe to accelerate the research in this space. This site is the nucleus of this effort and will offer details of different projects and associated papers, and datasets as they are developed by this community for the community.

The site is also the entry point of EarComp workshop, our annual meeting to discuss the progress of this place, and present a clear sense of direction for the research community to proceed in this space.

eSense OVERVIEW

eSense is a multi-sensory earable platform for personal-scale behavioural analytics research. It is a True Wireless Stereo (TWS) earbud augmented with a 6-axis inertial motion unit, a microphone, and dual mode Bluetooth (Bluetooth Classic and Bluetooth Low Energy). eSense is built with a custom-designed 15 × 15 × 3 mm PCB and composed of a Qualcomm CSR8670, a dual-mode Bluetooth audio system-on-chip (SoC) with a microphone per earbud; a InvenSense MPU6500 six-axis inertial measurement unit (IMU) including a three-axis accelerometer, a three-axis gyroscope, and a two-state button; a circular LED; associated power regulation; and battery-charging circuitry. There is no internal storage or real-time clock. It is powered by an ultra-thin 40-mAh LiPo battery. The carrier casing is equipped with a battery enabling recharging of eSense earbuds on the go (up to 3 full charges). Each earbud weights 20 g and is 18 × 20 × 20 mm.

Please check the IEEE Pervasive Computing article on eSense for more details.

eSense RESOURCES

User Manual

Learn how to quickly get started with eSense

BLE Specification

Detail structure of BLE transport and data commands

Data Visualiser

A node app to visualise and configure eSense sensory streams at real-time (with manual)

Android Library

A light-weight android library to build mobile apps with eSense (with manual)

eSense COMMUNITY RESOURCES

Flutter Plugin

Flutter plugin for eSense Android and iOS. CREDIT: CACHET Team, DTU

iOS LIBRARY

iOS Library for eSense. CREDIT: Yuuki Nishiyama, University of Tokyo

Publications, Projects, Models and Dataset

60+ academic research groups from all over the globe are contributing to this research effort. Please check back to this site soon as we are going to showcase those research in this space together with papers and datasets.

Contact Us

Pervasive Systems team at Nokia Bell Labs Cambridge maintains this research space voluntarily as a community service. Please get in touch with us to contribute to this effort in advancing the earable computing research.

CREDITS : Alessandro Montanari, Chulhong Min, Akhil Mathur, Fahim Kawsar