Lego NXT Dancing to the Rhythm

A Lego-NXT-based humanoid robot dancing to the rhythm of prodigy. It reacts in real-time to multimodal events, from musical note-onsets and dance floor colors, with user-defined dance motions. [paper]

Synchronized Robot Dancing

RoboNova dancing to Blur. Each sequence of moves is synchronized to the musical beats on-the-fly, retrieved from the real-time INESC Porto Beat Tracker (IBT). [paper1]; [paper2]

Humanoid Robot Dancing Samba

Simulated humanoid robot NAO dancing samba. The dance movements were mapped from MoCap (motion capture) recordings of human samba performances. [paper1]; [paper2]; [paper3]

Beat Tracking for Robot Audition and Live Beat-Synchronous Robot Dancing

Interactive robot dancing system that simultaneously processes and responds to the beat of continuous musical stimuli and to the speech of a human interactor in a real-world scenario. [paper1]; [paper2]; [paper3]


  • Topic: Music Information Retrieval
  • Partners: UPF (Barcelona), BMAT (Barcelona), OFAI (Vienna), IRCAM (Paris), INESC Porto (Porto), Stromatalite (London), QMUL (London)
  • Project leader: Stromatolite
  • Funding: EU
  • Dates: 2011-2013
  • External link
Palco 3.0


  • Topic: Improving music recommendations in the portuguese music social network Palco Principal:
    • social networks of musicians an listeners
    • free music data, with a focus on Portuguese underground music
  • Research on:
    • music audio signal classification (genres, tags, etc.)
    • audio-based music similarity
    • music similarity based on user behaviors
    • music similarity based on textual data
    • playlist generation
  • Partners: Palco Principal Lda, INESC Porto, Economics Faculty University of Porto, Science Faculty University of Porto
    • Project leader: Palco Principal Lda
    • Funding: QREN
    • Dates: 2009-2011

COST IC0601 Action on Sonic Interaction Design

SID is the COST IC0601 Action on Sonic Interaction Design.

  • Topic: Sonic Interaction Design
  • Partners
  • Project Chair: Universita IUAV di Venezia
  • Funding: COST
  • Dates: 2007-2011

In the SID COST Action, our group participated in a number of Short-Term Scientific Missions:

  1. “Soundscape analysis using music principles and technologies”Ming Yang from University of Sheffield, to our group; February-March 2011
  2. IMPROVe Sound Object Instrument”Richard Widerberg from Valand School of Fine Arts, University of Gothenburg, to our group; November 2010
  3. Interactive Music 2.0: User-driven ad hoc dance clubs”Yago De Quay from our group to University of Oslo, Dept. of Musicology and Informatics: Aug-Sept 2010
  4. “Mapping Human Dance Gestures onto Robots”João Oliveira from our group to IPEM, Ghent University; November 2009
  5. “Interactions between dance movements and music rhythmic structure – The case of groove in Samba”Luiz Naveda from IPEM, Ghent University to our group; May 18-June 1st, 2009
  6. “UrbanSync: Gathering of urban signals” Stephan Baumann; from German Research Center for Artificial Intelligence, Kaiserslautern, to our group; 6/10/08 – 26/10/08
  7. “Exploring contact sound synthesis via haptic interactions”Mathieu Lagrange; from IRCAM to our group; April 2008
  8. “Implementation of Auditory Scene Analysis cues in the free sound analysis framework MARSYAS”Luis Gustavo Martins; from our group to CIRMMT, Montreal; June 2008