OMRAS2 Research Workshops

For OMRAS2 and Goldsmiths Digital Studios researchers.

ResearchWorkshopTimeAndLocation

Professor Michael Casey

Syllabus

---

Oct 9th

---

* Introduction to OMRAS2

• • current state of system infrastructure
  • architecture of Goldsmiths OMRAS2 system
  • account-level access
  • public Web access

* Goldsmiths OMRAS2 tools

• • 25,000 track metadata store (postgres)
  • 25,000 track media store (filesystem)
  • web accessibility (via php and flash)
  • low-level feature databases (audioDB)
  • feature extraction (fftExtract, mp7extract, VAMP plugins)

* Example searches

• • metadata search
  • content-based searches (riff / theme finding)

---

Oct 16th

---

* Searching low-level features

• • use cases : apocrypha, opus retrieval, cover songs, remixes
  • audioDB application
  • content-based search over web services (SOAP / Flash / PHP )
  • how to choose the features for your use case scenario
  • how to select a query (track + time points)
  • how to restrict the search catalogue
  • how to choose a query type
  • what the results mean
  • efficiency (how to speed up searches)

---

Oct 23rd

---

* Managing media and metadata in OMRAS2

• • ingesting new media and metadata
  • how to extract your own features
  • how to update the feature store
  • how to record searches and results
  • how to evaluate a search

---

Oct 30th

---

• Update on GS OMRAS2 FEATURE EXTRACTION BOT and XGRID
• How to make digital art from content-based search/retrieval
  • soundspotter / videospotter sotware
  • automatic remixing from your iPod
  • audio-visual content-based search and retrieval
  • segmentation / beats / shots / tempo tracking

---

Nov 2nd

---

All-day Royal Academy of Music concert featuring a new version of Goldsmiths' real-time MIR system: ?.

12.30 - 2.00pm: David Gorton: Introduction to 'Opening the Creative Studio'

Michael Casey and Neil Heyde (Cello): Improvisation with ? and video

2.00pm Break

3.00pm - 5.00pm: Pat Nunn (research student): presentation on 'Coalescence' for clarinet and electronics

Paul Archbold and Neil Heyde: Re-composing Jonathan Harvey's Adveya

5.00pm Break

6.00pm - 8.00pm: David Gorton, Neil Heyde, Michael Casey, and Milton Mermikides: Hyperbow piece 'Sonata No. 2 for Cello'

---

Nov 6th

---

* Scaling content-based search to millions of tracks

• • size of media search O( dn )
  • size of pair-wise similarity O ( (dn)^2 )
  • doing better: O ( (dn)^(1/c^2) ), c>>1
  • principles of data warehousing
  • efficient data structures for

---

Nov 13th

---

* UI Design for Content-Based Searching

• • Service-Oriented API for content-based search
  • Design principles for representing content
  • Content-based search controls and representation
  • The Media Matrix @ Goldsmiths (Sally Potter Archive)

---

Nov 20th

---

* Semantic Web and RESTful OMRAS2

• • RDF triples
  • OWL ontologies
  • RESTful services and content-based search

---

Nov 27th

---

* Automatic Classification and Ontologies

• • The MPEG-7 International Standard for content-based classification
  • MPEG-7 and Semantic Web interoperability
  • How to use an MPEG-7 classifier
  • How to build an MPEG-7 classifier
  • Automatic indexing of audio-visual archives

---

Dec 4th

---

* Intensive release workshop 1

• • Preparation of tools for OMRAS2 release 1
  • Documentation of tools
  • User interface testing

---

Dec 11th

---

* Intensive release workshop 2

• • Documentation of tools
  • User interface testing

-- MichaelCasey - 12 Oct 2007