Difference between revisions of "Audio Fingerprint"

From MusicBrainz Wiki
(Open source systems:: Moving from parked domain to Google code page)
(Cleanup, added Echo Nest, Last.fm, AudioScout, OpenFP, Rovi, Gracenote)
Line 9: Line 9:
 
==Known Audio Fingerprinting Systems==
 
==Known Audio Fingerprinting Systems==
  
===Open source systems:===
+
=== Open Source Systems ===
  
 
* The fingerprint in Kurt Rosenfeld's [http://www.w140.com/audio/ FDMF].
 
* The fingerprint in Kurt Rosenfeld's [http://www.w140.com/audio/ FDMF].
* Freetantrum songprint  <br/>There is a project called [http://sourceforge.net/projects/freetantrum freetantrum] on Sourceforge. It seems to be a dead project (its home page was replaced with an advert for unrelated things in 2001), but it may be worth investigating and resurrecting the code they produced. 
+
* MusicURI, part of the [http://sourceforge.net/projects/mpeg7audiodb Mpeg-7 Audio DB] project.
* MusicURI, a project trying to combine audio fingerprinting with text based search. More info on project [http://semedia.deit.univpm.it/musicuri/ homepage]. The GPL source code is available at [http://sourceforge.net/projects/mpeg7audiodb SourceForge].
+
* [http://jhears.org/ jHears] is an acoustic fingerprinting framework based on [[Future Proof Fingerprint|FutureProofFingerPrint]] design by Geoff Schmidt (formelly of Tuneprint). jHears is developed by Juha Heljoranta.
* A possible [[Future Proof Fingerprint|FutureProofFingerPrint]] algorithm that we could code has been Proposed by Geoff Schmidt, formally of Tuneprint.  
 
* [http://jhears.org/ jHears] is an acoustic fingerprinting framework based on [[Future Proof Fingerprint|FutureProofFingerPrint]] design by Geoff Schmidt. jHears is developed by Juha Heljoranta.
 
 
* [http://acoustid.org/ Acoustid] is an open source project that aims to create a free database of audio fingerprints with mapping to the MusicBrainz  metadata database and provide a web service for audio file identification using this database. Developed by [[User:LukasLalinsky|Lukáš Lalinský]]
 
* [http://acoustid.org/ Acoustid] is an open source project that aims to create a free database of audio fingerprints with mapping to the MusicBrainz  metadata database and provide a web service for audio file identification using this database. Developed by [[User:LukasLalinsky|Lukáš Lalinský]]
* [defunct] [http://code.google.com/p/libfooid/ libFooID], an audio fingerprinting library used by, and developed for [http://www.foosic.org/ foosic].
+
* [http://code.google.com/p/audioscout/ AudioScout]. Based on the [http://www.phash.org/ pHash] audio fingerprinting library, developed by the same authors. Uses the "Philips Robust Hashing" algorithm.
 +
* [http://open-fp.sourceforge.net/ OpenFP].
 +
* ''[defunct]'' [http://code.google.com/p/libfooid/ libFooID]. An audio fingerprinting library used by, and developed for [http://www.foosic.org/ foosic].
 +
* ''[defunct]'' [http://sourceforge.net/projects/freetantrum Freetantrum]. It seems to be a dead project (its home page was replaced with an advert for unrelated things in 2001), but it may be worth investigating and resurrecting the code they produced. 
  
===Commercial systems:===
+
=== Partially Open-Source Systems ===
  
* Relatable's [[TRM]] <br/> The system [[MusicBrainz]] originally used. The use of TRM has since been removed from MusicBrainz.
+
* [[AmpliFIND Music Services]]'s [[PUID]] (formerly MusicIP/[[MusicMagic]]/Predixis)<br/>The [[PUID]] technology has been integrated into the [[MusicBrainz]] since March 2006 and into Picard since version 0.7.0 released in July 2007.  See their [http://www.freshpatents.com/Audio-fingerprinting-system-and-method-dt20050324ptan20050065976.php patent application] for details on the technology. The client-side audio fingerprinting library ([http://bugs.musicbrainz.org/browser/libofa/trunk libofa]) is open-source.
* [[MusicIP]]'s [[PUID]] (formerly [[MusicMagic]]/Predixis)<br/>The [[PUID]] technology has been integrated into the [[MusicBrainz]] since March 2006 and into Picard since version 0.7.0 released in July 2007.  See their [http://www.freshpatents.com/Audio-fingerprinting-system-and-method-dt20050324ptan20050065976.php patent application] for details on the technology.  
+
* [http://blog.last.fm/2010/07/09/fingerprint-api-and-app-updated Last.fm]. The client-side audio fingerprinting library ([https://github.com/lastfm/Fingerprinter fplib]) is open-source. Uses the "[http://www.cs.cmu.edu/~yke/musicretrieval/ Computer Vision for Music Identification]" algorithm.
* AudibleMagic  <br/>[http://www.econtentmag.com/Articles/ArticleReader.aspx?ArticleID=4473&IssueID=128 This article] compares business models for Philips & Audible Magic  
+
* [http://developer.echonest.com/docs/v4/song.html#identify The Echo Nest]. Originally a proprietary system, but the source code has been recently released on GitHub -- [https://github.com/echonest/echoprint-server server], [https://github.com/echonest/echoprint-codegen codegen]
* Philips (also licensed by SNOCAP)  <br/>[http://ismir2002.ismir.net/proceedings/02-FP04-2.pdf http://ismir2002.ismir.net/proceedings/02-FP04-2.pdf] [http://ict.ewi.tudelft.nl/pub/doets/paper027.pdf http://ict.ewi.tudelft.nl/pub/doets/paper027.pdf] [http://wwwiti.cs.uni-magdeburg.de/iti_amsl/lehre/03_SoSem/mmsec_v/scripte/vorles-mm-03-6.3.pdf This presentation] (in PDF) has a few slides on the Philips system as well:
+
* ''[defunct]'' Relatable's [[TRM]]. The system [[MusicBrainz]] originally used. The use of TRM has since been removed from MusicBrainz. The client-side audio fingerprinting library was open source and integrated into [http://bugs.musicbrainz.org/browser/libmusicbrainz/tags/release-2.1.5 libmusicbrainz].
 +
 
 +
=== Commercial Systems ===
 +
 
 +
* [http://audiblemagic.com/ Audible Magic]. [http://www.econtentmag.com/Articles/ArticleReader.aspx?ArticleID=4473&IssueID=128 This article] compares business models for Philips & Audible Magic  
 +
* [http://business.mufin.com/solutions/audioid AudioID]. Developed at the [http://www.idmt.fraunhofer.de/eng/research_topics/audioid.htm Fraunhofer Institute for Integrated Circuits IIS and the Fraunhofer Institute for Digital Media Technology IDMT], now provided by [http://www.mufin.com/ mufin GmbH].
 +
* [http://www.shazam.com/ Shazam]. Proprietary music fingerprinting system, currently offered directly to users over the telephone.  
 +
* [http://www.rovicorp.com/products/developers/innovate/rovi_cloud_services.htm Rovi Media Recognition Service] (formelly [http://en.wikipedia.org/wiki/AMG_LASSO AMG LASSO]).
 +
* [http://www.gracenote.com/products/musicid/ Gracenote MusicID].
 +
* Philips. One of the first scalable audio fingerprint algorithms. Described [http://ismir2002.ismir.net/proceedings/02-FP04-2.pdf here] and [http://ict.ewi.tudelft.nl/pub/doets/paper027.pdf here].
 
* [http://spiedl.aip.org/getabs/servlet/GetabsServlet?prog=normal&id=PSISDG005242000001000055000001&idtype=cvips&gifs=yes USC]  
 
* [http://spiedl.aip.org/getabs/servlet/GetabsServlet?prog=normal&id=PSISDG005242000001000055000001&idtype=cvips&gifs=yes USC]  
* AudioID: <br/>[http://www.idmt.fraunhofer.de/eng/research_topics/audioid.htm On the Fraunhofer IDMT site], [http://www.m2any.com/ site of the AudioID company]
 
* [http://www.shazam.com/music/portal/sp/s/media-type/html/user/anon/page/default/template/pages/p/company_profile.html Shazam] have their own proprietary music fingerprinting system, currently offered directly to users over the telephone.
 
 
* And possibly most ridiculously of all: [http://www.songtapper.com/s/tappingmain.bin The Song Tapper]  
 
* And possibly most ridiculously of all: [http://www.songtapper.com/s/tappingmain.bin The Song Tapper]  
  
 
[[Category:Terminology]]
 
[[Category:Terminology]]

Revision as of 10:51, 15 May 2011

Audio fingerprints are identifiers for audio files based on the contained audio data.

MusicBrainz originally used Relatable's TRM exclusively as their only audio fingerprint technology, but due to various scalability and performance issues, and the fact that the server is closed-source and thus, not fixable, an alternative was required. MusicIPs PUID technology was chosen in March of 2006 as an efficient alternative.

PUIDs were first integrated into Picard 0.7, and have seen continuous support in the MusicBrainz Server.

Also see: How PUIDs Work and Future Proof Fingerprint.

Known Audio Fingerprinting Systems

Open Source Systems

  • The fingerprint in Kurt Rosenfeld's FDMF.
  • MusicURI, part of the Mpeg-7 Audio DB project.
  • jHears is an acoustic fingerprinting framework based on FutureProofFingerPrint design by Geoff Schmidt (formelly of Tuneprint). jHears is developed by Juha Heljoranta.
  • Acoustid is an open source project that aims to create a free database of audio fingerprints with mapping to the MusicBrainz metadata database and provide a web service for audio file identification using this database. Developed by Lukáš Lalinský
  • AudioScout. Based on the pHash audio fingerprinting library, developed by the same authors. Uses the "Philips Robust Hashing" algorithm.
  • OpenFP.
  • [defunct] libFooID. An audio fingerprinting library used by, and developed for foosic.
  • [defunct] Freetantrum. It seems to be a dead project (its home page was replaced with an advert for unrelated things in 2001), but it may be worth investigating and resurrecting the code they produced.

Partially Open-Source Systems

Commercial Systems