Difference between revisions of "Audio Fingerprint"
From MusicBrainz Wiki
Jump to navigationJump to searchBrianFreud (talk | contribs) (→Open source systems:: Moving from parked domain to Google code page) |
(Cleanup, added Echo Nest, Last.fm, AudioScout, OpenFP, Rovi, Gracenote) |
||
Line 9: | Line 9: | ||
==Known Audio Fingerprinting Systems== |
==Known Audio Fingerprinting Systems== |
||
− | ===Open |
+ | === Open Source Systems === |
* The fingerprint in Kurt Rosenfeld's [http://www.w140.com/audio/ FDMF]. |
* The fingerprint in Kurt Rosenfeld's [http://www.w140.com/audio/ FDMF]. |
||
+ | * MusicURI, part of the [http://sourceforge.net/projects/mpeg7audiodb Mpeg-7 Audio DB] project. |
||
⚫ | * |
||
⚫ | |||
− | * MusicURI, a project trying to combine audio fingerprinting with text based search. More info on project [http://semedia.deit.univpm.it/musicuri/ homepage]. The GPL source code is available at [http://sourceforge.net/projects/mpeg7audiodb SourceForge]. |
||
− | * A possible [[Future Proof Fingerprint|FutureProofFingerPrint]] algorithm that we could code has been Proposed by Geoff Schmidt, formally of Tuneprint. |
||
⚫ | |||
* [http://acoustid.org/ Acoustid] is an open source project that aims to create a free database of audio fingerprints with mapping to the MusicBrainz metadata database and provide a web service for audio file identification using this database. Developed by [[User:LukasLalinsky|Lukáš Lalinský]] |
* [http://acoustid.org/ Acoustid] is an open source project that aims to create a free database of audio fingerprints with mapping to the MusicBrainz metadata database and provide a web service for audio file identification using this database. Developed by [[User:LukasLalinsky|Lukáš Lalinský]] |
||
− | * |
+ | * [http://code.google.com/p/audioscout/ AudioScout]. Based on the [http://www.phash.org/ pHash] audio fingerprinting library, developed by the same authors. Uses the "Philips Robust Hashing" algorithm. |
+ | * [http://open-fp.sourceforge.net/ OpenFP]. |
||
+ | * ''[defunct]'' [http://code.google.com/p/libfooid/ libFooID]. An audio fingerprinting library used by, and developed for [http://www.foosic.org/ foosic]. |
||
⚫ | |||
+ | === Partially Open-Source Systems === |
||
⚫ | |||
⚫ | * [[AmpliFIND Music Services]]'s [[PUID]] (formerly MusicIP/[[MusicMagic]]/Predixis)<br/>The [[PUID]] technology has been integrated into the [[MusicBrainz]] since March 2006 and into Picard since version 0.7.0 released in July 2007. See their [http://www.freshpatents.com/Audio-fingerprinting-system-and-method-dt20050324ptan20050065976.php patent application] for details on the technology. The client-side audio fingerprinting library ([http://bugs.musicbrainz.org/browser/libofa/trunk libofa]) is open-source. |
||
− | * Relatable's [[TRM]] <br/> The system [[MusicBrainz]] originally used. The use of TRM has since been removed from MusicBrainz. |
||
+ | * [http://blog.last.fm/2010/07/09/fingerprint-api-and-app-updated Last.fm]. The client-side audio fingerprinting library ([https://github.com/lastfm/Fingerprinter fplib]) is open-source. Uses the "[http://www.cs.cmu.edu/~yke/musicretrieval/ Computer Vision for Music Identification]" algorithm. |
||
⚫ | * [[ |
||
+ | * [http://developer.echonest.com/docs/v4/song.html#identify The Echo Nest]. Originally a proprietary system, but the source code has been recently released on GitHub -- [https://github.com/echonest/echoprint-server server], [https://github.com/echonest/echoprint-codegen codegen] |
||
⚫ | |||
+ | * ''[defunct]'' Relatable's [[TRM]]. The system [[MusicBrainz]] originally used. The use of TRM has since been removed from MusicBrainz. The client-side audio fingerprinting library was open source and integrated into [http://bugs.musicbrainz.org/browser/libmusicbrainz/tags/release-2.1.5 libmusicbrainz]. |
||
− | * Philips (also licensed by SNOCAP) <br/>[http://ismir2002.ismir.net/proceedings/02-FP04-2.pdf http://ismir2002.ismir.net/proceedings/02-FP04-2.pdf] [http://ict.ewi.tudelft.nl/pub/doets/paper027.pdf http://ict.ewi.tudelft.nl/pub/doets/paper027.pdf] [http://wwwiti.cs.uni-magdeburg.de/iti_amsl/lehre/03_SoSem/mmsec_v/scripte/vorles-mm-03-6.3.pdf This presentation] (in PDF) has a few slides on the Philips system as well: |
||
+ | |||
⚫ | |||
+ | |||
⚫ | |||
+ | * [http://business.mufin.com/solutions/audioid AudioID]. Developed at the [http://www.idmt.fraunhofer.de/eng/research_topics/audioid.htm Fraunhofer Institute for Integrated Circuits IIS and the Fraunhofer Institute for Digital Media Technology IDMT], now provided by [http://www.mufin.com/ mufin GmbH]. |
||
⚫ | |||
+ | * [http://www.rovicorp.com/products/developers/innovate/rovi_cloud_services.htm Rovi Media Recognition Service] (formelly [http://en.wikipedia.org/wiki/AMG_LASSO AMG LASSO]). |
||
+ | * [http://www.gracenote.com/products/musicid/ Gracenote MusicID]. |
||
+ | * Philips. One of the first scalable audio fingerprint algorithms. Described [http://ismir2002.ismir.net/proceedings/02-FP04-2.pdf here] and [http://ict.ewi.tudelft.nl/pub/doets/paper027.pdf here]. |
||
* [http://spiedl.aip.org/getabs/servlet/GetabsServlet?prog=normal&id=PSISDG005242000001000055000001&idtype=cvips&gifs=yes USC] |
* [http://spiedl.aip.org/getabs/servlet/GetabsServlet?prog=normal&id=PSISDG005242000001000055000001&idtype=cvips&gifs=yes USC] |
||
− | * AudioID: <br/>[http://www.idmt.fraunhofer.de/eng/research_topics/audioid.htm On the Fraunhofer IDMT site], [http://www.m2any.com/ site of the AudioID company] |
||
⚫ | |||
* And possibly most ridiculously of all: [http://www.songtapper.com/s/tappingmain.bin The Song Tapper] |
* And possibly most ridiculously of all: [http://www.songtapper.com/s/tappingmain.bin The Song Tapper] |
||
Revision as of 10:51, 15 May 2011
Audio fingerprints are identifiers for audio files based on the contained audio data.
MusicBrainz originally used Relatable's TRM exclusively as their only audio fingerprint technology, but due to various scalability and performance issues, and the fact that the server is closed-source and thus, not fixable, an alternative was required. MusicIPs PUID technology was chosen in March of 2006 as an efficient alternative.
PUIDs were first integrated into Picard 0.7, and have seen continuous support in the MusicBrainz Server.
Also see: How PUIDs Work and Future Proof Fingerprint.
Known Audio Fingerprinting Systems
Open Source Systems
- The fingerprint in Kurt Rosenfeld's FDMF.
- MusicURI, part of the Mpeg-7 Audio DB project.
- jHears is an acoustic fingerprinting framework based on FutureProofFingerPrint design by Geoff Schmidt (formelly of Tuneprint). jHears is developed by Juha Heljoranta.
- Acoustid is an open source project that aims to create a free database of audio fingerprints with mapping to the MusicBrainz metadata database and provide a web service for audio file identification using this database. Developed by Lukáš Lalinský
- AudioScout. Based on the pHash audio fingerprinting library, developed by the same authors. Uses the "Philips Robust Hashing" algorithm.
- OpenFP.
- [defunct] libFooID. An audio fingerprinting library used by, and developed for foosic.
- [defunct] Freetantrum. It seems to be a dead project (its home page was replaced with an advert for unrelated things in 2001), but it may be worth investigating and resurrecting the code they produced.
Partially Open-Source Systems
- AmpliFIND Music Services's PUID (formerly MusicIP/MusicMagic/Predixis)
The PUID technology has been integrated into the MusicBrainz since March 2006 and into Picard since version 0.7.0 released in July 2007. See their patent application for details on the technology. The client-side audio fingerprinting library (libofa) is open-source. - Last.fm. The client-side audio fingerprinting library (fplib) is open-source. Uses the "Computer Vision for Music Identification" algorithm.
- The Echo Nest. Originally a proprietary system, but the source code has been recently released on GitHub -- server, codegen
- [defunct] Relatable's TRM. The system MusicBrainz originally used. The use of TRM has since been removed from MusicBrainz. The client-side audio fingerprinting library was open source and integrated into libmusicbrainz.
Commercial Systems
- Audible Magic. This article compares business models for Philips & Audible Magic
- AudioID. Developed at the Fraunhofer Institute for Integrated Circuits IIS and the Fraunhofer Institute for Digital Media Technology IDMT, now provided by mufin GmbH.
- Shazam. Proprietary music fingerprinting system, currently offered directly to users over the telephone.
- Rovi Media Recognition Service (formelly AMG LASSO).
- Gracenote MusicID.
- Philips. One of the first scalable audio fingerprint algorithms. Described here and here.
- USC
- And possibly most ridiculously of all: The Song Tapper