LearningAPI has moved to a new blog!
The learningapi blog has moved to a new URL. These posts will remain here, but all new content has moved to learningAPI.com: Digital Media, Streaming Video & Educational Technology. You may also subscrdibe to the RSS feed for the new learningAPI.com blog.April 13, 2007
Image, Audio & Video Search - Reading Content and Context
In his article, Improving Image Search, Harvard's Michael Hemment writes about a research project at UC San Diego that uses human-generated sample data to train an engine that analyses images to extract searchable metadata. Supervised
Multiclass Labeling (SML), automatically analyses the content of
images, compares it to various “learned” objects
and classes, and then assigns searchable labels or keywords to the
images. SML can also be used to identify content and generate keywords
for different parts of the same image.
This is an interesting topic. I'm reminded of several related topics -- all involved in extracting useful metadata from binary media objects :
- The Music Genome Project and their Pandora site. Uses human-generated metadata to describe the music, but using fields very similar in concept to the data in VIA or the seed data used in SML.
- Using OCR tools to identify and index text that appears in an image. Google's Orcopus project is an open-source way to do this, although commercial products like Pictron do it for images and video.
- Speech-recognition on audio/video content is similarly a
way to try to index the otherwise opaque contents of a binary media
file. What's odd is how little use this has gotten in the real world,
even though the technology has been around for quite some years.
I read somewhere on the web recently, (can't recall the source) the correct observation that hugely popular video sites like YouTube are built on making video findable by using very primitive metadata combined with the all-important context. Who else likes this? What else has this person created/bookmarked/shared? What comments and tags have users applied? All have turned out to be far more useful than a full transcript or speech-recognition search.
Posted by larryb at 12:10 PM [permanent link]
Category: Innovative Technology , Video and Multimedia Technology , eLearning & Instructional Technology
Category: Innovative Technology , Video and Multimedia Technology , eLearning & Instructional Technology
TrackBack URL for this entry:
http://www.learningapi.com/cgi-bin/mt-tb.cgi/114
Listed below are links to weblogs that reference 'Image, Audio & Video Search - Reading Content and Context' from learningAPI.com: Media and Learning Technology - Larry Bouthillier.
http://www.learningapi.com/cgi-bin/mt-tb.cgi/114
Listed below are links to weblogs that reference 'Image, Audio & Video Search - Reading Content and Context' from learningAPI.com: Media and Learning Technology - Larry Bouthillier.
Search
Archives
Recent Entries
Streaming Video Playback Speed Controls - Two Innovative Methods
Tools for testing streaming media
Facebook and Academic Institutions - Content or Context?
Video Transcript Browsing Interface
The New RealPlayer 11 - A First Look
Is RealPlayer going to make a comeback?
Is Amazon's S3 the cheapest streaming video hosting out there?
Image, Audio & Video Search - Reading Content and Context
e-Learning 2.0 - The End of the Course?
Online Video and Web 2.0 - What's missing?
Tools for testing streaming media
Facebook and Academic Institutions - Content or Context?
Video Transcript Browsing Interface
The New RealPlayer 11 - A First Look
Is RealPlayer going to make a comeback?
Is Amazon's S3 the cheapest streaming video hosting out there?
Image, Audio & Video Search - Reading Content and Context
e-Learning 2.0 - The End of the Course?
Online Video and Web 2.0 - What's missing?
Author Links
About the author
Speaking Engagements
Streaming and Multimedia Articles and Tutorials
My Harvard Business School Bio page
Blogroll
Digital Media Bulletin - Jose Alvear
ResearchForward - Michael J. Hemment
BusinessOfVideo.com
Online Video Punch
The Learning Circuits Blog
Elatable - Bradley Horowitz
Harold Jarche
HBS Prof. Andy McAfee on Web 2.0
DV for Teachers
SciTech Daily Review
Quirksmode - Javascript & AJAX
Educational Technology & Life
Jon Udell
Learning Technology - Denis Saulnier
Weblog Categories
Digital Restrictions Management
eLearning & Instructional Technology
Innovative Technology
Misc
Personal Video Publishing
Streaming Media
Streaming Media Technology Tips
Video and Multimedia Technology
Web and Software Development
Weblogs
External Links