Pluggd : Keyword Matching Within Videos

SMS Text

With the rapid rise in video and audio content online, there is an immediate need for search technologies that can catalog and search media content based on content in addition to the meta-data provided alongside.

Pluggd is one such firm that is seeking to provide the answer with its HeatMap interface that makes it possible for users to move to segments within video that mentions keywords they are looking for.

The core technology

Starting out as a firm that focused on delivering podcast results, the firm has added video analysis that does the conversion of the audio to text and that feeds a subsystem that generates a heat map below the video. The color code on the map represents the extent to which the content spoken in video matches the search query of the user. In addition the contextual analysis engine associates several concepts with the keywords.

Lead by Alex Castro, a person with wide experience in digital media and voice over IP, the company is providing means for contextual ads (overlays or text ). TechCrunch mentions that the engine is poised to take advantage of the emerging model of social networking enabled media search.

The major hurdles here are processing time for the amount of content online and how the firm scales the HeatMap interface to further abstraction ( as in recognizing concepts do not confirm to keyword search).

You can give the service a try by registering at

Get the latest news from Search Engine Journal!
We value your privacy! See our policy here.
  • Tim Cohn

    Video keyword search looks like it would be the next most likely natural and complimentary extension of text keyword search.

  • Arun Radhakrishnan

    Yes Tim, Its the proliferation of video content that is causing the same. I look forward to what the major search engines offer on this front.

  • Tim Cohn

    I would say so…If I recall correctly: YouTube consumption now represents either 10% of internet traffic or bandwidth.

  • Arun Radhakrishnan

    And also a major chunk of Google’s traffic. It’ll be interesting to watch developments in the core media space.

  • Loren Baker, Editor

    Agreed, adding this keyword matching technology to video search will be a major step in both usability AND monetizing video since then Google and others can match video ads to keywords used during internal video search and post search advertising.

  • Ed

    I agree this is very interesting and could be very beneficial.
    But Pluggd seems a mess right now. They’re receiving coverage by SEJ, and yet they have dead links on the Featured items on their homepage, and a blog that’s 8 months in arrears.

  • Arun Radhakrishnan

    Hi Ed. Thanks for pointing that out. The firm has some great technology for monetizing media content and it was that I wanted to showcase in the article.

  • Tim Cohn

    Surely its not Vaporware!

  • Ed

    Arun, your coverage was fine, and I’m glad you alerted/reminded us of these developments.
    I only meant that if SEJ covered me, I’d have all the lights on, the candy dishes full, and the pillows fluffed up.
    In other words, if your relaunching, and a top site like SEJ could take notice…..
    Thanks again,