Archives For Rich Media

1749731173_9616916fceNote: All comments are my own and may not reflect those of my employer.  This is a living position so I retain my right to edit and note the edits below as the conversation evolves.

For years when I worked on Web video and audio technologies from Xing MPEG, to Progressive Networks and RealNetworks, Windows Media and beyond, Jan Ozer was one of the most unbiased and critical analysts of subjective video quality during his tenure at PC Magazine, and more recently at Streaming  Jan just posted his comparison of H.264 to VP8 and his results should start to refine the conversation around the future of video formats as Adobe, Apple, Google, Microsoft and the MPEG LA  set their positions for the next decade.  But before we get into the details, a quick primer on Video codecs, their impact on the Web and beyond.

Why do Codecs Matter?

Let me start by saying no reasonably consumer should need to think about video codecs.  Video should just work and quality should be good to great depending on the screen.  But for companies whose business models depend on the economics of video, the stakes are very real as you consider cost of compression in time, hardware requirements, and licensing costs.  Nearly all video compression formats today use perceptual methods to compress video into a “lossy” form by throwing out information the human eye isn’t likely to notice – not too dissimilar to how MP3 or JPEG images work today.  These methods are governed today by patents.

The reason we can enjoy great HD video quality and streaming video over the Internet today is really due to three things:

  1. Improved methods for compressing video and audio
  2. Faster processors to crunch large volumes of math representing the video & audio
  3. General acceptance and adoption in the industry (a long way of saying the vaunted “Ecosystem” word).

But to a consumer, the real value of implied or implicit standards in video is: “Just make sure I can watch it where I want, on what I want.”  Put another way, “Make it good enough, make it work”.  That’s where things start to break down.

A Brief History of a Decade of Web Video
A decade ago, three video formats battled it out – MPEG, Windows Media, and Real Video for postage stamped video delivery.  Each was instrumental in establishing the underpinnings of delivering video over the Web.  In the past 5 years, the quick maturation of Web video disrupted the marketplace with Flash promoting VP6, a technology Adobe had licensed from a smaller company called On2. Other codecs were available for Flash, but VP6 offered a better quality and cost structures. The explosion in popularity of Web video sites such as YouTube benefited from the dual ability to create their own branded video players and experiences on top of Flash and Flash Video on basic Web servers.

Meanwhile, MPEG and other codec technologies were absorbed into the emergent H.264 video standard.  Adobe, Apple, Microsoft, and others announced support for H.264 which is managed by a patent pool and licensing group called the MPEG-LA, LLC of which many companies including my employer are a member.  MPEG LA assembles patents for most consumer electronics-based digital video in the market today including those used in DVD and Blu-Ray, satellite and cable TV and receive royalties for their work in lieu of creating and promoting their own formats.

But others continued to work on their own format. On2 continued to plug away on their video codecs with primary licensor Adobe benefiting until being acquired by Google last year for their VP8 video codec.  What is VP8 you might ask?  Google also announced intent to release VP8 as WebM – an open-source, royalty free alternative to H.264 for use in HTML5 – the next-generation standard for Web browsers.

So a decade later we have H.264 (MPEG) and WebM (VP8) vying to be the de-facto video standard for the next-generation Web browser standard and beyond. For professionals, the dimensions they will evaluate on continue to be the same: Quality, Cost, and Reach.

Quality: When is it “Good Enough”?

The key value proposition for a codec provider a decade ago was who could deliver smoother, bigger, more TV-like video over the Web.  Each company strived to show how their video was better than the competition at delivering VHS, DVD, and later HD quality at a fraction the size.  But when does the video quality become “Good Enough”?  One could argue we’re approaching these limits already.  As Jan Ozer found in his recent evaluation of H.264 and VP8:

“H.264 still offers better quality, but the difference wouldn’t be noticeable in most applications.”

Based on Jan’s first evaluation, it sounds like VP8 is “Good Enough” in terms of quality.  More studies will need to be done but on face-value, the key points of differentiation have already shifted away from video quality to other dimensions of cost and reach.

Cost: What is the definition of “Free”?

In the past two years, the industry has seen rapid adoption of H.264 as an HD-ready alternative for consumer electronics and web-based experiences.  Many articles have been written regarding the pros/cons of the H.264 licensing terms which I won’t rehash here.  What’s different is Google’s approach.  With WebM they look to provide a free,royalty free route for licensing WebM and offering it up as a part of HTML5.

Reach: The Three Waves of Adoption

Next, you have industry adoption/reach.  Generally speaking, video formats seen three waves of adoption:

  1. Client Software – PC and/or Mac, new video formats today are first tested and proven for encoding, playback, and distribution via software encode/decode.  This is why certain video formats today eat up so much CPU – they run in software only.
  2. Servers & Solutions – Again, an offshoot of software, but here we see enhancements such as ability to deliver live content as well as on-demand from a server-type solution.  Integration partnerships ramp, solution providers and integration specialists for industries from video distribution to advertising support and you start to see Content Delivery Networks (CDNs) adopt the format en masse.
  3. Hardware Adoption – The last step is burning the format into silicon and/or enabling special software at the hardware level to accelerate at each point in the value chain: Creation/encoding, Distribution, and Client Playback.  This is the point at which you see everything from mobile phones to set-tops able to reasonably play back a format. Five years ago, a newer PC
    laying H.264 video would have pegged the processor; today’s latest smartphones can play it without issue. This because the device includes dedicated circuitry to decode the video while being conscious of things such as battery life.

Each of these waves are increasingly essential for any provider to play in.  The latter represents maturity.  Google has announced new hardware partnerships for Google TV that will offer hardware accelerated support for WebM “later”.  H.264 is further along in its maturity and adoption curve.

Where the Players and Lining Up

If you look across the landscape, the top players here are Adobe, Microsoft, Apple, Google and MPEG LA – and each has expressed their opinion on the matter.  So where do they stand?

Adobe – has announced they will support VP8/WebM in an undated future release of Flash Player.

Microsoft – will support choice of formats in Internet Explorer 9 and Silverlight .  Dean Hachamovitch recently posted the official response:

“When it comes to video and HTML5, we’re all in. In its HTML5 support, IE9 will support playback of H.264 video as well as VP8 video when the user has installed a VP8 codec on Windows.”

The Silverlight team also recently affirmed their position in a recent blog post.

Apple – So where does this leave Apple?  Steve Jobs recently responded to a customer mail noting:

“All video codecs are covered by patents. A patent pool is being assembled to go after Theora and other “open source” codecs now. Unfortunately, just because something is open source, it doesn’t mean or guarantee that it doesn’t infringe on others patents. An open standard is different from being royalty free or open source.”

Google – pretty clear considering they’re behind VP8/WebM and use H.264 today.  Some in the industry ask will Google force all YouTube video to WebM, putting pressure on Apple and others to follow?

MPEG LA – MPEG LA is reportedly investigating VP8/WebM in the interest of building a patent pool.

For those of us in the industry, more interesting times ahead, but this script feels a little like a Bill Murray film where we’re the weather man. Will hardware vendors be fast or slow to adopt VP8?  Will industry professionals adopt one or both, or wait and see?

What do you think?  Feel free to post here or email me at sean at (fixing the at).

Update (05/23/11 7:30pm) – PC Magazine’s David Murphy also has a good recap though I think he’s oversimplifying the number of profiles that would be used in real-world use.

Photo: Fight for your Mind, by just.Luc on Flickr via Creative Commons license.

(Ed. Note: Thanks to Techradar for naming our Yule Log Visualization for Windows Media Player one of the Top 60 free apps for Windows at #4)

If you know me, you know I can go a little Clark Griswold this time of year.  I love the holidays and spreading a little Christmas cheer.  So here are a few of my favorite downloads, dusted off and repackaged for Windows 7.    With apologies to my friends in the southern hemisphere, I’m keeping the Winter Fun Pack naming convention ;).  So this year I’m super-sizing my blog post on fun PC projects with features that are simplified by Windows 7.  Please note that this is not an official release from Microsoft, rather something I like to do for fun.  So here goes:

#1 NEW: Add a Winter Desktop Theme to Windows 7

imageThis combination of Winter wallpapers and sound effects are sure to warm your heart and will be familiar to those who installed the Windows XP Winter Fun Pack back in 2003 as this is a re-release, simplified by Windows 7.  I tried to take care not to overdo with the sound effects but you’ll find a few little additions I think you’ll enjoy.  To install, just run the .themepack file on your Windows 7 desktop.  The wallpapers are set to change every 30 minutes, but feel free to choose your own.

Download Winter Desktop Theme for Windows 7 via Skydrive (5MB):

#2 Add a Yule Log Visualization for Windows Media Player to Windows 7

This was one of my favorites and the good news is that it’s been tested and works great with Windows 7.  Watch as the Yule log flares along to your favorite holiday music in Windows Media Player.  A bit of trivia – we commissioned Frog Design to create this back in 2003, inspired by years of the 24 hour Yule Log on WPIX 11 in New York on Christmas Eve/Day.   Little did we know then what a classic it would become.

Download Yule Log Viz for Windows Media Player via Skydrive (1.9MB)

#3 Quickly get to Holiday Autoplaylists with Windows 7

image Another oldie but goodie – unzip these playlists to your default folder (e.g. My Music) and Windows Media Player will create playlists based on holiday music in your library.  Not only good for finding the music based on common keywords, but also for removing those tracks from your library after the holidays.  In music mixology, nothing is worse than “Jingle Bells” in the middle of a 4th of July party.  You’ll find playlist selections including “All”, “Fresh Tracks” for music added in last 7 days,  “One Audio CD Worth” and “One Data CD-R Worth” in the mix for holidays of multiple denominations.  To install, just unzip into your My Music\Playlists folder.

Download WMP Holiday Autoplaylists via Skydrive (15.5KB)

#4: Create a Holiday Trivia Slideshow with Windows Media Center and Windows 7

A few years back, I built a pack of trivia questions as slideshow images that could be used as a slideshow on Xbox 360 or Windows Media Center.  Organization is now simplified with the Slideshow creator built into the Windows 7 Media Center – Pictures feature – just pick your Pictures, add the trivia questions and music, and you’re set for your next holiday party.  Trust me, friends will ask how you did it.  You can learn more here at my original post.

Download Christmas Trivia Pack #1 (.zip, 3MB)

Except for the Desktop Theme, most if not all of the above should work on earlier versions (XP, Vista) but some of the features are easier/more intuitive on Windows 7.  In the coming week, I’ll post additional clips here as well as my own How To for a cool Holiday outdoor display I’m doing this year created with Windows Live Movie Maker and powered by Windows 7.

If you like the Holiday add-ons, please let me know in comments here and tell your friends.  Happy Holidays everyone!

At the Windows Media Center event at CEDIA this week, Microsoft announced what many enthusiasts have been waiting for with baited breath: a relaxing of restrictions which made Windows Media Center less attractive to existing PC owners or enthusiasts building homegrown PCs.  The announcements included:

  • Digital Cable Tuner (DCT) support for all.  Up until now, you could only get a digital cable tuner for your PC to work on a pre-built PC from manufacturers such as Dell or HP.  PCs needed to be pre-qualified by CableLabs in what was a process that left a lot of enthusiasts unable to support digital cable on their PCs.  Soon, anyone who builds a PC will be able to enjoy digital cable tuning.  I’m sure ATI is happy as well as one of the premier builders of  cable tuner hardware.
  • TV Portability. As one who has two DCTs on my HTPC, I can relate to the frustration that has existed when trying to copy that content to a portable device such as my laptop or Zune.  Programs such as local television flagged as “Copy Freely” (CF) will now transfer.  I can confirm this works, I’ve seen it in action.
  • SDV Support. This doesn’t mean much to consumers other than ensuring future aggravations are avoided.  As cable systems move to “Switched Digital Video“, as a means of managing their clogged networks by pushing a live feed on an empty channel when a consumer requests to view the network vs. blindly broadcasting all networks on all available channels.  The problem is it requires new hardware to talk to the cable operator and request the channel. 
  • New ATI DCT Firmware for Vista and Windows 7. The new firmware (yet to be released) by ATI for their Digital Cable Tuners will enable the above support.  I can also attest that this new firmware will bring smiles to Media Center fans as I’ve seen it running.  You can expect improvements to the update experience as well – stay tuned for more.

Additional discussion is going on over at  Details on availability haven’t been released yet, but I think we can all expect to see good things October 22nd.  Hopefully this quells concerns about the future of digital cable support in Windows 7.

This got me to thinking – a Windows 7 Media Center builder party in the Seattle area around October 22nd could be fun.