Using controllers from an external assembly in ASP.NET Web API

I have always been a big fan of placing MVC controllers outside the actual web application project, in a separate class library (or libraries). Let's explore how we can do the same for ASP.NET Web API - in both latest Codeplex builds and in RC.