A Common Design Problem – Should the Primary Key Always be a Clustered

The question is does the change of any column as Primary Key should also create a Clustered Index? Moreover, is there any case, where one would not do the same?