This article looks at how the ‘Mystery Shopper’ methodology used by a consortium of universities was adapted to assess the usability of the library web pages of all four universities. Using a methodology refined from a previous web usability exercise, the various elements in the process are described. The outcomes of the project are briefly discussed, along with lessons learnt from the process.