Using an English design, the Penfold Pillar Box was manufactured in Christchurch by P & D Duncan Ltd between 1894 and 1901. It was originally installed in New Plymouth before being replaced in the 1960s. It was once used to collect donations for the museum, but it has reverted to taking letters and is cleared every morning.

A recent visitor from England, who is a member of the Letter Box Study Group which is “the recognised definitive authority on the British letter box”, has confirmed that only about 25 of these boxes now survive in New Zealand.