The poet, author and painter, Holger Drachmann, who first visited Skagen in 1871, bought his own house in Skagen in 1902 and named it Pax. Drachmann died in 1908 and in 1911 Pax opened as a museum dedicated to the life and times of Holger Drachmann. The furniture and inventory have been preserved. Works by Holger Drachmann as well as other Skagen painters from the period can be seen in the house.

Holger Drachmann was actually the founder of the artist colony in Skagen as, after his first visit to Skagen, he was so captivated by the place, that he promoted Skagen among his artist friends, who soon after started travelling to Skagen to practise the plein-air painting in these ideal surroundings.