This was already the highlight of his concept, which he developed with the architect Hans Hollein: The diverse, labyrinthine spaces of the building refused the historical sequence, and other connections were made between the works than those of chronology. "The visitor experiences it like Hansel and Gretel: They remember every little flower, because they have to find their way back."
The light, open, hierarchy-free house heralded, when it was opened in 1982, a new era of museum architecture in Germany. For it confronted contemporary art that not only demanded the viewer's participation but also practiced it. Like a "city within a city," Hollein composed a multi-part complex that accommodates various building types – tower, temple, and factory space. The entrance leads through a glass pavilion down a narrow staircase to the reception area, from which several paths lead into the fifteen individual rooms. Arranged on three levels, they are connected by a sophisticated system of stairs. The exhibition area covers 4,000 square meters.

"Forms of construction that encourage taking the artwork seriously and support interpretation," Cladders had wished, and worked so closely with Hollein that they and their families went on vacation together. Bringing the vision to life and, with cultural department director Busso Diekamp as the third member of the team, implementing it in the small city of 160,000 residents on the Lower Rhine was a cultural-political act of conviction: The carnival float "Scrap Dealer Cladders, Diekamp & Co." teased them for it.
However, the cultural flagship of the city, which architectural historian Wolfgang Pehnt welcomed as "masterpiece of architectural collage," did not always find the support of local politics and suffered due to the ebb of the city treasury. Central artworks, including "Tallow/Unschlitt" by Joseph Beuys, were withdrawn by collectors, and spaces had to be temporarily closed due to rain entering. The renovation was ultimately overdue and cost the city nearly five million euros: The outer facade, terraces, and steps were completely renewed, the roof was sealed, a new air conditioning system was installed, and fire safety measures were improved.