Following its erection in 1928, the Bishop's Fountain (Püspök-kút) stood at its original location—where the Orb Monument (Országalma) stands today—for a brief period of just 9 years.

It was dismantled in 1937, as Ferenc Sidló's statue of Saint Stephen was originally intended for that site. The Bishop's Fountain was relocated to the square in front of the railway station, and after the war, the statues of the bishops were removed from it. Fortunately, the works were preserved in the museum. In July 1972, the fountain was moved to its current location.

During the Ottoman era, an icehouse stood on the site of the Orb Monument (Országalma). A timber beam from it was discovered during a later excavation, and to this day, it is preserved in Bory Castle.