Matthew Henry Baron Butz von Rolsberg (*1673 Zlabings - †1748 Mayres), an Imperial postmaster, purchased the Mayres estate in 1713 for 18,000 guilders. He had a baroque chateau built on the site of the fortress in 1717.

Baron John II. Baptist Joseph of Madrowsky, the Regional Commissioner of Znaim, bought the estate in 1790 for 22,600 guilders from Matthews' grandson Maximilian.

Just three years later, the estate was acquired for 27,750 guilders by John Ignatius Rupp von Ehrenstrohm, the Governor of the Olmütz region, originally from Finland. In 1799, he was knighted in Vienna by Emperor Francis I. of Austria as one of his best beekeepers and honey producers.

His sons Frank and William built the chapel of Our Lady of Help in 1817 after the difficult year of famine. Frank also had a cotton mill established in 1820 and was instrumental in the development of fruit growing.

The second-born son William had an affair with his maid, Catherine Wimmer of Holleschitz near Sitzgras, and in 1815 their son Georg Wimmer, was born. William paid for his studies in Vienna and Georg eventually became the personal medical doctor of the infamous Belgian King Leopold II.

From 1823 to 1840, the allodial estate was owned by the Bavarian Royal Chamberlain and Captain, Frank Knight of Leon. In 1826, he had a cattle feedshed established.

In 1840, Baroness Bertha of Erben, the widow of John Joseph of Erben, "I&R" (Imperial & Royal) Court Councilor, bought it from him. In 1842, she advertised to lease a recently built distillery for 500 guilders per year.

The estate owned by Ferdinand Bischoff-Widderstein was offered at public auction in 1845.

In subsequent years JUDr. Johann Dworaczek (* 1808 Tischnowitz - † 1865 Vienna), a Viennese court and trial lawyer, also a member of the Moravian Provincial Assembly, is mentioned as the owner.

After him, there is a mention of Wenzl Welz from Gutenbrunn near Malsching.

Leo von Stangler from Koschetitz purchased the estate from him in July 1880 and on August 1st the marriage of his daughter Milada Agnes Mary took place in Mayres.

In 1898, Mayres was purchased by Helene Mary Adolphine Freifrau of Offermann - Schindler (*1854 Rzeckowitz - † 1914 Vienna). She used the chateau as her summer residence and restored and enlarged it in the neo-Gothic style and had a new chapel built. Its interior was much admired. She commissioned an English park with a gazebo where live music was played. Boats rides took place on the moat behind the castle. She also had a hunting lodge built towards the Tri-border. There also used to be a gamekeeper's cabin nearby.

After her death, her second husband Iwan Baron of Offermann took over the estate, who then sold it to Count František Dobřenský. In January 1915, he sold everything for 500,000 crowns to the Association of Jewish Refugees from Bukovina. Alois Löbenstein and company became infamous for cutting down trees and having a total of 130 hectares of trees from the entire area monetized.

They sold the property for a million more to Schulim and Jetti Schreyer from Galicia, who donated a new bell to the Chapel of Our Lady of Help in 1920.

In 1920, the extended Chromeček family, originally from Beňov, Moravia was registered at the manor home, farming in the surrounding area.

The industrialist Schreyer died in August 1920 and the castle with the park and courtyard was put up for sale in 1922.

On May 20, 1922, Joseph Miesler from North Bohemia bought the property. He and his wife Theresia, known as Resi, ran a boarding house there.

In 1929, it was offered for sale by the Mieslers.

After the withdrawal of the borderlands in 1938, the castle was home to Reich Labor Service for Female Youth (RADwJ).

The Offermann's hunting lodge towards the Tri-border was renamed "An der Sonnleiten" and served the Provincial Commission for the Protection of Children and Youth from Brünn as a holiday home.

After the liberation, the Russian army was stationed in Mayres until September 1945.

After the castle was confiscated by the Czechoslovak Ministry of Agriculture, it was used for cultural events as well as a warehouse.

Around 1952, a murder took place during a celebration in the castle. Due to an argument about the establishment of the Uniform agricultural cooperative” (JZD), one of the farmers from Mayres was thrown from the balcony. The perpetrators took his body to his house and fled.

After its establishment in 1955, the JZD turned the castle chapel into a garage for agricultural machinery and the dance hall into a fertilizer warehouse. Part of the parquet was stolen and another part was damaged by stored saltpeter.

That was the beginning of the end for the castle. In the 1980’s, a foreign film crew was allowed to film a scene in a war film in exchange for foreign currency. A partisan attack on the Gestapo office was simulated, during which windows painted with flammable material were set on fire.

The locals eventually dismantled the rest for material. Today, a "piece" of the castle can still be found in almost every house in the area.

The bell from the castle chapel was stolen before 1989. Someone stole the altar from the Church of Our Lady of Help after the revolution.

Only the torso of the left wing which used to be the kitchen, has survived from the castle and a group of 300-year-old oaks in the middle of the overgrown park along with the larch alley towards Fratres which used to be a stop on the old postal route from Prague to Vienna.

The ruin is inadequately fenced and not preserved, so it was removed from the Monuments catalogue in 2009.