On his death the abbacy was given to a Norman monk, Walter of Cerasia, and in his time the great church of which some foundations still remain was begun.

The "wily Agelwy" had left "four chests of silver" towards this reconstruction, but this was not enough to build even the crypt and chancel, and we find Abbot Walter sending the chief treasures of the monastery, namely, the shrines containing the relics of Saint Odulf and Saint Egwin, round the country in charge of certain monks for the collection of more funds.
According to the monkish historian Saint Odulf refused to allow himself to be used for this purpose, and after one experiment the attempt was given up.

The story goes that the shrine was carried to Winchcomb and laid in the church there, with the intention of being brought out next day into the market-place for exhibition, and probably with the hope of some cures being effected.

But when the bearers tried to remove it from the church they could not with all their strength raise it from the floor; so the sermon was preached outside, a collection made, and the shrine (which now could be lifted with perfect ease) brought home.

The expedition with Saint Egwin was quite successful, and a considerable sum of money collected towards the building.
As time went on the Monastery waxed in wealth and importance, and succeeding abbots completed, furnished, and decorated the new church planned by Abbot Walter.