Having stepped up from his first-team coach role to take over from Dougie Freedman for the final ten matches of the season, Williams leaves the club ahead of the expiry of his contract this summer.
He said: "This club has so much potential and, when you see the backing the club receives from the supporters both home and away, I truly hope they are rewarded for their loyalty with success on the pitch."