Prior to this, Lyttle had established himself as a reliable defender with Swansea City, joining in July 1992 for £12,500. During his full season with Swansea, he made 46 appearances and scored one goal, contributing to the newly-promoted Second Division clubs fifth-place league finish. His professional foundation was laid at Leicester City in 1990, followed by a period at non-League side Worcester City from August 1991, where his strong performances caught the attention of higher-tier clubs. Lyttle continued his significant tenure with Nottingham Forest through their Premier League periods, notably contributing to their third-place finish in the 199495 season and remaining with the club across subsequent relegations and promotions.
In this influential role, he has achieved significant success, notably guiding school teams to an impressive 13 national finals between 2015 and 2016. His ongoing commitment at Thomas Telford School underscores his dedication to applying his profound knowledge of the sport in an educational and developmental context, consistently nurturing young athletes towards elite performance levels.