Jimmy, the third new arrival of that summer transfer window to have previously played for Cambridge, was released by the Amber Army at the end of the 2015-16 season. He scored in his final game for Cambridge, coming off of the bench to net in a 2-2 draw against Argyle. It did not take long for Leeds-born Jimmy’s footballing ability to be spotted. He was recruited by nearby Huddersfield Town at the age of seven, and progressed through the club’s entire youth system in a decade to appear for the first team in 2012.
Following his first move away from the Terriers in a brief spell at Northwich Victoria, Spencer had a pair of impressive loan deals at League 2 level - firstly with Morecambe, averaging a goal every four games, followed by ten goals in 41 appearances for Cheltenham Town. Those loan moves earned Jimmy opportunities in Huddersfield’s senior squad at the beginning of the following season, when he played in both league and cup competitions and signed a one-year contract extension before testing himself at League 1 level with Brentford and Crawley, the latter spell cut short through injury.
A final loan move to Scunthorpe United preceded Jimmy’s 12-year affiliation with Huddersfield Town, as he and Town agreed to terminate his contract in January 2014 to allow him to sign for Notts County. Thirty-two games for the Magpies included six goals for the forward, but County opted to not renew his two-year contract, leading to his short stay at Cambridge last season.