1983/84 saw three Managers at the helm of the Club. When Spike O’Neill resigned to take up a scouting position with Bangor F.C., Archie W alls took over in a caretaker capacity until a full-time appointment could be made. This turned out to be qualified I.F.A. Coach, Morris McCullagh who secured the runners-up position for that season. The league Champions by two points were Newtownards side, Roadhouse Royals who the Swifts had beaten in both their league matches.

In 1983 it was decided that the 1st. XI should replace their all white kit which had given them such great service. The Swifts returned to Jackie Cummings Sports to have a kit specially made by Octopus. The shirt was White with thin Yellow hoops and Blue “V” neck and cuffs and a set of plain White shorts and socks accompanied the kit. It soon became apparent that cotton shirts did not wear as well as shiny Polyester and this was the last occasion that the Swifts ordered shirts in that material.

Things did not work out too well for Morris and the following season saw Archie Walls return to the Managers position. Unfortunately the tide had definitely turned for the Swifts as far as league success was concerned as the continuing trend of players leaving to play at higher levels made it increasingly difficult to challenge for trophies. Despite these setbacks, the lst.XI managed to finish only two points behind the eventual Champions, another Newtownards side, Tudor Rangers.

Around this time, the Swifts were approached about the possibility of being joined with a Ladies team, when their manager, schoolteacher Dominic Keeley, attended a Swifts Committee meeting in January 1984. After much consideration, the Swifts formally invited the Ladies to affiliate in March of that year.
The team was composed mainly of former members of Holywood Girls F.C. and they were to be known as bangor Swifts Ladies. They were to be governed by their own elected Committee who were responsible for drawing up their own set of Rules.

Despite several of the girls having strong connections with members of the Swifts, the affiliation was not an overwhelming success although the two sections helped each other out to a certain extent.