If you have Spotify Premium, try a third party client. Even GUI clients like Spotify-qt are memory light [though not at feature parity] whilst terminal clients like ncspot, spotify-player take 1/10th the memory. The latter even supports Spotify connect.