Unlike other desktop version, Spotify Linux version doesn’t have Menu to toggle to offline mode (at least until this post written).

But if you use 1.0.47 or later, you should be able to toggle offline mode by pressing CTRL+SHIFT+O.
Make sure you already download all of the songs on your playlist.