Lippol94 dropped some shiny news off in the OMG! Inbox! this morning – Rhythmbox no-longer exits when you press the ‘close’ button.

In Lucid pressing the ‘close’ window button minimized the main window to the Rhythmbox indicator. With the introduction of the new Sound Menu in Ubuntu 10.10 the last few months have required Maverick users to have Rhythmbox fully open on the desktop (or sat in the panel/dock) all the time.

The Sound Menu now supports minimizing to and maximizing from – a small little issue I’m so glad has finally been resolved.

It *does* have an Icon, i just haven't logged out since applying the update.
maverick Rhythmbox soundapplet soundmenu