My problem was that I didn't find an easy way to have it connect automatically - I was using Adium in Mac OS. Adium is a multi-protocol chat program, so some of the way it works doesn't fit very naturally with IRC, but I didn't want to run a separate program.
It would be nice to have the channel joined and messages logged even if the chat window was closed, but this doesn't seem to be possible in the currently released version (http://trac.adium.im/ticket/12068). Until this is implemented, I plan to just minimize the window.