To make this go away I had to wipe my RubyMine settings (~/.RubyMine) and configure everything again. Fun.
~/.RubyMine