After fooling around with atos and symbolicate (which does work in the organizer), I found dwarfdump which works well enough for me.
Just open terminal, cd to the directory that has your .dSYM, and then run:
dwarfdump -a yourAppName.app.dSYM
dwarfdump will output all the symbols and addresses for your dSYM file. Good enough for me. Just find the closes match when you get a crash.