I'm wanting to be able to converse. One of the reasons I wanted to learn the language is so that I can watch anime (especially Clannad) without subtitles. Also, my friend is learning Japanese too so it would be nice to be able to talk to him to practice. I would feel weird not being able to read and write the language but able to speak it so I learned hiragana, and will learn katakana in a bit. I don't know if I'll ever get around to kanji though, it's so overwhelming...
What's Pimsleur?
EDIT: And, if a book you could suggest was only written in kana, I might want to read it. While I know all the hiragana characters, I can't read very fast...