Also, if you like a little edgier music around the same level of quirkiness... I can't recommend the Dismemberment Plan enough. I'd stay away from "Emergency and I" at first (even though it is a great album) and start off with "!" or "The Dismemberment Plan is Terrified." "Change" and "Emergency and I" are great albums, but may turn off some people at first... The Plan has wowed me for years though (mostly fueled by their live shows, pity they are no more)...
And after the plan, I'd go on a limb and say get anything you can by Spoon... especially "Series of Sneaks" and "Girls Can Tell"... fantastic rock band...
-Nick