Okay to make this all cohesive with the editorial title of this post, my vote for the best band names swiped from song names would be (in random order):
Radiohead
We are Scientists
Blonde Redhead
Ladytron
Death Cab for Cutie
Math and Physics Club
Pretty Girls Make Graves