The site looks incomplete without the header ads. It seems like something is missing with them being removed. I say keep the header ads and remove everything else, specially the flash ads below the CB.
Again, why should you not try to make profit? The header ads aren't intrusive at all. You got a great site here and if the ads enables you to make some money without getting in the way of users, why not?