Mortgage advisers say they're getting a raw deal, and house-buyers are suffering.