When Bill O'Reilly left for vacation after revelations of payouts related to sexual harassment allegations caused advertisers to flee his show, the big question was whether he'd come back to host The O'Reilly Factor. Now we know the answer is no.