The former prime minister has urged voters not to "romance" the idea of a protest vote in this weekend's Wentworth byelection.