Barnaby Joyce is interrupt his leave to attend the party's state conference before returning to work next week.