A 5.5 metre boat carrying four people on a fishing trip to Rottnest left from Cockburn Sound on Wednesday night, but had not returned by Thursday evening.