I actually contacted the DELWP about a similar issue.
I have had rabbits, foxes and deer walk onto the crown land along a creek that borders the farm that I hunt on.
I asked them if I could hunt pest animals on the crown land in question.
Their answer:
Dear M*******
Thank you for your recent enquiry to the Department of Environment, Land, Water and Planning Customer Service Centre.
The Department's response is:-
If the area is licensed crown land, you would need to seek permission of the licensee to hunt for pest animals. If it is unoccupied crown land, you are allowed to do so.
The following link to the website may be of assistance to you:
http://www.delwp.vic.gov.au/ If you require clarification or have a further enquiry, please do not hesitate to contact the Customer Service Centre on 136 186 between 8am - 6pm weekdays or email :
customer.service@delwp.vic.gov.au