You can, but you need a special license and a diesel car. You also need to let the police know ahead of time. According to Tim Minchin, very few people actually drive through the middle of Australia, and it is mostly occupied by the Aboriginal communities.