Aliens Might Just Be Too Far Away