The asteroids we should worry about