We know without going.

They climbed the steep little peak we see on the right, from the crest of which they had a splendid view over an immense stretch of country behind us.

They looked in that direction because that was the point from which pursuit or danger would come.

The band behind us built a fire, and the Great Bear and Black Rifle saw its smoke.

They saw the smoke because they could see nothing else so far behind them.