A London bookseller, who was visiting the place, heard of this clever lad, and took him into his shop as an errand boy; but Joshua found that his concern was more with the outside of books than the inside, and came home, at the end of five months, to his father's loom.
He was a steady lad, with no passions save for reading and quiet heartfelt religion; but though he had never been guilty of any serious fault, the Baptist body to which his family belonged considered he had too much "head-knowledge" of Christianity to have much "heart-knowledge" of its truths; and for that reason only, and their distrust and contempt of human learning, refused to admit him to baptism.
However, this was no obstacle either to his marrying the daughter of a minister of his own persuasion, or taking the mastership of a school at Bristol, where he found less narrow-minded co-religionists, and was baptized by them in 1734, when twenty-six years of age.

He was a successful schoolmaster, and was likewise able to join the classes at Bristol Academy, where he studied thoroughly Latin, Greek, Hebrew, and Syriac.

His circumstances were prosperous and rapidly improving when, after five years of great comfort at Bristol, his mind became so imbued with the sense of the need that some one should assist Carey, that he offered himself, together with Ward and two other young men, one of whom he had recently brought back to Christianity from Tom Paine's infidel doctrines.

Again his "human learning" stood in his way.

The honest, ignorant men who were working so earnestly, fancied it connected with Pharisaism, and had little idea that the Brahmin philosophy was as hard to deal with as the Greek.