RIT-RAG (Retrieval-Induced Tree RAG) is a new method that combines content retrieval with structural navigation to improve the accuracy of language models in answering questions. It builds a tree for each document and uses its structure to guide the model in retrieving relevant information. RIT-RAG outperforms other methods on several benchmarks, including a new benchmark of 2.84 million technical-documentation webpages.