R-Search

The Large Language Model (LLM) should output in the following format:

Reasoning process + Search planning results - DAG + [Search results] + Final generated result

Installation

1. PyTorch: Install PyTorch version 2.6.
2. trl: Install from GitHub:

   pip install git+https://github.com/huggingface/trl.git

3. lagent:

   cd lagent
   pip install -e .

Data Processing

Data clustering uses data/clusters.py, and dataset generation and filtering use data/qa_gen.py.

Training

To train the model, run the following script:

sh train.sh