docs: Cookbook for self-instruct (#1451)

camel-ai · Jan 15, 2025 · 1b5fc20 · 1b5fc20
1 parent 96c83d2
commit 1b5fc20
Show file tree

Hide file tree

Showing 11 changed files with 1,017 additions and 1,088 deletions.
diff --git a/README.md b/README.md
@@ -273,10 +273,10 @@ Practical guides and tutorials for implementing specific functionalities in CAME
 ### Model Training & Data Generation
 | Cookbook | Description |
 |:---|:---|
-| **[Data Generation with CAMEL and Finetuning with Unsloth](https://docs.camel-ai.org/cookbooks/model_training/sft_data_generation_and_unsloth_finetuning_Qwen2_5_7B.html)** | Learn how to generate data with CAMEL and fine-tune models effectively with Unsloth. |
-| **[Data Gen with Real Function Calls and Hermes Format](https://docs.camel-ai.org/cookbooks/model_training/data_gen_with_real_function_calls_and_hermes_format.html)** | Explore how to generate data with real function calls and the Hermes format. |
-| **[CoT Data Generation and Upload Data to Huggingface](https://docs.camel-ai.org/cookbooks/model_training/cot_data_gen_upload_to_huggingface.html)** | Uncover how to generate CoT data with CAMEL and seamlessly upload it to Huggingface. |
-| **[CoT Data Generation and SFT Qwen with Unsolth](https://docs.camel-ai.org/cookbooks/model_training/cot_data_gen_sft_qwen_unsolth_upload_huggingface.html)** | Discover how to generate CoT data using CAMEL and SFT Qwen with Unsolth, and seamlessly upload your data and model to Huggingface. |
+| **[Data Generation with CAMEL and Finetuning with Unsloth](https://docs.camel-ai.org/cookbooks/data_generation/sft_data_generation_and_unsloth_finetuning_Qwen2_5_7B.html)** | Learn how to generate data with CAMEL and fine-tune models effectively with Unsloth. |
+| **[Data Gen with Real Function Calls and Hermes Format](https://docs.camel-ai.org/cookbooks/data_generation/data_gen_with_real_function_calls_and_hermes_format.html)** | Explore how to generate data with real function calls and the Hermes format. |
+| **[Self-instruct Data Generation](https://docs.camel-ai.org/cookbooks/data_generation/self_instruct_data_generation.html)** | Explore comprehensive guidelines and best practices for generating self-instructional data, enabling robust model training and improved performance. |
+| **[CoT Data Generation and SFT Qwen with Unsolth](https://docs.camel-ai.org/cookbooks/data_generation/cot_data_gen_sft_qwen_unsolth_upload_huggingface.html)** | Discover how to generate CoT data using CAMEL and SFT Qwen with Unsolth, and seamlessly upload your data and model to Huggingface. |
 
 ### Multi-Agent Systems & Applications
 | Cookbook | Description |

diff --git a/docs/cookbooks/applications/index.rst b/docs/cookbooks/applications/index.rst
@@ -2,7 +2,7 @@
 
    <div class="prev-next-nav">
      <a class="left-nav" href="../basic_concepts/index.html">← Basic Concepts</a>
-     <a class="right-nav" href="../model_training/index.html">Model Training →</a>
+     <a class="right-nav" href="../data_generation/index.html">Model Training →</a>
    </div>
 
 Applications

diff --git a/...sft_qwen_unsolth_upload_huggingface.ipynb → ...sft_qwen_unsolth_upload_huggingface.ipynb b/...sft_qwen_unsolth_upload_huggingface.ipynb → ...sft_qwen_unsolth_upload_huggingface.ipynb
diff --git a/...al_function_calls_and_hermes_format.ipynb → ...al_function_calls_and_hermes_format.ipynb b/...al_function_calls_and_hermes_format.ipynb → ...al_function_calls_and_hermes_format.ipynb
diff --git a/docs/cookbooks/model_training/index.rst → docs/cookbooks/data_generation/index.rst b/docs/cookbooks/model_training/index.rst → docs/cookbooks/data_generation/index.rst
@@ -15,5 +15,5 @@ Model Training and Fine-tuning
    sft_data_generation_and_unsloth_finetuning_Qwen2_5_7B
    sft_data_generation_and_unsloth_finetuning_tinyllama
    data_gen_with_real_function_calls_and_hermes_format
-   cot_data_gen_upload_to_huggingface
+   self_instruct_data_generation
    cot_data_gen_sft_qwen_unsolth_upload_huggingface
diff --git a/docs/cookbooks/data_generation/self_instruct_data_generation.ipynb b/docs/cookbooks/data_generation/self_instruct_data_generation.ipynb
diff --git a/...n_and_unsloth_finetuning_Qwen2_5_7B.ipynb → ...n_and_unsloth_finetuning_Qwen2_5_7B.ipynb b/...n_and_unsloth_finetuning_Qwen2_5_7B.ipynb → ...n_and_unsloth_finetuning_Qwen2_5_7B.ipynb
diff --git a/...loth_finetuning_mistral_7b_instruct.ipynb → ...loth_finetuning_mistral_7b_instruct.ipynb b/...loth_finetuning_mistral_7b_instruct.ipynb → ...loth_finetuning_mistral_7b_instruct.ipynb
diff --git a/...on_and_unsloth_finetuning_tinyllama.ipynb → ...on_and_unsloth_finetuning_tinyllama.ipynb b/...on_and_unsloth_finetuning_tinyllama.ipynb → ...on_and_unsloth_finetuning_tinyllama.ipynb