Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

meta-template pool retrieval and updating code #2

Open
GreenyWind opened this issue Jun 8, 2024 · 8 comments
Open

meta-template pool retrieval and updating code #2

GreenyWind opened this issue Jun 8, 2024 · 8 comments

Comments

@GreenyWind
Copy link

请问这部分代码计划什么时候更新呢?很想在生物问题上试试。

@YangLing0818
Copy link
Owner

Thanks for your attention. We may update this part a month later.

@xiezhipeng-git
Copy link

最关键的部分代码没有看到。能介绍下到底是模型总结的思维模板,还是人类总结的?是训练或微调中总结的还是推理中总结的?和针对问题处理过的rag又有哪些不同呢?

@weizhehuang0827
Copy link

最关键的部分代码没有看到。能介绍下到底是模型总结的思维模板,还是人类总结的?是训练或微调中总结的还是推理中总结的?和针对问题处理过的rag又有哪些不同呢?

我也同样想知道这块的具体细节,好像作者文章的意思是在evaluation的时候同步更新meta buffer

@ZhaochenYu0201
Copy link
Collaborator

Thank you for your attention. Our current repository only contains the basic part of our BoT, which is the demo version. The core code, including the meta buffer library and buffer manager, has not been released yet. Please stay tuned for updates.

As for the thought templates, they are generated by LLMs. During the construction phase of the meta buffer, we prepare three general coarse-grained thought templates for utilization. These thought templates are further instantiated from the three coarse-grained templates based on tasks and are refined by the buffer manager to form new thought templates.

The RAG mainly extracts facts related to the corresponding problems from external sources to address hallucination issues, thereby enhancing the accuracy of LLMs in answering professional questions in specific domains. However, it cannot provide precise guidance for complex reasoning problems. Compared to the RAG processed for tasks, our thought templates contain general approaches to problem-solving and represent abstract high-level thoughts that could help solve difficult reasoning problems.

For more details, please refer to our paper.

@dbinthesky
Copy link

缺乏最关键的代码,现在的运行逻辑是调用了test_templates.py里预定义的解题模板。paper中的一个关键手段是Problem Distiller,从问题中自动化地提取template,这个在现在的代码中并没有看到。

@ZhaochenYu0201
Copy link
Collaborator

目前我们开源的是不包含meta-buffer library和buffer manager的版本,之后我们会对这两个模块逐一更新,请大家耐心等待!同时针对这个问题我们在README中也有说明,感谢大家的关注!

@Lbaiall
Copy link

Lbaiall commented Jul 13, 2024

请问这部分代码计划什么时候更新呢?很想在生物问题上试试。

@GreenyWind 你启发于哪种生物问题呢,我也是想在动物行为推理上去进行启发和猜想

@gaoxix
Copy link

gaoxix commented Oct 24, 2024

Thanks for updating the core code about the buffer manager and meta buffer soon. I want to Leave two questions.
Firstly,now the thought templates is all about the program of thougts. So where is the difference between the PoT(progarm of thoughts) and the BoT.
Secondly, BoT has not feedback mechanism,so if through the reasoning process the answer is wrong,how to deal with the situation? or still save the high-level thoughts? how to address the more general ploblems?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

8 participants