Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

问题:请问cpm-bee中的微调是指finetuning吗?cpm-bee可以进行Prompt enginering吗?(指令微调,或者chain of thoutht微调) #104

Open
summerghw opened this issue Sep 18, 2023 · 2 comments

Comments

@summerghw
Copy link

No description provided.

@summerghw
Copy link
Author

summerghw commented Sep 18, 2023

image
1。这里看到BM体系里是包含finetuning 和prompt的。但是在文档中,只找到了一个微调的段落。请问该微调属于哪一种?
image

  1. 请问cpm-bee属于第一种还是第二种模型?
    image

@summerghw summerghw changed the title 问题,cpm-bee中的微调是指finetuning吗?cpm-bee可以进行Prompt enginering吗》(指令微调,或者chain of thoutht微调) 问题:请问cpm-bee中的微调是指finetuning吗?cpm-bee可以进行Prompt enginering吗?(指令微调,或者chain of thoutht微调) Sep 18, 2023
@EnHuiPug
Copy link

  1. 文档里面的全量微调是指图里面的fine tuning,增量微调是指delta tuning
  2. 第一种,但是你的描述不准确,一般来说都是先训练出来基座模型(比如 qwen-base,然后用基座模型SFT出来一个SFT模型(比如 qwen-chat),所以你不应该问CPMBee是哪种模型,而是问开源出来的这个模型参数是哪种模型,答案是基座模型。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants