Formula 2 & Observation 2

[renmengjie7]

论文中的observation2, 是否应该为负相关?

We assume rsk is the PRM’s output sigmoid score at k-th step
请问 rsk 是r-th step的reward吗? 该定义下, 与公式2的设计有些矛盾

[Wloner0809]

论文中的observation2, 是否应该为负相关?
We assume rsk is the PRM’s output sigmoid score at k-th step 请问 rsk 是r-th step的reward吗? 该定义下, 与公式2的设计有些矛盾

I'm also confused about this formula. Actually I think $1-2r_{s_k}$ should be $2r_{s_k}-1$.

[zhoubiansining]

Here our definition of $r_{s_k}$ is consistent with the one in appendix, representing the PRM's output score, not the reward. And the reward for the step is actually $1-r_{s_k}$.