You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This error is triggered when I evaluate with alpaca_eval version1. baseline is text_davinci_003 and evaluatior is gpt4. It was evaluating fine up until this point, and in the last couple of days it's been a problem
script:
alpaca_eval --model_outputs /data/local/user/fanyi/github/Humback/results//model_outputs.json --annotators_config 'alpaca_eval_gpt4_turbo_fn'
error:
openai.BadRequestError: Error code: 400 - {'error': {'message': "The response was filtered due to the prompt triggering Azure OpenAI's content management policy. Please modify your prompt and retry. To learn more about our content filtering policies please read our documentation: https://go.microsoft.com/fwlink/?linkid=2198766", 'type': None, 'param': 'prompt', 'code': 'content_filter', 'status': 400, 'innererror': {'code': 'ResponsibleAIPolicyViolation', 'content_filter_result': {'hate': {'filtered': False, 'severity': 'safe'}, 'jailbreak': {'filtered': False, 'detected': False}, 'self_harm': {'filtered': False, 'severity': 'safe'}, 'sexual': {'filtered': True, 'severity': 'medium'}, 'violence': {'filtered': False, 'severity': 'safe'}}}}}
The text was updated successfully, but these errors were encountered:
This error is triggered when I evaluate with alpaca_eval version1. baseline is text_davinci_003 and evaluatior is gpt4. It was evaluating fine up until this point, and in the last couple of days it's been a problem
script:
alpaca_eval --model_outputs /data/local/user/fanyi/github/Humback/results//model_outputs.json --annotators_config 'alpaca_eval_gpt4_turbo_fn'
error:
openai.BadRequestError: Error code: 400 - {'error': {'message': "The response was filtered due to the prompt triggering Azure OpenAI's content management policy. Please modify your prompt and retry. To learn more about our content filtering policies please read our documentation: https://go.microsoft.com/fwlink/?linkid=2198766", 'type': None, 'param': 'prompt', 'code': 'content_filter', 'status': 400, 'innererror': {'code': 'ResponsibleAIPolicyViolation', 'content_filter_result': {'hate': {'filtered': False, 'severity': 'safe'}, 'jailbreak': {'filtered': False, 'detected': False}, 'self_harm': {'filtered': False, 'severity': 'safe'}, 'sexual': {'filtered': True, 'severity': 'medium'}, 'violence': {'filtered': False, 'severity': 'safe'}}}}}
The text was updated successfully, but these errors were encountered: