Skip to content

Latest commit

 

History

History
166 lines (164 loc) · 3.62 KB

File metadata and controls

166 lines (164 loc) · 3.62 KB

Results of GPT-3.5 on HumanEval/45

Date: 18 July, 2023
Model: gpt-3.5-turbo
Temperature: 0.2
Passing runs: 10
Total runs: 10
Success rate: 100%

Prompt

Tokens: 72

def triangle_area(a, h):
    """Given length of a side and high return area for a triangle.
    >>> triangle_area(5, 3)
    7.5
    """

The above is an incomplete Python code fragment. Return the complete and correct code with no additional text.

Correct solution

def triangle_area(a, h):
    """Given length of a side and high return area for a triangle.
    >>> triangle_area(5, 3)
    7.5
    """return a * h / 2.0

Unit tests

METADATA = {}


def check(candidate):
    assert candidate(5, 3) == 7.5
    assert candidate(2, 2) == 2.0
    assert candidate(10, 8) == 40.0

Runs

✅ Run 1

Start time: 2023-07-18 17:21:00
Duration: 2.42s
Completion tokens: 50
Result: Pass

def triangle_area(a, h):
    """Given length of a side and high return area for a triangle.
    >>> triangle_area(5, 3)
    7.5
    """
    return (a * h) / 2

✅ Run 2

Start time: 2023-07-18 17:20:56
Duration: 3.68s
Completion tokens: 50
Result: Pass

def triangle_area(a, h):
    """Given length of a side and high return area for a triangle.
    >>> triangle_area(5, 3)
    7.5
    """
    return (a * h) / 2

✅ Run 3

Start time: 2023-07-18 17:20:54
Duration: 2.27s
Completion tokens: 50
Result: Pass

def triangle_area(a, h):
    """Given length of a side and high return area for a triangle.
    >>> triangle_area(5, 3)
    7.5
    """
    return (a * h) / 2

✅ Run 4

Start time: 2023-07-18 17:20:51
Duration: 2.58s
Completion tokens: 50
Result: Pass

def triangle_area(a, h):
    """Given length of a side and high return area for a triangle.
    >>> triangle_area(5, 3)
    7.5
    """
    return (a * h) / 2

✅ Run 5

Start time: 2023-07-18 17:20:49
Duration: 2.66s
Completion tokens: 55
Result: Pass

def triangle_area(a, h):
    """Given length of a side and high return area for a triangle.
    >>> triangle_area(5, 3)
    7.5
    """
    return (a * h) / 2

✅ Run 6

Start time: 2023-07-18 17:20:46
Duration: 2.38s
Completion tokens: 50
Result: Pass

def triangle_area(a, h):
    """Given length of a side and high return area for a triangle.
    >>> triangle_area(5, 3)
    7.5
    """
    return (a * h) / 2

✅ Run 7

Start time: 2023-07-18 17:20:43
Duration: 2.8s
Completion tokens: 50
Result: Pass

def triangle_area(a, h):
    """Given length of a side and high return area for a triangle.
    >>> triangle_area(5, 3)
    7.5
    """
    return 0.5 * a * h

✅ Run 8

Start time: 2023-07-18 17:20:41
Duration: 2.18s
Completion tokens: 50
Result: Pass

def triangle_area(a, h):
    """Given length of a side and high return area for a triangle.
    >>> triangle_area(5, 3)
    7.5
    """
    return (a * h) / 2

✅ Run 9

Start time: 2023-07-18 17:20:39
Duration: 2.3s
Completion tokens: 50
Result: Pass

def triangle_area(a, h):
    """Given length of a side and high return area for a triangle.
    >>> triangle_area(5, 3)
    7.5
    """
    return (a * h) / 2

✅ Run 10

Start time: 2023-07-18 17:20:36
Duration: 2.77s
Completion tokens: 50
Result: Pass

def triangle_area(a, h):
    """Given length of a side and high return area for a triangle.
    >>> triangle_area(5, 3)
    7.5
    """
    return (a * h) / 2