Skip to content

Latest commit

 

History

History
251 lines (249 loc) · 5.46 KB

47.md

File metadata and controls

251 lines (249 loc) · 5.46 KB

Results of GPT-4 on HumanEval/47

Date: 18 July, 2023
Model: gpt-4
Temperature: 0.2
Passing runs: 10
Total runs: 10
Success rate: 100%

Prompt

Tokens: 101

def median(l: list):
    """Return median of elements in the list l.
    >>> median([3, 1, 2, 4, 5])
    3
    >>> median([-10, 4, 6, 1000, 10, 20])
    15.0
    """

The above is an incomplete Python code fragment. Return the complete and correct code with no additional text.

Correct solution

def median(l: list):
    """Return median of elements in the list l.
    >>> median([3, 1, 2, 4, 5])
    3
    >>> median([-10, 4, 6, 1000, 10, 20])
    15.0
    """l = sorted(l)
    if len(l) % 2 == 1:
        return l[len(l) // 2]
    else:
        return (l[len(l) // 2 - 1] + l[len(l) // 2]) / 2.0

Unit tests

METADATA = {}


def check(candidate):
    assert candidate([3, 1, 2, 4, 5]) == 3
    assert candidate([-10, 4, 6, 1000, 10, 20]) == 8.0
    assert candidate([5]) == 5
    assert candidate([6, 5]) == 5.5
    assert candidate([8, 1, 3, 9, 9, 2, 7]) == 7

Runs

✅ Run 1

Start time: 2023-07-18 18:39:16
Duration: 9.41s
Completion tokens: 127
Result: Pass

def median(l: list):
    """Return median of elements in the list l.
    >>> median([3, 1, 2, 4, 5])
    3
    >>> median([-10, 4, 6, 1000, 10, 20])
    15.0
    """
    l.sort()
    length = len(l)
    if length % 2 == 0:
        return (l[length // 2] + l[length // 2 - 1]) / 2
    else:
        return l[length // 2]

✅ Run 2

Start time: 2023-07-18 18:39:05
Duration: 10.36s
Completion tokens: 136
Result: Pass

def median(l: list):
    """Return median of elements in the list l.
    >>> median([3, 1, 2, 4, 5])
    3
    >>> median([-10, 4, 6, 1000, 10, 20])
    15.0
    """
    l.sort()
    n = len(l)
    m = n - 1
    if (n % 2):
        return l[int((m)/2)]
    else:
        return (l[int(m/2)] + l[int((m/2) + 1)]) / 2

✅ Run 3

Start time: 2023-07-18 18:38:54
Duration: 10.68s
Completion tokens: 127
Result: Pass

def median(l: list):
    """Return median of elements in the list l.
    >>> median([3, 1, 2, 4, 5])
    3
    >>> median([-10, 4, 6, 1000, 10, 20])
    15.0
    """
    l.sort()
    length = len(l)
    if length % 2 == 0:
        return (l[length // 2] + l[length // 2 - 1]) / 2
    else:
        return l[length // 2]

✅ Run 4

Start time: 2023-07-18 18:38:44
Duration: 10.72s
Completion tokens: 136
Result: Pass

def median(l: list):
    """Return median of elements in the list l.
    >>> median([3, 1, 2, 4, 5])
    3
    >>> median([-10, 4, 6, 1000, 10, 20])
    15.0
    """
    l.sort()
    n = len(l)
    m = n - 1
    if (n % 2):
        return l[int((m)/2)]
    else:
        return (l[int(m/2)] + l[int((m/2) + 1)]) / 2

✅ Run 5

Start time: 2023-07-18 18:38:34
Duration: 9.4s
Completion tokens: 136
Result: Pass

def median(l: list):
    """Return median of elements in the list l.
    >>> median([3, 1, 2, 4, 5])
    3
    >>> median([-10, 4, 6, 1000, 10, 20])
    15.0
    """
    l.sort()
    n = len(l)
    m = n - 1
    if (n % 2):
        return l[int((m)/2)]
    else:
        return (l[int(m/2)] + l[int((m/2) + 1)]) / 2

✅ Run 6

Start time: 2023-07-18 18:38:24
Duration: 10.45s
Completion tokens: 127
Result: Pass

def median(l: list):
    """Return median of elements in the list l.
    >>> median([3, 1, 2, 4, 5])
    3
    >>> median([-10, 4, 6, 1000, 10, 20])
    15.0
    """
    l.sort()
    length = len(l)
    if length % 2 == 0:
        return (l[length // 2] + l[length // 2 - 1]) / 2
    else:
        return l[length // 2]

✅ Run 7

Start time: 2023-07-18 18:38:09
Duration: 14.9s
Completion tokens: 137
Result: Pass

def median(l: list):
    """Return median of elements in the list l.
    >>> median([3, 1, 2, 4, 5])
    3
    >>> median([-10, 4, 6, 1000, 10, 20])
    15.0
    """
    l.sort()
    n = len(l)
    m = n - 1
    if (n % 2):
        return l[int((m)/2)]
    else:
        return (l[int((m)/2)] + l[int((m)/2) + 1])/2.0

✅ Run 8

Start time: 2023-07-18 18:37:59
Duration: 9.69s
Completion tokens: 127
Result: Pass

def median(l: list):
    """Return median of elements in the list l.
    >>> median([3, 1, 2, 4, 5])
    3
    >>> median([-10, 4, 6, 1000, 10, 20])
    15.0
    """
    l.sort()
    length = len(l)
    if length % 2 == 0:
        return (l[length // 2] + l[length // 2 - 1]) / 2
    else:
        return l[length // 2]

✅ Run 9

Start time: 2023-07-18 18:37:48
Duration: 10.96s
Completion tokens: 127
Result: Pass

def median(l: list):
    """Return median of elements in the list l.
    >>> median([3, 1, 2, 4, 5])
    3
    >>> median([-10, 4, 6, 1000, 10, 20])
    15.0
    """
    l.sort()
    length = len(l)
    if length % 2 == 0:
        return (l[length // 2] + l[length // 2 - 1]) / 2
    else:
        return l[length // 2]

✅ Run 10

Start time: 2023-07-18 18:37:38
Duration: 9.59s
Completion tokens: 136
Result: Pass

def median(l: list):
    """Return median of elements in the list l.
    >>> median([3, 1, 2, 4, 5])
    3
    >>> median([-10, 4, 6, 1000, 10, 20])
    15.0
    """
    l.sort()
    n = len(l)
    m = n - 1
    if (n % 2):
        return l[int((m)/2)]
    else:
        return (l[int(m/2)] + l[int((m/2) + 1)]) / 2