Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parser script for the chatbot input #675

Open
wants to merge 161 commits into
base: main
Choose a base branch
from

Commits on Aug 8, 2024

  1. initial commit

    EwDa291 committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    1ebc363 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    34df842 View commit details
    Browse the repository at this point in the history
  3. some cleanup

    EwDa291 committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    10edb20 View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2024

  1. used jinja to replace macros

    EwDa291 committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    85a93ec View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    dfff5fa View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    649ddec View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    2116d6e View commit details
    Browse the repository at this point in the history
  5. small update, not important

    EwDa291 committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    159aa62 View commit details
    Browse the repository at this point in the history
  6. change to the templates

    EwDa291 committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    75765e5 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    57d9cfe View commit details
    Browse the repository at this point in the history
  8. Delete scripts/HPC chatbot preprocessor/start_checker.py

    This file is just used to test some things locally and not part of the parser
    EwDa291 authored Aug 9, 2024
    Configuration menu
    Copy the full SHA
    75d345b View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2024

  1. make sure files with duplicate names between normal files and linux-t…

    …utorial are both read and saved properly
    EwDa291 committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    ff7a9fc View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    47a33b7 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    7d279d6 View commit details
    Browse the repository at this point in the history
  4. some small fixes

    EwDa291 committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    8047572 View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2024

  1. remove try-except-structure

    EwDa291 committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    7d1c5ed View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    984b0cd View commit details
    Browse the repository at this point in the history
  3. Rename file

    EwDa291 committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    8f5eeaa View commit details
    Browse the repository at this point in the history
  4. cleanup repository

    EwDa291 committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    2b97b7a View commit details
    Browse the repository at this point in the history
  5. Rename directory

    EwDa291 committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    b595301 View commit details
    Browse the repository at this point in the history
  6. add a main function

    EwDa291 committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    90c8ab7 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    b8ae706 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    b751497 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    0f8eb5d View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    9938e92 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    508b22c View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    a25ce2d View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    80d0535 View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2024

  1. Configuration menu
    Copy the full SHA
    9163a75 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    1dcffc1 View commit details
    Browse the repository at this point in the history
  3. small optimisations

    EwDa291 committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    4d7fbdb View commit details
    Browse the repository at this point in the history
  4. small optimisations

    EwDa291 committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    671f7f3 View commit details
    Browse the repository at this point in the history
  5. initial commit

    EwDa291 committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    e5c39bd View commit details
    Browse the repository at this point in the history
  6. added requirements

    EwDa291 committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    c6492fc View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    aff8198 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    a981002 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2024

  1. Configuration menu
    Copy the full SHA
    1f3b343 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b6388d3 View commit details
    Browse the repository at this point in the history
  3. filter out images

    EwDa291 committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    48cad97 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    df58f23 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    c423e07 View commit details
    Browse the repository at this point in the history
  6. cleaned up parser with macros

    EwDa291 committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    2c333fe View commit details
    Browse the repository at this point in the history
  7. cleaned up parser with macros

    EwDa291 committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    ce52352 View commit details
    Browse the repository at this point in the history
  8. cleaned up parser with macros

    EwDa291 committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    5db34af View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2024

  1. Update README.md

    EwDa291 authored Aug 19, 2024
    Configuration menu
    Copy the full SHA
    4226d28 View commit details
    Browse the repository at this point in the history
  2. Update README.md

    EwDa291 authored Aug 19, 2024
    Configuration menu
    Copy the full SHA
    d730a26 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    f3182e3 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    aee54de View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    675bec5 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    f1e58ef View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    2bf1075 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    a168509 View commit details
    Browse the repository at this point in the history
  9. take out some copy pasting

    EwDa291 committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    09b86c9 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    f95b99e View commit details
    Browse the repository at this point in the history
  11. fixing typos

    EwDa291 committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    06bb7b9 View commit details
    Browse the repository at this point in the history
  12. take out copy pasting

    EwDa291 committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    2f3e5b3 View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2024

  1. Configuration menu
    Copy the full SHA
    0c4dbe8 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    38c4572 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5cbd653 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. Configuration menu
    Copy the full SHA
    0e6f8b2 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    cd77837 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    98eb695 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    27457e3 View commit details
    Browse the repository at this point in the history
  5. implemented extra test to make sure generic files dont accidentally g…

    …et flagged as os-specific
    EwDa291 committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    bb72287 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    67cb19e View commit details
    Browse the repository at this point in the history
  7. clean up unused code

    EwDa291 committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    cf9834a View commit details
    Browse the repository at this point in the history
  8. introduce more macros

    EwDa291 committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    da32459 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    093200b View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    5d0ffe9 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    a3e34a9 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    7c6154b View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    8d5b50d View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    0c10376 View commit details
    Browse the repository at this point in the history
  15. Configuration menu
    Copy the full SHA
    f8ee860 View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    6533733 View commit details
    Browse the repository at this point in the history
  17. Configuration menu
    Copy the full SHA
    2e7a00f View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    f5e0579 View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2024

  1. First attempt at splitting in paragraphs (need for other fixes for ti…

    …tle-based-split first
    EwDa291 committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    6757b4f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6d9558d View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    2c7025a View commit details
    Browse the repository at this point in the history
  4. update test for valid titles

    EwDa291 committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    ae99bb9 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    084b421 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    cf7f5f0 View commit details
    Browse the repository at this point in the history
  7. clean up temporary version

    EwDa291 committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    b7c10d3 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    4a441f3 View commit details
    Browse the repository at this point in the history
  9. small fix to macros

    EwDa291 committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    662134f View commit details
    Browse the repository at this point in the history
  10. clean up test for valid title

    EwDa291 committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    05eab4a View commit details
    Browse the repository at this point in the history
  11. add a test for write_metadata

    EwDa291 committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    b85a8fb View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2024

  1. Configuration menu
    Copy the full SHA
    39a3c99 View commit details
    Browse the repository at this point in the history
  2. clean up

    EwDa291 committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    af9e6cc View commit details
    Browse the repository at this point in the history
  3. clean up

    EwDa291 committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    f4163a7 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    833f964 View commit details
    Browse the repository at this point in the history
  5. clean up

    EwDa291 committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    79b1a56 View commit details
    Browse the repository at this point in the history
  6. added test for if mangler

    EwDa291 committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    cec154c View commit details
    Browse the repository at this point in the history
  7. clean up

    EwDa291 committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    2f4a277 View commit details
    Browse the repository at this point in the history
  8. clean up customizable options

    EwDa291 committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    cd0c8eb View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2024

  1. Configuration menu
    Copy the full SHA
    3be262a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    1d32aab View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5902c96 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    6f97d5f View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    6e48800 View commit details
    Browse the repository at this point in the history
  6. include chatbot_prepprocessor

    EwDa291 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    0bc440b View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    e6e6023 View commit details
    Browse the repository at this point in the history
  8. cleanup

    EwDa291 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    a6d99d9 View commit details
    Browse the repository at this point in the history
  9. cleanup

    EwDa291 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    2be834f View commit details
    Browse the repository at this point in the history
  10. cleanup

    EwDa291 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    532543a View commit details
    Browse the repository at this point in the history
  11. relocate test files

    EwDa291 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    107464e View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    dd64381 View commit details
    Browse the repository at this point in the history
  13. relocate full test files

    EwDa291 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    ef3fd58 View commit details
    Browse the repository at this point in the history
  14. Revert "update arguments of if mangler"

    This reverts commit dd64381.
    EwDa291 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    4d7db8f View commit details
    Browse the repository at this point in the history
  15. Revert "relocate full test files"

    This reverts commit ef3fd58.
    EwDa291 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    df9bac5 View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    631d9e9 View commit details
    Browse the repository at this point in the history
  17. relocated full test files

    EwDa291 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    c6e600d View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    d1c6194 View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    695ffd6 View commit details
    Browse the repository at this point in the history
  20. smal fix

    EwDa291 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    af4832b View commit details
    Browse the repository at this point in the history
  21. test text for paragraph split

    EwDa291 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    8805c8c View commit details
    Browse the repository at this point in the history
  22. Configuration menu
    Copy the full SHA
    a265ffd View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. Configuration menu
    Copy the full SHA
    6c2a61c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ed08879 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    176af13 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    d4ceac8 View commit details
    Browse the repository at this point in the history
  5. updated requirements.txt

    EwDa291 committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    815a863 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    d15469f View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    daa6b36 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    4c19f44 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    9a6ff58 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    56543f0 View commit details
    Browse the repository at this point in the history
  11. added examples of output of the script when splitting on paragraphs w…

    …ith a min_paragraph_length of 683
    EwDa291 committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    52a3861 View commit details
    Browse the repository at this point in the history
  12. fix for issue with html links

    EwDa291 committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    692e77b View commit details
    Browse the repository at this point in the history
  13. fix for issue with html links

    EwDa291 committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    7f493a1 View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    0e34396 View commit details
    Browse the repository at this point in the history
  15. Configuration menu
    Copy the full SHA
    fa00044 View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    b3952b2 View commit details
    Browse the repository at this point in the history
  17. added test for insert_links

    EwDa291 committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    73072bf View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. Configuration menu
    Copy the full SHA
    3161309 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    7d4d7f9 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    3407be3 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    6d04bbc View commit details
    Browse the repository at this point in the history
  5. added verbose mode

    EwDa291 committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    f33cfb3 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    1c389d7 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. Added limitation on lists

    EwDa291 committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    3227f19 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    67aed53 View commit details
    Browse the repository at this point in the history
  3. new test for links

    EwDa291 committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    9e297b1 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    b6b8610 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    57a2139 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. Configuration menu
    Copy the full SHA
    170a10c View commit details
    Browse the repository at this point in the history
  2. removed parsed mds

    EwDa291 committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    04efff6 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    1ef1f10 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    621c0a3 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    adf364d View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    2c6e3c4 View commit details
    Browse the repository at this point in the history
  7. removing unnecessary files

    EwDa291 committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    32b8b74 View commit details
    Browse the repository at this point in the history
  8. Revert "removing unnecessary files"

    This reverts commit 32b8b74.
    EwDa291 committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    445f7ee View commit details
    Browse the repository at this point in the history
  9. change filenames

    EwDa291 committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    d96aeba View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    bec9a63 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    886da19 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    b354bb2 View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    87e5575 View commit details
    Browse the repository at this point in the history
  14. add pytest to requirements

    EwDa291 committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    8f39e08 View commit details
    Browse the repository at this point in the history
  15. Configuration menu
    Copy the full SHA
    d6c33e7 View commit details
    Browse the repository at this point in the history