Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature/refactor #16

Draft
wants to merge 19 commits into
base: master
Choose a base branch
from
Draft

Feature/refactor #16

wants to merge 19 commits into from

Commits on Jan 18, 2021

  1. Renamed files 

    Signed-off-by: thatInfrastructureGuy <[email protected]>
    @thatInfrastructureGuy
    thatInfrastructureGuy committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    a8a8117 View commit details
    Browse the repository at this point in the history

  2. Refactor each step into a separate goroutine 

    Signed-off-by: thatInfrastructureGuy <[email protected]>
    @thatInfrastructureGuy
    thatInfrastructureGuy committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    5959435 View commit details
    Browse the repository at this point in the history

  3. WriteRow is set to true. 

    Signed-off-by: thatInfrastructureGuy <[email protected]>
    @thatInfrastructureGuy
    thatInfrastructureGuy committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    df58750 View commit details
    Browse the repository at this point in the history

Commits on Jan 19, 2021

  1. closing queue after gzip have been added. 

    Signed-off-by: thatInfrastructureGuy <[email protected]>
    @thatInfrastructureGuy
    thatInfrastructureGuy committed Jan 19, 2021
    Configuration menu
    Copy the full SHA
    3e7e1e9 View commit details
    Browse the repository at this point in the history

  2. Close upload channel after upload. 

    Signed-off-by: thatInfrastructureGuy <[email protected]>
    @thatInfrastructureGuy
    thatInfrastructureGuy committed Jan 19, 2021
    Configuration menu
    Copy the full SHA
    3864897 View commit details
    Browse the repository at this point in the history

  3. Amend comment. 

    Signed-off-by: thatInfrastructureGuy <[email protected]>
    @thatInfrastructureGuy
    thatInfrastructureGuy committed Jan 19, 2021
    Configuration menu
    Copy the full SHA
    0a7d387 View commit details
    Browse the repository at this point in the history

  4. Close gzip writer after done. 

    Signed-off-by: thatInfrastructureGuy <[email protected]>
    @thatInfrastructureGuy
    thatInfrastructureGuy committed Jan 19, 2021
    Configuration menu
    Copy the full SHA
    4d7c6fc View commit details
    Browse the repository at this point in the history

  5. Use env var LOG_LEVEL 

    Signed-off-by: thatInfrastructureGuy <[email protected]>
    @thatInfrastructureGuy
    thatInfrastructureGuy committed Jan 19, 2021
    Configuration menu
    Copy the full SHA
    6f935d5 View commit details
    Browse the repository at this point in the history

  6. Return Row Count 

    Signed-off-by: thatInfrastructureGuy <[email protected]>
    @thatInfrastructureGuy
    thatInfrastructureGuy committed Jan 19, 2021
    Configuration menu
    Copy the full SHA
    1d30a66 View commit details
    Browse the repository at this point in the history

  7. Add debug logs. 

    Signed-off-by: thatInfrastructureGuy <[email protected]>
    @thatInfrastructureGuy
    thatInfrastructureGuy committed Jan 19, 2021
    Configuration menu
    Copy the full SHA
    22aba36 View commit details
    Browse the repository at this point in the history

  8. Use gzip buffer only for s3 upload. 

    Signed-off-by: thatInfrastructureGuy <[email protected]>
    @thatInfrastructureGuy
    thatInfrastructureGuy committed Jan 19, 2021
    Configuration menu
    Copy the full SHA
    e2b61cf View commit details
    Browse the repository at this point in the history

  9. Remove debug log. 

    Signed-off-by: thatInfrastructureGuy <[email protected]>
    @thatInfrastructureGuy
    thatInfrastructureGuy committed Jan 19, 2021
    Configuration menu
    Copy the full SHA
    668ce48 View commit details
    Browse the repository at this point in the history

  10. Close gzip writer when last part is encountered. 

    Signed-off-by: thatInfrastructureGuy <[email protected]>
    @thatInfrastructureGuy
    thatInfrastructureGuy committed Jan 19, 2021
    Configuration menu
    Copy the full SHA
    d0e4239 View commit details
    Browse the repository at this point in the history

  11. Wait for goroutines to finish 

    Signed-off-by: thatInfrastructureGuy <[email protected]>
    @thatInfrastructureGuy
    thatInfrastructureGuy committed Jan 19, 2021
    Configuration menu
    Copy the full SHA
    622385b View commit details
    Browse the repository at this point in the history

  12. Dont flush and close 

    Signed-off-by: thatInfrastructureGuy <[email protected]>
    @thatInfrastructureGuy
    thatInfrastructureGuy committed Jan 19, 2021
    Configuration menu
    Copy the full SHA
    f77fba6 View commit details
    Browse the repository at this point in the history

  13. Errorf args 

    Signed-off-by: thatInfrastructureGuy <[email protected]>
    @thatInfrastructureGuy
    thatInfrastructureGuy committed Jan 19, 2021
    Configuration menu
    Copy the full SHA
    c4c0da0 View commit details
    Browse the repository at this point in the history

  14. Errorf args 

    Signed-off-by: thatInfrastructureGuy <[email protected]>
    @thatInfrastructureGuy
    thatInfrastructureGuy committed Jan 19, 2021
    Configuration menu
    Copy the full SHA
    8f1a201 View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2021

  1. Use csvBuf value instead of pointer. 

    Signed-off-by: thatInfrastructureGuy <[email protected]>
    @thatInfrastructureGuy
    thatInfrastructureGuy committed Jan 30, 2021
    Configuration menu
    Copy the full SHA
    ef4399f View commit details
    Browse the repository at this point in the history

Commits on May 16, 2021

  1. Update README.md

    @thatInfrastructureGuy
    thatInfrastructureGuy authored May 16, 2021
    Configuration menu
    Copy the full SHA
    05f05c1 View commit details
    Browse the repository at this point in the history