Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Switch from pickled blobs to JSON data #1786

Open
wants to merge 74 commits into
base: master
Choose a base branch
from
Open

Switch from pickled blobs to JSON data #1786

wants to merge 74 commits into from
+877 −653

Commits on Oct 10, 2024

  1. Database format 21: add JSON, remove pickle

    @dsblank
    dsblank committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    a05fe5a View commit details
    Browse the repository at this point in the history

  2. Rename new column to json_data

    @dsblank
    dsblank committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    a8ef265 View commit details
    Browse the repository at this point in the history

  3. Read prev version

    @dsblank
    dsblank committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    97d3388 View commit details
    Browse the repository at this point in the history

  4. Load old version

    @dsblank
    dsblank committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    7497abd View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. Added to_dict, from_dict

    @dsblank
    dsblank committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    76d622e View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2024

  1. Refactor for upgrade uses

    @dsblank
    dsblank committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    c014c15 View commit details
    Browse the repository at this point in the history

  2. Peoplemodel mostly working

    @dsblank
    dsblank committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    43ea2b2 View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2024

  1. Save new db 21 with JSON data field

    @dsblank
    dsblank committed Oct 13, 2024
    Configuration menu
    Copy the full SHA
    1350f5c View commit details
    Browse the repository at this point in the history

  2. Docstrings

    @dsblank
    dsblank committed Oct 13, 2024
    Configuration menu
    Copy the full SHA
    e677833 View commit details
    Browse the repository at this point in the history

  3. Generic needs to handle both blob and json during upgrades

    @dsblank
    dsblank committed Oct 13, 2024
    Configuration menu
    Copy the full SHA
    7ac4f7b View commit details
    Browse the repository at this point in the history

  4. name fixes

    @dsblank
    dsblank committed Oct 13, 2024
    Configuration menu
    Copy the full SHA
    08869eb View commit details
    Browse the repository at this point in the history

  5. black linting

    @dsblank
    dsblank committed Oct 13, 2024
    Configuration menu
    Copy the full SHA
    99b3d2b View commit details
    Browse the repository at this point in the history

  6. Removed unneeded properties on primary objects

    @dsblank
    dsblank committed Oct 13, 2024
    1 Configuration menu
    Copy the full SHA
    a9da731 View commit details
    Browse the repository at this point in the history

  7. Use a version of Nick's to/from json funcs

    @dsblank
    dsblank committed Oct 13, 2024
    Configuration menu
    Copy the full SHA
    bc5ac5b View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2024

  1. Revert "Removed unneeded properties on primary objects" 

    This reverts commit a9da731.
    @dsblank
    dsblank committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    33928a9 View commit details
    Browse the repository at this point in the history

  2. linting

    @dsblank
    dsblank committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    3785e46 View commit details
    Browse the repository at this point in the history

  3. WIP: eventmodel, and familymodel

    @dsblank
    dsblank committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    b211640 View commit details
    Browse the repository at this point in the history

  4. Use column position in model

    @dsblank
    dsblank committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    21caaa2 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2024

  1. Refactor serializers to classes

    @dsblank
    dsblank committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    bcd7018 View commit details
    Browse the repository at this point in the history

  2. People model converted

    @dsblank
    dsblank committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    b3c0540 View commit details
    Browse the repository at this point in the history

  3. Family model converted

    @dsblank
    dsblank committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    5a01af2 View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2024

  1. Merge remote-tracking branch 'origin/master' into dsb/depickle

    @dsblank
    dsblank committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    22fc4b8 View commit details
    Browse the repository at this point in the history

  2. Typo: return -> yield

    @dsblank
    dsblank committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    125d46d View commit details
    Browse the repository at this point in the history

  3. Protection for null dates in events

    @dsblank
    dsblank committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    f16a268 View commit details
    Browse the repository at this point in the history

  4. All remaining views converted

    @dsblank
    dsblank committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    b59fb64 View commit details
    Browse the repository at this point in the history

  5. All remaining views converted

    @dsblank
    dsblank committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    0489b5b View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2024

  1. No need to make treemodels serialize agnostic

    @dsblank
    dsblank committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    1085ced View commit details
    Browse the repository at this point in the history

  2. Date positions are in dateval; ok

    @dsblank
    dsblank committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    65d84c8 View commit details
    Browse the repository at this point in the history

  3. Import from XML working

    @dsblank
    dsblank committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    ae204b8 View commit details
    Browse the repository at this point in the history

  4. Remove old commented code

    @dsblank
    dsblank committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    fe2b561 View commit details
    Browse the repository at this point in the history

  5. Bug fixing

    @dsblank
    dsblank committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    c1c1804 View commit details
    Browse the repository at this point in the history

  6. Linting

    @dsblank
    dsblank committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    e4c0f2c View commit details
    Browse the repository at this point in the history

  7. Linting

    @dsblank
    dsblank committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    adda6d5 View commit details
    Browse the repository at this point in the history

  8. Bug fixes

    @dsblank
    dsblank committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    136d907 View commit details
    Browse the repository at this point in the history

  9. Updated libgedcom

    @dsblank
    dsblank committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    ef5fc30 View commit details
    Browse the repository at this point in the history

  10. Got to be careful adding random values to objects

    @dsblank
    dsblank committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    73d2054 View commit details
    Browse the repository at this point in the history

  11. Fixing undo/redo

    @dsblank
    dsblank committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    d3dfd4f View commit details
    Browse the repository at this point in the history

  12. Fixing undo/redo

    @dsblank
    dsblank committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    69f9bbb View commit details
    Browse the repository at this point in the history

  13. Suss bug?

    @dsblank
    dsblank committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    dbeb864 View commit details
    Browse the repository at this point in the history

  14. Temp fix before Nick's fix

    @dsblank
    dsblank committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    368e2ac View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. Date JSON tweak

    @dsblank
    dsblank committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    d2c301a View commit details
    Browse the repository at this point in the history

  2. Fix PAT/MAT ronymics

    @dsblank
    dsblank committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    20c4781 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. Merge branch 'master' into dsb/depickle

    @dsblank
    dsblank authored Oct 31, 2024
    Configuration menu
    Copy the full SHA
    1d24d85 View commit details
    Browse the repository at this point in the history

  2. Updated copyright statements for this PR

    @dsblank
    dsblank committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    f14d776 View commit details
    Browse the repository at this point in the history

  3. Revert "Updated copyright statements for this PR" 

    This reverts commit f14d776.
    @dsblank
    dsblank committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    08d76dc View commit details
    Browse the repository at this point in the history

  4. Updated copyright statements for this PR

    @dsblank
    dsblank committed Oct 31, 2024
    Configuration menu
    Copy the full SHA
    54fe9c1 View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2024

  1. Convert serializer methods to static methods; can be used as singleton

    @dsblank
    dsblank committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    6f5bcda View commit details
    Browse the repository at this point in the history

  2. Don't add properties/methods to Gramps objects, unless they start with _

    @dsblank
    dsblank committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    ef8297b View commit details
    Browse the repository at this point in the history

  3. Simplify access

    @dsblank
    dsblank committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    cb7ffbc View commit details
    Browse the repository at this point in the history

  4. Update gramps/gui/views/treemodels/placemodel.py

    @dsblank
    dsblank authored Nov 1, 2024
    Configuration menu
    Copy the full SHA
    357584a View commit details
    Browse the repository at this point in the history

  5. Leaving metadata as pickle for now

    @dsblank
    dsblank committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    641a05b View commit details
    Browse the repository at this point in the history

  6. Renamed struct to dict

    @dsblank
    dsblank committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    ac5db94 View commit details
    Browse the repository at this point in the history

  7. Fix typo in from_dict docstring

    @dsblank
    dsblank committed Nov 1, 2024
    Configuration menu
    Copy the full SHA
    f834b50 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2024

  1. Update gramps/gen/lib/serialize.py 

    Co-authored-by: stevenyoungs <[email protected]>
    @dsblank @stevenyoungs
    dsblank and stevenyoungs authored Nov 2, 2024
    Configuration menu
    Copy the full SHA
    5c8c643 View commit details
    Browse the repository at this point in the history

  2. Apply suggestions from code review 

    Co-authored-by: stevenyoungs <[email protected]>
    @dsblank @stevenyoungs
    dsblank and stevenyoungs authored Nov 2, 2024
    Configuration menu
    Copy the full SHA
    7381347 View commit details
    Browse the repository at this point in the history

Commits on Nov 4, 2024

  1. Removed COLUMN_ constants

    @dsblank
    dsblank committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    0e55d49 View commit details
    Browse the repository at this point in the history

  2. Removed COLUMN_ constants

    @dsblank
    dsblank committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    9e6ea7e View commit details
    Browse the repository at this point in the history

  3. Fixed broken test: couldn't replicate, so went with new results

    @dsblank
    dsblank committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    c3c3a03 View commit details
    Browse the repository at this point in the history

  4. Fixed broken test: couldn't replicate, so went with new results

    @dsblank
    dsblank committed Nov 4, 2024
    Configuration menu
    Copy the full SHA
    e1a65fa View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2024

  1. Migrated metadata to JSON

    @dsblank
    dsblank committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    707a74b View commit details
    Browse the repository at this point in the history

  2. Needed to move the JSON access test around

    @dsblank
    dsblank committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    be15f1e View commit details
    Browse the repository at this point in the history

  3. Linting

    @dsblank
    dsblank committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    be97ff4 View commit details
    Browse the repository at this point in the history

  4. Refine BSDDB

    @dsblank
    dsblank committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    cea7468 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. Just use one query to test for json_data

    @dsblank
    dsblank committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    6221aed View commit details
    Browse the repository at this point in the history

  2. Typo fix: suffic -> suffix

    @dsblank
    dsblank committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    ab75096 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2024

  1. Refactor supports_json_access

    @dsblank
    dsblank committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    1512e07 View commit details
    Browse the repository at this point in the history

  2. Refactor supports_json_access; linting

    @dsblank
    dsblank committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    f95d3c0 View commit details
    Browse the repository at this point in the history

  3. Update gramps/plugins/db/dbapi/sqlite.py 

    Co-authored-by: stevenyoungs <[email protected]>
    @dsblank @stevenyoungs
    dsblank and stevenyoungs authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    28b18a1 View commit details
    Browse the repository at this point in the history

  4. Update gramps/gen/db/generic.py 

    Co-authored-by: stevenyoungs <[email protected]>
    @dsblank @stevenyoungs
    dsblank and stevenyoungs authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    c3d6798 View commit details
    Browse the repository at this point in the history

  5. Update gramps/plugins/db/dbapi/sqlite.py 

    Co-authored-by: stevenyoungs <[email protected]>
    @dsblank @stevenyoungs
    dsblank and stevenyoungs authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    45cf406 View commit details
    Browse the repository at this point in the history

  6. Update gramps/plugins/db/dbapi/sqlite.py 

    Co-authored-by: stevenyoungs <[email protected]>
    @dsblank @stevenyoungs
    dsblank and stevenyoungs authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    3176463 View commit details
    Browse the repository at this point in the history

  7. Change naming for json data functions

    @dsblank
    dsblank committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    91a242d View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2024

  1. Regular bug fix: citation date error

    @dsblank
    dsblank committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    02c6115 View commit details
    Browse the repository at this point in the history

  2. Added logging to serialize

    @dsblank
    dsblank committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    4e3fb7e View commit details
    Browse the repository at this point in the history