Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor, fix, and optimizer filters/rules #1794

Open
wants to merge 92 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 90 commits
Commits
Show all changes
92 commits
Select commit Hold shift + click to select a range
a05fe5a
Database format 21: add JSON, remove pickle
dsblank Oct 10, 2024
a8ef265
Rename new column to json_data
dsblank Oct 10, 2024
97d3388
Read prev version
dsblank Oct 10, 2024
7497abd
Load old version
dsblank Oct 10, 2024
76d622e
Added to_dict, from_dict
dsblank Oct 11, 2024
c014c15
Refactor for upgrade uses
dsblank Oct 12, 2024
43ea2b2
Peoplemodel mostly working
dsblank Oct 12, 2024
1350f5c
Save new db 21 with JSON data field
dsblank Oct 13, 2024
e677833
Docstrings
dsblank Oct 13, 2024
7ac4f7b
Generic needs to handle both blob and json during upgrades
dsblank Oct 13, 2024
08869eb
name fixes
dsblank Oct 13, 2024
99b3d2b
black linting
dsblank Oct 13, 2024
a9da731
Removed unneeded properties on primary objects
dsblank Oct 13, 2024
bc5ac5b
Use a version of Nick's to/from json funcs
dsblank Oct 13, 2024
33928a9
Revert "Removed unneeded properties on primary objects"
dsblank Oct 14, 2024
3785e46
linting
dsblank Oct 14, 2024
b211640
WIP: eventmodel, and familymodel
dsblank Oct 14, 2024
21caaa2
Use column position in model
dsblank Oct 14, 2024
bcd7018
Refactor serializers to classes
dsblank Oct 27, 2024
b3c0540
People model converted
dsblank Oct 27, 2024
5a01af2
Family model converted
dsblank Oct 27, 2024
22fc4b8
Merge remote-tracking branch 'origin/master' into dsb/depickle
dsblank Oct 28, 2024
125d46d
Typo: return -> yield
dsblank Oct 28, 2024
f16a268
Protection for null dates in events
dsblank Oct 28, 2024
b59fb64
All remaining views converted
dsblank Oct 28, 2024
0489b5b
All remaining views converted
dsblank Oct 28, 2024
1085ced
No need to make treemodels serialize agnostic
dsblank Oct 29, 2024
65d84c8
Date positions are in dateval; ok
dsblank Oct 29, 2024
ae204b8
Import from XML working
dsblank Oct 29, 2024
fe2b561
Remove old commented code
dsblank Oct 29, 2024
c1c1804
Bug fixing
dsblank Oct 29, 2024
e4c0f2c
Linting
dsblank Oct 29, 2024
adda6d5
Linting
dsblank Oct 29, 2024
136d907
Bug fixes
dsblank Oct 29, 2024
ef5fc30
Updated libgedcom
dsblank Oct 29, 2024
73d2054
Got to be careful adding random values to objects
dsblank Oct 29, 2024
d3dfd4f
Fixing undo/redo
dsblank Oct 29, 2024
69f9bbb
Fixing undo/redo
dsblank Oct 29, 2024
dbeb864
Suss bug?
dsblank Oct 29, 2024
368e2ac
Temp fix before Nick's fix
dsblank Oct 29, 2024
d2c301a
Date JSON tweak
dsblank Oct 30, 2024
20c4781
Fix PAT/MAT ronymics
dsblank Oct 30, 2024
1d24d85
Merge branch 'master' into dsb/depickle
dsblank Oct 31, 2024
f14d776
Updated copyright statements for this PR
dsblank Oct 31, 2024
08d76dc
Revert "Updated copyright statements for this PR"
dsblank Oct 31, 2024
54fe9c1
Updated copyright statements for this PR
dsblank Oct 31, 2024
6f5bcda
Convert serializer methods to static methods; can be used as singleton
dsblank Nov 1, 2024
ef8297b
Don't add properties/methods to Gramps objects, unless they start with _
dsblank Nov 1, 2024
cb7ffbc
Simplify access
dsblank Nov 1, 2024
357584a
Update gramps/gui/views/treemodels/placemodel.py
dsblank Nov 1, 2024
641a05b
Leaving metadata as pickle for now
dsblank Nov 1, 2024
ac5db94
Renamed struct to dict
dsblank Nov 1, 2024
f834b50
Fix typo in from_dict docstring
dsblank Nov 1, 2024
5c8c643
Update gramps/gen/lib/serialize.py
dsblank Nov 2, 2024
7381347
Apply suggestions from code review
dsblank Nov 2, 2024
0e55d49
Removed COLUMN_ constants
dsblank Nov 4, 2024
9e6ea7e
Removed COLUMN_ constants
dsblank Nov 4, 2024
c3c3a03
Fixed broken test: couldn't replicate, so went with new results
dsblank Nov 4, 2024
e1a65fa
Fixed broken test: couldn't replicate, so went with new results
dsblank Nov 4, 2024
707a74b
Migrated metadata to JSON
dsblank Nov 12, 2024
be15f1e
Needed to move the JSON access test around
dsblank Nov 12, 2024
be97ff4
Linting
dsblank Nov 12, 2024
cea7468
Refine BSDDB
dsblank Nov 12, 2024
6221aed
Just use one query to test for json_data
dsblank Nov 13, 2024
ab75096
Typo fix: suffic -> suffix
dsblank Nov 13, 2024
1512e07
Refactor supports_json_access
dsblank Nov 14, 2024
f95d3c0
Refactor supports_json_access; linting
dsblank Nov 14, 2024
28b18a1
Update gramps/plugins/db/dbapi/sqlite.py
dsblank Nov 14, 2024
c3d6798
Update gramps/gen/db/generic.py
dsblank Nov 14, 2024
45cf406
Update gramps/plugins/db/dbapi/sqlite.py
dsblank Nov 14, 2024
3176463
Update gramps/plugins/db/dbapi/sqlite.py
dsblank Nov 14, 2024
91a242d
Change naming for json data functions
dsblank Nov 14, 2024
02c6115
Regular bug fix: citation date error
dsblank Nov 15, 2024
4e3fb7e
Added logging to serialize
dsblank Nov 15, 2024
6ab1985
Add protections on loggin
dsblank Nov 15, 2024
995d698
Update gramps/gen/db/generic.py
dsblank Nov 16, 2024
3cfa92e
First pass at new conversion
dsblank Nov 18, 2024
6d5f058
Fixes after mass conversion
dsblank Nov 18, 2024
647fd1e
Don't eat exception
dsblank Nov 18, 2024
915240b
Put entire set of changes in one transaction
dsblank Nov 18, 2024
2d2ab43
Added a couple of missing defaults: family.complete, media.thumb
dsblank Nov 18, 2024
ebbe6cf
A manual test script for validating conversion
dsblank Nov 18, 2024
abf6608
Rename
dsblank Nov 18, 2024
4915d83
table -> database
dsblank Nov 18, 2024
ba5fb5d
Moved conversion tools around a bit
dsblank Nov 19, 2024
a55b0ef
Moved conversion tools around a bit
dsblank Nov 19, 2024
8be7a4a
Refactor, fix, and optimizer filters/rules
dsblank Nov 22, 2024
9e85cee
Update hastagbase to non-optimized version
dsblank Nov 22, 2024
f4a552a
Deal with non-existent filters; pause to show progress
dsblank Nov 22, 2024
ca50a40
Linting
dsblank Nov 22, 2024
aa138a1
Merge branch 'master' into dsb/refactor-filter-and-optimize
dsblank Dec 8, 2024
795646e
In some cases, id_list could be a generator
dsblank Dec 10, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
21 changes: 21 additions & 0 deletions gramps/gen/db/conversion_tools/__init__.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
#
# Gramps - a GTK+/GNOME based genealogy program
#
# Copyright (C) 2024 Doug Blank <[email protected]>
#
# This program is free software; you can redistribute it and/or modify
# it under the terms of the GNU General Public License as published by
# the Free Software Foundation; either version 2 of the License, or
# (at your option) any later version.
#
# This program is distributed in the hope that it will be useful,
# but WITHOUT ANY WARRANTY; without even the implied warranty of
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
# GNU General Public License for more details.
#
# You should have received a copy of the GNU General Public License
# along with this program; if not, write to the Free Software
# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA.
#

from .conversion_21 import convert_21
Loading