Create a Pandera/PySpark base class for entities in a knowledge graph ontology#2

Merged

rjurney merged 48 commits intomainfrom rjurney/etl-init

Aug 22, 2022

+2,166-124

Commits on Jul 31, 2022

Make graphlet.etl module exist
Russell Jurney
committed

Commits on Aug 2, 2022

Merge branch 'main' of github.com:Graphlet-AI/graphlet into rjurney/etl-init
Russell Jurney
committed
Initial stub for EntityBase
Russell Jurney
committed

Commits on Aug 3, 2022

Formatting for VSCode settings
Russell Jurney
committed
Initial classes for nodes and edges
Russell Jurney
committed
Moved test_spark.py to test_etl.py
Russell Jurney
committed
Make version test pass
Russell Jurney
committed
Ignore D202 - no blank space after docstring
Russell Jurney
committed

Commits on Aug 4, 2022

+ipython dev dependency
Russell Jurney
committed
Ignore FNE008 - function names can't end with their first argument name
Russell Jurney
committed
Don't ignore FNE008
Russell Jurney
committed
+U100 - stupid thing ignores classnames in class functions
Russell Jurney
committed
Working entity base with more unit tests
Russell Jurney
committed
Run pytest as a pre-commit hook
Russell Jurney
committed
Validate the src and dst fields of an edge to be UUIDs
Russell Jurney
committed
comment fix
Russell Jurney
committed
Make data/ exist
Russell Jurney
committed
Allow function names to end with their first variable name
Russell Jurney
committed
Disable unit tests during pre-commit
Russell Jurney
committed
+xmltodict as dev dependency
Russell Jurney
committed
Removed xmltodict as dev dependency, moved to normal. Added ujson.
Russell Jurney
committed
Added types-ujson and types-xmltodict to make mypy happy. Added tqdm for DBLP JSON writing progress bar.
Russell Jurney
committed
+types-tqdm
Russell Jurney
committed
+requests +types-requests
Russell Jurney
committed

Commits on Aug 9, 2022

Added ipykernel as dev dependency so I can run code in VSCode
Russell Jurney
committed
Ignore data/ directory
Russell Jurney
committed
minus types-tqdm plus tqdm-stubs
Russell Jurney
committed
Changed entity_type from a Enu to an typing.Optional[str] with a validator that sets the default value to the class name of the sub-class of EntityBase.
Russell Jurney
committed
Merge branch 'main' of github.com:Graphlet-AI/graphlet into rjurney/etl-init
Russell Jurney
committed

Commits on Aug 13, 2022

Path utilities
Russell Jurney
committed
Ignore error about unneccessary return types as it is dumb
Russell Jurney
committed
Spark ETL test code
Russell Jurney
committed

Commits on Aug 19, 2022

+LICENSE

Russell Jurney
authored and
Russell Jurney
committed
No idea what changed, permissions
rjurney
committed
Perms
rjurney
committed
noop
rjurney
committed
Unit test for pydantic-spark
rjurney
committed
+pandas
rjurney
committed
+pyarrow
rjurney
committed
Instructions to update to poetry 1.2
rjurney
committed
Set no-binary = pydantic
rjurney
committed

Commits on Aug 20, 2022

Commented out unit test for pydantic spark stuff
rjurney
committed

Commits on Aug 22, 2022