Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature/mx-1673 full text search support #226

Open
wants to merge 32 commits into
base: main
Choose a base branch
from

Conversation

cutoffthetop
Copy link
Contributor

@cutoffthetop cutoffthetop commented Jan 6, 2025

PR Context

Changes

  • add support for full text queries on nested models to find extracted/rule/merged items
  • optimize extracted/rule/merged search queries by applying sorting and pagination
    before pulling in nested models as well as identifiers from referenced merged items
    and by replacing subqueries with cypher pattern comprehension syntax
  • prefix components in merged queries with _, to be more harmonious with _refs
  • add email fields to SEARCHABLE_FIELDS and SEARCHABLE_CLASSES (stop-gap MX-1766)

@cutoffthetop cutoffthetop self-assigned this Jan 6, 2025
@cutoffthetop cutoffthetop changed the title Feature/mx 1673 full text search support 2 feature/mx-1673 full text search support Jan 6, 2025
cutoffthetop added a commit that referenced this pull request Jan 9, 2025
### PR Context

- prep for #226

### Added

- add `extracted_or_rule_labels` to query builder globals

### Changes

- rename short and obscure cypher query variables to more expressive and
verbose ones

### Fixed

- avoid recursive retries in
`GraphConnector._check_connectivity_and_authentication`
- fix integration tests not properly marked as integration tests
Base automatically changed from feature/mx-1673-renaming to main January 9, 2025 13:15
cutoffthetop added a commit to robert-koch-institut/mex-common that referenced this pull request Jan 9, 2025
### PR Context

- prep for robert-koch-institut/mex-backend#226
- we need to determine the searchable fields for Text and Link objects
- Text and Link are subclasses of pydantics BaseModel, not our own
- so i needed to add support for any pydantic model to the field util
functions
- as far as i could determine, `GenericFieldInfo` and `get_all_fields`
is not used outside of mex-common at the moment, so we can safely move
them around

### Added

- BREAKING: add nested models (Text, Link) to *all* lookups in
`mex.common.fields`

### Changes

- BREAKING: move `GenericFieldInfo` from `models.base.field_info` to
`utils`
- BREAKING: move `get_all_fields` from `BaseModel` to `utils` to support
all base models
@cutoffthetop cutoffthetop changed the base branch from main to feature/mx-1673-matched-test-data January 9, 2025 13:30
cutoffthetop added a commit that referenced this pull request Jan 9, 2025
# PR Context
- prep for #226

# Added
- add two matched organizations to the test dummy data

# Changed
- rename `stable_target_id` to more appropriate `identifier` argument
for merged queries
Base automatically changed from feature/mx-1673-matched-test-data to main January 9, 2025 15:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants