Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Transformations lookup #19

Merged
merged 14 commits into from
Feb 2, 2024
Merged

Transformations lookup #19

Changes from 1 commit
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
a69d2dd
introduced expander
LydiaMennesHealth Jan 9, 2024
6ae9acd
added test for minimum length expander
LydiaMennesHealth Jan 9, 2024
07fe44c
integrated expanderr into TokenList and added testing
LydiaMennesHealth Jan 11, 2024
768e61d
document processor iterator added
LydiaMennesHealth Jan 11, 2024
ef1e6ce
return name as well when iterating processors
LydiaMennesHealth Jan 11, 2024
03d8b85
cleaned up accidentally duplicated test
LydiaMennesHealth Jan 11, 2024
71339b7
fixed accidentally deleted tests
LydiaMennesHealth Jan 11, 2024
e198630
updated formatting
LydiaMennesHealth Jan 17, 2024
3c95c18
fixed issue with potential overwritten values in expansion_to_origina…
LydiaMennesHealth Jan 17, 2024
9a0cafb
pylint skip comment added
LydiaMennesHealth Jan 17, 2024
b1230f7
fixed some typing incompatibilities and fixed the order of elements w…
LydiaMennesHealth Jan 17, 2024
746d6ad
im sick of formatting by noq
LydiaMennesHealth Jan 17, 2024
ddd4b4d
found small issue in regexp annotator
LydiaMennesHealth Jan 18, 2024
23103c3
flake8 unhappy with comment
LydiaMennesHealth Jan 18, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
flake8 unhappy with comment
  • Loading branch information
@LydiaMennesHealth
LydiaMennesHealth committed Jan 18, 2024
commit 23103c35ea285cc7e5b81ddee4734a58b97f9f4c
4 changes: 3 additions & 1 deletion docdeid/process/annotator.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -252,7 +252,9 @@ def __init__(
self.pre_match_words: Optional[set[str]] = None
self.matching_pipeline: Optional[list[StringModifier]] = None

# in case of a provided matching pipeline this goes wrong because it simply gets overwritten no warning nada
# in case of a provided matching pipeline this goes wrong
# because it simply gets overwritten no warning nada
# (will fix this in next PR)
if pre_match_words is not None:
self.pre_match_words = set(pre_match_words)
self.matching_pipeline = [docdeid.str.LowercaseString()]
Expand Down