Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

use explicit hint tokens for export marker #92

Merged
merged 1 commit into from
Jul 6, 2024
Merged

Conversation

alaviss
Copy link
Owner

@alaviss alaviss commented Jul 6, 2024

Since unary operator processing in external scanner conflicts with export marker, the export marker was made into a non-terminal rule that was also an external symbol, where the sole reason for the external symbol was to allow the unary operator handler in the external parser know that the marker * is meant to be a marker and not an unary operator.

Recent tree-sitter changes has forbade this particular usage. As such, switch to using a signal token (an optional token that is an external) to let the external scanner know the context it is handling.

Ref: #90 (comment)
Ref: tree-sitter/tree-sitter#2577

Since unary operator processing in external scanner conflicts with
export marker, the export marker was made into a non-terminal rule that
was also an external symbol, where the sole reason for the external
symbol was to allow the unary operator handler in the external parser
know that the marker `*` is meant to be a marker and not an unary
operator.

Recent tree-sitter changes has forbade this particular usage. As such,
switch to using a signal token (an optional token that is an external)
to let the external scanner know the context it is handling.

Ref: #90 (comment)
Ref: tree-sitter/tree-sitter#2577
@alaviss alaviss enabled auto-merge (squash) July 6, 2024 22:23
@alaviss alaviss merged commit fe7557e into main Jul 6, 2024
19 checks passed
@alaviss alaviss deleted the push-zklunpolsmwo branch July 6, 2024 22:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant