Skip to content

unicode support #156

Open
Open
@CrockAgile

Description

A contributor was unclear while working on #154 if the crate supported unicode (link).

Documentation and tests should call this out that BNF intends (and should?) support unicode.

Activity

Carlyle-Foster

Carlyle-Foster commented on Jan 5, 2025

@Carlyle-Foster
Contributor

i think that we should definitely support grammars that operate on unicode, but for the grammar definitions themselves limiting unicode support to terminals could be an avenue for performance gains + make the code a bit simpler (both in human and machine terms)

Carlyle-Foster

Carlyle-Foster commented on Jan 5, 2025

@Carlyle-Foster
Contributor

it's not a pressing issue though, rn i think we handle unicode correctly and use it everywhere

added this to the 0.6 milestone on Feb 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      unicode support · Issue #156 · shnewto/bnf