Sign in

    mizchi/crater/css/token does not have a README file

    HashType

    pub enum HashType {
    Id
    Unrestricted
    }

    Hash token type flag

    NumType

    pub enum NumType {
    Integer
    Number
    }

    Number type flag

    Token

    pub enum Token {
    Ident(String)
    Function(String)
    AtKeyword(String)
    Hash(String, HashType)
    String(String)
    BadString
    Number(Double, NumType)
    Percentage(Double)
    Dimension(Double, String)
    Delim(Char)
    Whitespace
    Colon
    Semicolon
    Comma
    LeftBracket
    RightBracket
    LeftParen
    RightParen
    LeftBrace
    RightBrace
    CDO
    CDC
    EOF
    }

    CSS Token types based on CSS Syntax Level 3 https://www.w3.org/TR/css-syntax-3/#tokenization

    Token::to_string

    fn Token::to_string(self : Token) -> String

    tokenize

    fn tokenize(input : String) -> Array[Token]

    Tokenize a CSS string into a list of tokens