README

Milky2018/css/token does not have a README file

#
HashType

pub enum HashType {
Id
Unrestricted
}

Hash token type flag

#
NumType

pub enum NumType {
Integer
Number
}

Number type flag

#
Token

pub enum Token {
Ident(String)
Function(String)
AtKeyword(String)
Hash(String, HashType)
String(String)
BadString
Number(Double, NumType)
Percentage(Double)
Dimension(Double, String)
Delim(Char)
Whitespace
Colon
Semicolon
Comma
LeftBracket
RightBracket
LeftParen
RightParen
LeftBrace
RightBrace
CDO
CDC
EOF
}

CSS Token types based on CSS Syntax Level 3 https://www.w3.org/TR/css-syntax-3/#tokenization

#
Token::to_string

fn Token::to_string(self : Token) -> String

#
tokenize

fn tokenize(input : String) -> Array[Token]

Tokenize a CSS string into a list of tokens

#
tokenize_with_signs

fn tokenize_with_signs(input : String) -> (Array[Token], Array[Bool])

Tokenize and also return a parallel array marking which Number tokens had an explicit leading +/- sign in the source. Used by the selector parser to validate <an+b> shapes that depend on the "type flag" CSS Syntax 3 records on <number-token>. The signs array has the same length as the tokens array; entries are false for non-Number tokens.

Powered by MoonBit

Site sourceReport issuePackagesBuild queueSkillsStatistics

© 2026 mooncakes.io