mooncakes.io

marianoguerra/css/token does not have a README file

HashKind

pub(all) enum HashKind {
  Id
  Unrestricted
} derive(Eq, @moonbitlang/core/debug.Debug
Debug)

Whether a #... can be an id selector, or only a hex colour.

The distinction is the specification's and it is load-bearing: #1a2b3c is a colour but not a valid id, so #foo and #1a2b3c cannot be the same token if a selector parser is to reject the second.

Token

source

pub(all) struct Token {
  kind : TokenKind
  span : @marianoguerra/css/span.Span
Span
} derive(Eq, @moonbitlang/core/debug.Debug
Debug)

Token::is_trivia

source

fn Token::is_trivia(self : Token) -> Bool

Whether this token is skipped when looking for the next meaningful one.

TokenKind

source

pub(all) enum TokenKind {
  Ident(String)
  Function(String)
  AtKeyword(String)
  Hash(String, HashKind)
  Str(String)
  BadStr
  Url(String)
  BadUrl
  Number(String, Double, Bool)
  Percentage(String, Double)
  Dimension(String, Double, Bool, String)
  Whitespace
  Colon
  Semicolon
  Comma
  LBracket
  RBracket
  LParen
  RParen
  LBrace
  RBrace
  Cdo
  Cdc
  Comment(String)
  Delim(Char)
  Eof
} derive(Eq, @moonbitlang/core/debug.Debug
Debug)

TokenKind::closer_for

source

fn TokenKind::closer_for(self : TokenKind) -> TokenKind?

The opener that this closer matches, if it is one.

Used by error recovery, which has to know how deep it is before it can know whether a } ends the thing it is skipping.

TokenKind::is_opener

source

fn TokenKind::is_opener(self : TokenKind) -> Bool

TokenKind::to_debug

source

fn TokenKind::to_debug(self : TokenKind) -> String

A stable one-line rendering of a token, for tests and for the oracle.

Hand-written rather than derived because this string is an interface: the differential harness compares it, so it must not change when a variant is renamed or a field reordered. It is also the only place a Char or a Double gets formatted, which keeps backend differences in number printing confined to one function.

dump

source

fn dump(toks : Array[Token]) -> String

A whole token stream, one token per line, for the differential harness.

tokenize

source

fn tokenize(src : String) -> Array[Token]

Tokenize a whole stylesheet, ending with exactly one Eof.

Source Files

Site source Report issue Packages Build queue Skills Statistics

#HashKind

#Token

#Token::is_trivia

#TokenKind

#TokenKind::closer_for

#TokenKind::is_opener

#TokenKind::to_debug

#dump

#tokenize

Source Files

HashKind

Token

Token::is_trivia

TokenKind

TokenKind::closer_for

TokenKind::is_opener

TokenKind::to_debug

dump

tokenize