cli/q
1
0
Fork 0
Code Issues Pull requests Releases Activity

Improved Windows support in the tokenizer

Browse source
This commit is contained in:
Eduard Urbach 2025-04-18 14:48:59 +02:00
parent a023b058f8
commit 9107a06df5
No known key found for this signature in database
GPG key ID: C874F672B1AF20C0
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
src/token/Tokenize.go
View file

@ -9,7 +9,7 @@ func Tokenize(buffer []byte) List {
for i < Position(len(buffer)) {
switch buffer[i] {
case ' ', '\t':
case ' ', '\t', '\r':
case ',':
tokens = append(tokens, Token{Kind: Separator, Position: i, Length: 1})
case '(':