I've created a dub package for the D version of DMD's lexer, generated automatically from the C++ source.

github: https://github.com/yebblies/ddmd
dub: http://code.dlang.org/packages/ddmd

There are a few annoying limitations, such that it uses dmd's error printing and allocation functions, and requires configuration through 'global'.

Here is an example program that uses the lexer:


import std.stdio;
import std.file;

import ddmd.tokens;
import ddmd.lexer;


void main()

   string data = "void blah() {} // stuff";
   auto l = new Lexer("myfile", data.ptr, 0, data.length, 0, 0);
       printf("token: %s\n", l.token.toChars());
   while (l.nextToken() != TOKeof);



token: void
token: blah
token: (
token: )
token: {
token: }

Reply via email to