Thanks, this is really well-written. How can we manipulate the position of lexbuf though? For instance, I want to implement a lexer for Brainfuck loop so when ] is found, the lexer check the state of the tape and decide if it should skip back to the matching [ (which would require changing the value of lex_curr_p I suppose) or just carry on.