Add tokenizer support of offset for memory