This is a Java implementation of a GPT3/4 tokenizer, loosely ported from Tiktoken with the help of ChatGPT. ...that all 3.5-turbo models released after 0613 now have ...

Please install the following dependencies to use the library. implementation 'com.google.api-client:google-api-client:1.32.2' implementation 'org.apache.commons ...