Splits a list of documents into sublists based on a maximum token limit.
The list of documents to be split.
A function that calculates the number of tokens in a list of documents.
Rest
The maximum number of tokens allowed in a sublist.
Splits a list of documents into sublists based on a maximum token limit.