Prepping the content for uploading into chat packages involved some manual work. After exploring various methods to automatically prepare documents for conversion to chat packages we decided to stick with a rather manual method because it provided the best results. While the following describes how to break up a large document into a chat package collection the same process applies to having several documents.
Step 1: Extract Text and Break the Document into Sections
A chat package is limited to a maximum length of 120,000 characters which is typically in the range of 20,000 to 26,000 words. If you are within that range then just create a single chat package.
For our pdf with almost 500 pages it has many more words than what can fit into a single chat package. So, we break it up into pieces to become individual chat packages.
We like to use the following Python script. Feel free to use it. Or break up the document entirely manually. The end result is the same; you have a bunch of text to paste into the
"Create Chat Package" web page.
Step 2: Construct Document Summary and Keywords
You now have several text files. Each text file represents a section or chapter of the large PDF. For each of these sections a Document Summary and Document Keywords will need to be created.
Of course, you can create these manually. However, we hacve that it is easy to paste the the document section into ChatGPT with these instructions:
For the following content please create a summary of less than 2000 characters.
Then generate a comma separated list of keywords, product names, product model
numbers and key concepts of less than 2000 characters.
```
Content here...
Step 3: Create the Chat Packages
There will be one chat package per document section. Detailed instructions are here:
How to Create a Chat Package
The link to create a chat package is at:
Create a Chat Package
It is important to use the same "Collection ID" and "Collection Name" when creating several chat packages that are intended to be used as a collection.
Once you have created some or all of the chat packages then you will see them in My Chat Packages
In My Chat Packages you will see a link to "ICE Pack Collection". Click on it and the Collection will open. You can share that link with whomever you like.