Not many can claim 25 years on the Internet! Join us in celebrating this milestone. Learn more about our history, and thank you for being a part of our community!
Now, if you want to get tricky, you use recursive package files. As in, the sounds directory is really a package stored in the master package file. This speeds stuff up tremendously when accessing files, period.
My package format supports/uses both.
- Splat
I never thought of that. hmmm.... Gonna give it a try. Thanks.
By the way, anybody here used zLib? Anygood? I'm not sure if I should use it, as it seems to be a little overkill.
- Splat
[This message has been edited by Splat (edited November 17, 1999).]
Then, for each subpackage, the process is repeated, creating a tree of file headers.
Whenever my game needs a file, it passes the complete filename it wants, ie "sounds/death.wav". First, it checks to see if a file header with that exact name is present. If not, it "peels" off the directory and looks for a file header of a subpackage with that name. Recurse the same function into the subpackage. Repeat until file is found or conclusively not there.
Once the file is found, we have (automagically using the loader function) an absolute offset from the beginning of the WHOLE package. Its just a matter of reading it in.
The packer, however, is a real recursive nightmare. Reason being, each file header is NOT the same size. The file name has a variable size and is stored by writing a byte for how long it is then the actual contents. So to pack the archive, you need to reserve the file header space at the beginning, then compress the files, then come back and record the file header's with offset, size, and compression type.
Its much more important to have a simple loader than a simple packer. You have unlimited time to pack the data, but a game user does NOT want to wait a minute while your game loads its data. Redesigning a file format for easy loading is critical.
- Splat
[This message has been edited by Splat (edited November 17, 1999).]
However, reading a byte then a variable number has neglible effect on performance, and that is all the loader does. The trick is, loading of the package directory is done at registration (in my game engine you register a package file to get an integer package id). So that is also just a one shot thing. Plus, it keeps support for long filenames while not having to reserve 255 bytes per entry. You got several thousand files, that 255 bytes per will start to add up and make the file header so very large.
I guess in the end its just a personal choice. 400k here or there isn't that big a deal.
- Splat
How do you deal with compression? DO you compress the packed file, or each file before packing it? I see advantages both ways:
one big archive - Less load time, decompress at startup. After that, just extract data. More memory is required to hold the decompressed file.
bunch of archives - less memory. Only unpacked as they're needed. Slow because they're only unpacked as they're needed.
So, what do you think? Compress before or after packing, or just skip packing altogether. Although, if I'm gonna skip it, I might as well just compress it before and after startup.
/Niels
