It should be possible to read or extract data from the archive without loading the whole archive (or file?) into memory

[dralley]

Currently Package::open() loads the entire archive into memory, while PackageMetadata::open() doesn't have access to the archive at all.

There's no way to stream access to the archive, or extract files from the archive, without loading the entire archive into memory and dumping each file (also extracted into a large buffer). That's not ideal.

There should be some way to stream across the package and access files one at a time, preferably without needing to also fully dump those into buffers also.