Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Frame-wise compression #125

Open
arahlin opened this issue Oct 18, 2023 · 2 comments
Open

Frame-wise compression #125

arahlin opened this issue Oct 18, 2023 · 2 comments
Assignees

Comments

@arahlin
Copy link
Member

arahlin commented Oct 18, 2023

Useful for allowing fseek on compressed frame files.

@nwhitehorn
Copy link
Member

Is there a reason we want to use fseek? The way we encode pipeline state, and so the whole processing model, kind of break if we do that. For one-off debugging, this is somewhat useful, but you still need some kind of index of where you should fseek to, which means you need to read the whole file once anyway, so just decompressing it seems easy enough...

@arahlin
Copy link
Member Author

arahlin commented Jan 3, 2024

The so3g tools use this functionality. We added indexing with fseek/ ftell to the G3Reader already in a previous PR. This open issue is just closing the loop, so that this functionality works on compressed data as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants