Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TileUDT is backed by Arrow record #4

Open
echeipesh opened this issue Oct 17, 2019 · 0 comments
Open

TileUDT is backed by Arrow record #4

echeipesh opened this issue Oct 17, 2019 · 0 comments
Labels

Comments

@echeipesh
Copy link
Collaborator

The objective of this epic is to create end-to-end prototype the uses of Arrow in DataFrame.
This is a critical milestone before we start introducing an ArrowCubeUDT (or something like that) into RasterFrames. It's not critical for the Arrow schema we use to be optimal.

At the end of this epic we should have a local environment where some operation is done on ArrowCubeTile on JVM, the raster is sent to python where its transformed using python udf as an ndarray. Some kind of benchmark exists that compares with status-quo.

@echeipesh echeipesh added the Epic label Oct 17, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant