Skip to content
This repository has been archived by the owner on Mar 6, 2019. It is now read-only.

Add PySpark support #17

Open
metasim opened this issue Sep 14, 2017 · 1 comment
Open

Add PySpark support #17

metasim opened this issue Sep 14, 2017 · 1 comment
Assignees

Comments

@metasim
Copy link
Contributor

metasim commented Sep 14, 2017

Currently the UDTs work fine in PySpark, and UDFs if called from SQL context. Need to figure out the Python constructs and configuration necessary to register UDFs and UDAFs with the Python DataFrame API.

Support will need to be done in two phases. The first addressing the UDF/UDAF registration/declaration in the DataFrame context. The second is to figure out how to declare and enforce the RasterFrame constraints around spatial key, tile layer metadata, and tiles. This is likely much harder without a type system, perhaps requiring custom Python wrappers.

@metasim metasim self-assigned this Sep 14, 2017
@metasim
Copy link
Contributor Author

metasim commented Dec 1, 2017

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants