Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add fields of struct array support to dataframe creation functions #334

Merged
merged 1 commit into from
Sep 5, 2021

Conversation

gavinkflam
Copy link
Contributor

See #333

  • Extend array-type to support any Spark SQL DataType, in the same fashion we are already doing in struct-field.
  • Improve create-dataframe tests, adding tests for struct fields and struct array fields

@anthony-khong
Copy link
Member

Looks good to me! Thank you for the PR! I'll merge all the checks pass!

@codecov-commenter
Copy link

Codecov Report

Merging #334 (9f0132a) into develop (52b3e99) will increase coverage by 0.000%.
The diff coverage is 100.000%.

Impacted file tree graph

@@            Coverage Diff            @@
##           develop      #334   +/-   ##
=========================================
  Coverage   99.967%   99.967%           
=========================================
  Files           36        36           
  Lines         3084      3085    +1     
=========================================
+ Hits          3083      3084    +1     
  Misses           1         1           
Impacted Files Coverage Δ
...rc/clojure/zero_one/geni/core/dataset_creation.clj 100.000% <100.000%> (ø)

@anthony-khong anthony-khong merged commit 011e148 into zero-one-group:develop Sep 5, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants