I have a json file with multiple datatypes in same column:
- a1 struct<a12:ARRAY<struct a13:string,a14:string>>
- b1 ARRAY
I am trying to use uniontype to load into the table. but getting below error:
Unsupported dataType: uniontype.
i have tried using jsonfile directly as a source.
as well as used an avro table as source(loaded data into table as avro where inferrend schema for this column happens to be string(i.e. generic type to assimilate any type of data using spark sql context.)
Any help would be appreciated.