https://www.databricks.com/blog/introducing-variant-new-open-standard-semi-structured-data-apache-parquettm-delta-lake https://docs.databricks.com/aws/en/ingestion/variant#-ingest-data-from-cloud-object-storage-as-variant I think(?) we can use the VARIANT type in the bronze landing `all_events` https://github.com/databricks-solutions/caspers-kitchens/blob/main/pipelines/order_items/transformations/transformation.py Investigate further...
https://www.databricks.com/blog/introducing-variant-new-open-standard-semi-structured-data-apache-parquettm-delta-lake
https://docs.databricks.com/aws/en/ingestion/variant#-ingest-data-from-cloud-object-storage-as-variant
I think(?) we can use the VARIANT type in the bronze landing
all_eventshttps://github.com/databricks-solutions/caspers-kitchens/blob/main/pipelines/order_items/transformations/transformation.pyInvestigate further...