Spark Compatabilities

[Data-drone]

Hey has this been tested with Spark 3.2 and DBR 10?

[niftimus]

The unit tests are executed using Apache Spark 3.1.2 which seems to be packaged with DBR 9.1 LTS per https://docs.databricks.com/release-notes/runtime/releases.html. The tests have not been run so far against earlier / later Spark versions. Mileage may therefore vary on the later Spark release.