Bump version of spark to 3.4.1

[devongleeson]

There is a recent CVE against spark 3.3.x line, CVE-2023-22946, where the suggested mitigation is upgrading to the 3.4.x line.

[devongleeson]

Would it make sense to include 3.4.0 as well?

[Jolanrensen]

Unfortunately, that won't work as expected, as explained in this issue: #195.
A simple version bump will most likely cause many unexpected bugs since our hacky implementation (the core scala module of the project) has deviated too much from the original Spark one. Supporting 3.4+ would require a major overhaul.

[devongleeson]

Ah, that's too bad.