Hello everyone,
As part of a PoC with Spark 4.0.0, I had to quickly adapt Trevas.
I don't know if you have any plans for Spark 4 support or how this parallel version will be managed in the future.
I made my adjustments in the branch https://github.com/coperator/Trevas/tree/trevas_2.3.0_spark4
With these changes, I was able to get Trevas running on Spark 4.0.0.
Some Antrl methods are deprecated now and could be further customized there.
Short summary of the necessary changes:
- New spark version required some minor changes (Dataset.showString removed)
- New scala version 2.13 required some lines of code to be adapted (toMap(Function) removed and some other issues)
- New Antlr version
That's pretty it.
Let me know if I should create a pull request to a specific branch in the original Trevas github repo.
Hello everyone,
As part of a PoC with Spark 4.0.0, I had to quickly adapt Trevas.
I don't know if you have any plans for Spark 4 support or how this parallel version will be managed in the future.
I made my adjustments in the branch https://github.com/coperator/Trevas/tree/trevas_2.3.0_spark4
With these changes, I was able to get Trevas running on Spark 4.0.0.
Some Antrl methods are deprecated now and could be further customized there.
Short summary of the necessary changes:
That's pretty it.
Let me know if I should create a pull request to a specific branch in the original Trevas github repo.