chore: Publish specific documentation for each supported Spark version

[andygrove]

What is the problem the feature request solves?

We currently publish a single version of documentation pages such as the compatibility guide and the configuration reference.

However, we can have differences in default config values and in compatible expressions between Spark versions, so we should really publish separate versions of these pages for each Spark version that we support.

Related to this, we currently publish docs for the main branch but eventually we should have docs per official Comet release, as well as "latest" which refers to the code in the main branch.

Describe the potential solution

No response

Additional context

No response

[coderfender]

I can work on this

[andygrove]

This is partially implemented, but we have serde framework shims that do affect the generated docs depending on which spark version is the default, so we need to figure out a solution