Add View Support to Spark

[nastra]

Feature Request / Improvement

Once #7880 is in, work could be started on supporting Views in Spark

Query engine

Spark

[singhpk234]

@nastra @amogh-jahagirdar any plans for this, i think spark view interfaces are in it's just that complete wiring in spark is still pending via [1] , do you plan to pickup implementing spark view interfaces in iceberg so that once the complete wiring of view support in spark is merged then would start supporting it or is it like we should wait for spark view support to be complete and then we will start implementing the spark view interfaces in iceberg-spark ?

cc @jzhuge

[1] https://github.com/apache/spark/pull/39796/files

[nastra]

@singhpk234 I was planning to pick up apache/spark#39796, but I don't know yet whether we'd want to integrate those temporarily into Iceberg until they make it into Spark

[jzhuge]

Rebased apache/spark#39796 to latest master branch

[jzhuge]

apache/spark#39796 (comment)

[jzhuge]

Spark umbrella JIRA: SPARK-31357

[jzhuge]

Rebased apache/spark#44197 with fixes for review comments and some unit tests

[rdblue]

I think we can call this one done with all of the PRs from @nastra that we've merged lately. Thanks @jzhuge and @nastra for getting this ready!