Core: Remove unused code for streaming position deletes

[wypoon]

Follow up to #9117.
Prior to that PR, there were two code paths in DeleteFilter for applying position deletes: if the number of position deletes were below a certain number, we use the PositionDeleteIndex bitmap and otherwise we use a streaming filter. That PR makes it so that we always use the first code path, but did not remove the now unused code for the second code path.
This PR is to remove most of the unused code. It includes removing tests which were only added to test that second code path as well as bugs found in that code path (#8132). The streamingFilter and streamingMarker public methods in Deletes are not removed but are deprecated; they can be removed in the version after 1.7. However, the implementation of the methods is replaced by the much simpler implementation using the PositionDeleteIndex bitmap (first code path mentioned above) and the backing classes for the streaming implementation is removed.

[wypoon]

@amogh-jahagirdar @szehon-ho @aokolnychyi please review.

[amogh-jahagirdar]

Thanks @wypoon but I think we should deprecate these APIs and remove at a future point (2.0) instead of removing outright.

[wypoon]

@amogh-jahagirdar I have restored the removed public static methods in Deletes and deprecated them instead. However, I have replaced their implementations with the equivalent of using the non-streaming code path.
See

iceberg/data/src/main/java/org/apache/iceberg/data/DeleteFilter.java

Lines 248 to 260 in a3849bf

	// if there are fewer deletes than a reasonable number to keep in memory, use a set
	if (posDeletes.stream().mapToLong(DeleteFile::recordCount).sum() < setFilterThreshold) {
	PositionDeleteIndex positionIndex = Deletes.toPositionIndex(filePath, deletes);
	Predicate<T> isDeleted = record -> positionIndex.isDeleted(pos(record));
	return createDeleteIterable(records, isDeleted);
	}
	return hasIsDeletedColumn
	? Deletes.streamingMarker(
	records, this::pos, Deletes.deletePositions(filePath, deletes), this::markRowDeleted)
	: Deletes.streamingFilter(
	records, this::pos, Deletes.deletePositions(filePath, deletes), counter);
	}

and

iceberg/data/src/main/java/org/apache/iceberg/data/DeleteFilter.java

Lines 262 to 267 in a3849bf

	private CloseableIterable<T> createDeleteIterable(
	CloseableIterable<T> records, Predicate<T> isDeleted) {
	return hasIsDeletedColumn
	? Deletes.markDeleted(records, isDeleted, this::markRowDeleted)
	: Deletes.filterDeleted(records, isDeleted, counter);
	}

for reference.
The same change is in #11177 except there the tests using Deletes.streamingFilter and Deletes.streamingMarker have not been removed, so you can see that the tests pass (for myself, I ran the tests locally). Since the objective is to remove code, I did not want to restore the tests here. #11177 is not intended for merging.

[amogh-jahagirdar]

Thanks @wypoon! I'll wait a bit in case @nastra had anything else, and then i'll merge.

[amogh-jahagirdar]

I tend to prefer not removing the tests until the deprecated method is actually removed from the code, but I think in this case it's fine since it's not a typical public API and rather a utility.

[wypoon]

The Flink CI issues are unrelated to this change. All tests passed prior to my last commit, and the only change in the last commit was updating javadoc comments.

[amogh-jahagirdar]

Thanks @wypoon , merging!