Skip to content

Latest commit

 

History

History
184 lines (168 loc) · 19.7 KB

CHANGELOG.md

File metadata and controls

184 lines (168 loc) · 19.7 KB
Raw

CHANGELOG

All notable changes to this project are documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning. See the CONTRIBUTING guide for instructions on how to add changelog entries.

Unreleased 3.0

Added

  • Support for HTTP/2 (server-side) (#3847)
  • Add getter for path field in NestedQueryBuilder (#4636)
  • Allow mmap to use new JDK-19 preview APIs in Apache Lucene 9.4+ (#5151)
  • Add events correlation engine plugin (#6854)
  • Introduce new dynamic cluster setting to control slice computation for concurrent segment search (#9107)
  • Implement on behalf of token passing for extensions (#8679)

Dependencies

  • Bump log4j-core from 2.18.0 to 2.19.0
  • Bump forbiddenapis from 3.3 to 3.4
  • Bump avro from 1.11.1 to 1.11.2
  • Bump woodstox-core from 6.3.0 to 6.3.1
  • Bump xmlbeans from 5.1.0 to 5.1.1 (#4354)
  • Bump reactor-netty-core from 1.0.19 to 1.0.22 (#4447)
  • Bump reactive-streams from 1.0.3 to 1.0.4 (#4488)
  • Bump jempbox from 1.8.16 to 1.8.17 (#4550)
  • Update to Gradle 7.6 and JDK-19 (#4973)
  • Update Apache Lucene to 9.5.0-snapshot-d5cef1c (#5570)
  • Bump maven-model from 3.6.2 to 3.8.6 (#5599)
  • Bump maxmind-db from 2.1.0 to 3.0.0 (#5601)
  • Bump wiremock-jre8-standalone from 2.33.2 to 2.35.0
  • Bump gson from 2.10 to 2.10.1
  • Bump com.google.code.gson:gson from 2.10 to 2.10.1
  • Bump com.maxmind.geoip2:geoip2 from 4.0.0 to 4.0.1
  • Bump com.avast.gradle:gradle-docker-compose-plugin from 0.16.11 to 0.16.12
  • Bump org.apache.commons:commons-compress from 1.22 to 1.23.0
  • Bump org.apache.commons:commons-configuration2 from 2.8.0 to 2.9.0
  • Bump com.netflix.nebula:nebula-publishing-plugin from 19.2.0 to 20.3.0
  • Bump io.opencensus:opencensus-api from 0.18.0 to 0.31.1 (#7291)
  • OpenJDK Update (April 2023 Patch releases) (#7344
  • Bump com.google.http-client:google-http-client:1.43.2 from 1.42.0 to 1.43.2 (7928))
  • Add Opentelemetry dependencies (#7543)
  • Bump org.bouncycastle:bcprov-jdk15on to org.bouncycastle:bcprov-jdk15to18 version 1.75 (#8247)
  • Bump org.bouncycastle:bcmail-jdk15on to org.bouncycastle:bcmail-jdk15to18 version 1.75 (#8247)
  • Bump org.bouncycastle:bcpkix-jdk15on to org.bouncycastle:bcpkix-jdk15to18 version 1.75 (#8247)

Changed

  • [CCR] Add getHistoryOperationsFromTranslog method to fetch the history snapshot from translogs (#3948)
  • Relax visibility of the HTTP_CHANNEL_KEY and HTTP_SERVER_CHANNEL_KEY to make it possible for the plugins to access associated Netty4HttpChannel / Netty4HttpServerChannel instance (#4638)
  • Migrate client transports to Apache HttpClient / Core 5.x (#4459)
  • Change http code on create index API with bad input raising NotXContentException from 500 to 400 (#4773)
  • Improve summary error message for invalid setting updates (#4792)
  • [Remote Store] Add Segment download stats to remotestore stats API (#8718)
  • [Remote Store] Add remote segment transfer stats on NodesStats API (#9168 #9393 #9454)
  • Return 409 Conflict HTTP status instead of 503 on failure to concurrently execute snapshots (#8986)

Deprecated

Removed

  • Remove deprecated code to add node name into log pattern of log4j property file (#4568)
  • Unused object and import within TransportClusterAllocationExplainAction (#4639)
  • Remove LegacyESVersion.V_7_0_* and V_7_1_* Constants (#2768)
  • Remove LegacyESVersion.V_7_2_ and V_7_3_ Constants (#4702)
  • Always auto release the flood stage block (#4703)
  • Remove LegacyESVersion.V_7_4_ and V_7_5_ Constants (#4704)
  • Remove Legacy Version support from Snapshot/Restore Service (#4728)
  • Remove deprecated serialization logic from pipeline aggs (#4847)
  • Remove unused private methods (#4926)
  • Remove LegacyESVersion.V_7_8_ and V_7_9_ Constants (#4855)
  • Remove LegacyESVersion.V_7_6_ and V_7_7_ Constants (#4837)
  • Remove LegacyESVersion.V_7_10_ Constants (#5018)
  • Remove Version.V_1_ Constants (#5021)
  • Remove custom Map, List and Set collection classes (#6871)

Fixed

  • Fix 'org.apache.hc.core5.http.ParseException: Invalid protocol version' under JDK 16+ (#4827)
  • Fix compression support for h2c protocol (#4944)

Security

Unreleased 2.x

Added

  • Add server version as REST response header #6583
  • Start replication checkpointTimers on primary before segments upload to remote store. (#8221)
  • [distribution/archives] [Linux] [x64] Provide the variant of the distributions bundled with JRE (#8195)
  • Add configuration for file cache size to max remote data ratio to prevent oversubscription of file cache (#8606)
  • Disallow compression level to be set for default and best_compression index codecs (#8737)
  • Prioritize replica shard movement during shard relocation (#8875)
  • Introducing Default and Best Compression codecs as their algorithm name (#9123)
  • Make SearchTemplateRequest implement IndicesRequest.Replaceable (#9122)
  • [BWC and API enforcement] Define the initial set of annotations, their meaning and relations between them (#9223)
  • [Segment Replication] Support realtime reads for GET requests (#9212)
  • [Feature] Expose term frequency in Painless script score context (#9081)
  • Add support for reading partial files to HDFS repository (#9513)
  • Add support for extensions to search responses using SearchExtBuilder (#9379)

Dependencies

  • Bump org.apache.logging.log4j:log4j-core from 2.17.1 to 2.20.0 (#8307)
  • Bump io.grpc:grpc-context from 1.46.0 to 1.57.1 (#8726, #9145)
  • Bump com.netflix.nebula:gradle-info-plugin from 12.1.5 to 12.1.6 (#8724)
  • Bump commons-codec:commons-codec from 1.15 to 1.16.0 (#8725)
  • Bump org.apache.zookeeper:zookeeper from 3.8.1 to 3.9.0 (#8844, #9146)
  • Bump org.gradle.test-retry from 1.5.3 to 1.5.4 (#8842)
  • Bump com.netflix.nebula.ospackage-base from 11.3.0 to 11.4.0 (#8838)
  • Bump com.google.http-client:google-http-client-gson from 1.43.2 to 1.43.3 (#8840)
  • OpenJDK Update (July 2023 Patch releases) (#8868
  • Bump hadoop libraries from 3.3.4 to 3.3.6 (#6995)
  • Bump com.gradle.enterprise from 3.13.3 to 3.14.1 (#8996)
  • Bump org.apache.commons:commons-lang3 from 3.12.0 to 3.13.0 (#8995, #9298)
  • Bump com.google.cloud:google-cloud-core-http from 2.21.0 to 2.21.1 (#8999)
  • Bump com.maxmind.geoip2:geoip2 from 4.0.1 to 4.1.0 (#8998)
  • Bump org.apache.commons:commons-lang3 from 3.12.0 to 3.13.0 in /plugins/repository-hdfs (#8997)
  • Bump netty from 4.1.94.Final to 4.1.96.Final (#9030)
  • Bump io.projectreactor.netty:reactor-netty-http from 1.1.8 to 1.1.9 (#9147)
  • Bump org.apache.maven:maven-model from 3.9.3 to 3.9.4 (#9148)
  • Bump com.azure:azure-storage-blob from 12.22.3 to 12.23.0 (#9231)
  • Bump com.diffplug.spotless from 6.19.0 to 6.20.0 (#9227)
  • Bump org.xerial.snappy:snappy-java from 1.1.8.2 to 1.1.10.3 (#9252)
  • Bump com.squareup.okhttp3:okhttp from 4.9.3 to 4.11.0 (#9252)
  • Bump com.squareup.okio:okio from 2.8.0 to 3.5.0 (#9252)
  • Bump com.google.code.gson:gson from 2.9.0 to 2.10.1 (#9230)
  • Bump lycheeverse/lychee-action from 1.2.0 to 1.8.0 (#9228)
  • Bump snakeyaml from 2.0 to 2.1 (#9269)
  • Bump aws-actions/configure-aws-credentials from 1 to 2 (#9302)
  • Bump com.github.luben:zstd-jni from 1.5.5-3 to 1.5.5-5 (#9431
  • Bump actions/setup-java from 2 to 3 (#9457)
  • Bump com.google.api:gax from 2.27.0 to 2.32.0 (#9300)
  • Bump netty from 4.1.96.Final to 4.1.97.Final (#9553)
  • Bump io.grpc:grpc-api from 1.57.1 to 1.57.2 (#9578)

Changed

  • Default to mmapfs within hybridfs (#8508)
  • Perform aggregation postCollection in ContextIndexSearcher after searching leaves (#8303)
  • Make Span exporter configurable (#8620)
  • Perform aggregation postCollection in ContextIndexSearcher after searching leaves (#8303)
  • [Refactor] StreamIO from common to core.common namespace in core lib (#8157)
  • [Refactor] Remaining HPPC to java.util collections (#8730)
  • Remote Segment Store Repository setting moved from index.remote_store.repository to index.remote_store.segment.repository and cluster.remote_store.repository to cluster.remote_store.segment.repository respectively for Index and Cluster level settings (#8719)
  • Change InternalSignificantTerms to sum shard-level superset counts only in final reduce (#8735)
  • Exclude 'benchmarks' from codecov report (#8805)
  • Create separate SourceLookup instance per segment slice in SignificantTextAggregatorFactory (#8807)
  • Allow test clusters to run with TLS (#8900)
  • Replace the deprecated IndexReader APIs with new storedFields() & termVectors() (#7792)
  • [Remote Store] Add support to restore only unassigned shards of an index (#8792)
  • Add safeguard limits for file cache during node level allocation (#8208)
  • Performance improvements for BytesRefHash (#8788)
  • Add support for aggregation profiler with concurrent aggregation (#8801)
  • [Remove] Deprecated Fractional ByteSizeValue support #9005 (#9005)
  • Add support for aggregation profiler with concurrent aggregation (#8801)
  • [Remote Store] Restrict user override for remote store index level settings (#8812)
  • [Refactor] MediaTypeParser to MediaTypeParserRegistry (#8636)
  • Make MultiBucketConsumerService thread safe to use across slices during search (#9047)
  • Removed blocking wait in TransportGetSnapshotsAction which was exhausting generic threadpool (#8377)
  • Adds support for tracing runnable scenarios (#8831)
  • Change shard_size and shard_min_doc_count evaluation to happen in shard level reduce phase (#9085)
  • Add attributes to startSpan methods (#9199)
  • [Refactor] Task foundation classes to core library - pt 1 (#9082)
  • Add base class for parameterizing the search based tests #9083 (#9083)
  • Add support for wrapping CollectorManager with profiling during concurrent execution (#9129)
  • Rethrow OpenSearch exception for non-concurrent path while using concurrent search (#9177)
  • Improve performance of encoding composite keys in multi-term aggregations (#9412)
  • Fix sort related ITs for concurrent search (#9177
  • Removing the vec file extension from INDEX_STORE_HYBRID_NIO_EXTENSIONS, to ensure the no performance degradation for vector search via Lucene Engine.(#9528))
  • Add support to use trace propagated from client (#9506)
  • Separate request-based and settings-based concurrent segment search controls and introduce AggregatorFactory method to determine concurrent search support (#9469)
  • [Remote Store] Rate limiter integration for remote store uploads and downloads(#9448)
  • [Remote Store] Implicitly use replication type SEGMENT for remote store clusters (#9264)
  • Use non-concurrent path for sort request on timeseries index and field(#9562)

Deprecated

Removed

  • Remove provision to create Remote Indices without Remote Translog Store (#8719)

Fixed

  • Fix flaky ResourceAwareTasksTests.testBasicTaskResourceTracking test (#8993)
  • Fix memory leak when using Zstd Dictionary (#9403)
  • Fix range reads in respository-s3 (9512)
  • Handle null partSize in OnDemandBlockSnapshotIndexInput (#9291)
  • Fix condition to remove index create block (#9437)
  • Add support to clear archived index setting (#9019)
  • [Segment Replication] Fixed bug where replica shard temporarily serves stale data during an engine reset (#9495)

Security