CHANGELOG.md

Change Log

v4.1 (2018-04-17)

Full Changelog

Note: Because of the integration with Confluent Platform integration, KSQL now uses the former's versioning scheme.

KSQL is now production ready and GA. It is distributed as part of Confluent Platform 4.1 (download).

Our 4.1 release blog has the details about what's new in this release. The KSQL 4.1 Upgrade Guide provides information on how to upgrade from KSQL v0.x developer preview releases to v4.1.

v0.5 (2018-03-07)

Full Changelog

This release included various bugfixes to stabilize KSQL.

v0.4 (2018-02-01)

Full Changelog

Implemented enhancements:

• Integration with Schema Registry #483

Closed issues:

• KSQL Avro format seems to be incompatible with the avro format expected by Kafka connect. #651
• CSAS execution silently fails #643
• Enhance 'print topic;' to display kafka topics #625
• ksql-server-start will hang when it "Unable to check broker compatibility" #611
• UDF function to search if the value exists in the json array #607
• CSAS: WITH is incompatible with WHERE? #604
• Timestamp field appears not to work in DESCRIBE EXTENDED #603
• EXTRACTJSONFIELD JSON array support #523
• Extend the DESCRIBE statement to more useful information #470

Merged pull requests:

• Update quickstart docs with new output for describe #684 (apurvam)
• Expect ksql-run-class parameters after the class name #683 (rodesai)
• Bump version to 0.4 #682 (apurvam)
• Make sure each Beacon ping includes current time #681 (apovzner)
• Update the start scripts so that the ksql server always generates a gc log #674 (apurvam)
• More informative help output for print-metrics #671 (rodesai)
• Cos integration for KSQL. #663 (hjafarpour)
• Remove suppression of method length check #662 (dguy)
• Allow passing a properties file to the quickstart examples #657 (mimaison)
• enable checkstyle check to avoid star import #654 (dguy)
• update datagen so iteration works properly and add schemas to use for testing #653 (dguy)
• Use PhoneHomeConfig for KSQL Beacon #648 (apovzner)
• updates for line length style check #645 (norwood)
• use EntityUtils instead of manually reading entity #644 (norwood)
• Add ksql-tools #634 (rodesai)
• Tests for cli module plus further tests for refactoring. #626 (dguy)
• Enhance show topics; and print "topic"; #624 (bluemonk3y)
• [BUG] jsonNode array index access for EXTRACTJSONFIELD #610 (robert2d)
• [UDF] JSON Array Contains function #608 (satybald)
• [Minor] Fix Variable initialization #602 (satybald)

v0.3 (2018-01-16)

Full Changelog

0.3 (2018-01-16)

Full Changelog

Fixed bugs:

• Broker compatibility check needs at least one topic to exist #612

Closed issues:

• Compilation issue: assembly-plugin group id '113584762' is too big #590
• Quickstart Non-Docker Setup for KSQL encounters error during compilation and cannot find symbol "class ZkUtilsProvider" #582
• Add system test - Rolling bounces #467
• Add system test - Core Kafka broker failures (one node or complete cluster, hard and soft) #466
• Add system test - lose a stream or rest node (due to OOM or crash) #465
• Make KSQL emit warning message when running against non-compliant AK, CK version #464

Merged pull requests:

• restore assembly configs #621 (aayars)
• remove docker boilerplate now provided by common #618 (aayars)
• create topic if none exist during broker compat test #612 #617 (dguy)
• Fix queries with limit #615 (rodesai)
• Refactoring to use schema type for comparison. #614 (hjafarpour)
• Use Apache commons CSV package for both serializer and deserializer i… #613 (hjafarpour)
• COS packaging for KSQL. #609 (hjafarpour)
• KSQL-473: point quickstart non-docker docs to release tarballs #601 (rodesai)
• Fix code style issues #599 (satybald)
• MINOR: Further code cleanups. #597 (dguy)
• Support avro types for nullable fields generated by Connect. #592 (hjafarpour)
• MINOR: don't allow modification of AggregateAnalysis collections externally #589 (dguy)
• KSQL-508: add metrics interceptors instead of replacing #585 (rodesai)
• Tests for commons package. #584 (hjafarpour)
• Ksql 569 serde tests #583 (hjafarpour)
• Skip the '@' character in the beginning of the field name in JSON #581 (hjafarpour)
• KSQL-235: dont block on socket read #579 (rodesai)
• Top k udaf #575 (hjafarpour)

v0.3-temp (2018-01-05)

Full Changelog

Implemented enhancements:

• View Tables Properties for a Stream #516

Fixed bugs:

• Don't execute create table/create stream as select statements during startup when the entity has been dropped #531
• Don't replay all previous events found on the command topic #454
• CLI should not start up if server is down #360

Closed issues:

• Command topic replication factor is not set correctly. #564
• Update Avro docs for tables because of issue 557 #561
• CREATE TABLE examples do not define KEY property yet #559
• Build Failing in all versions #558
• Schema inference for tables #557
• Add avro sample data generation in examples package. #541
• Could not find artifact io.confluent:common:pom:4.0.0-SNAPSHOT #537
• GROUP BY not recognizing SELECT Elements? #512
• Can't find any documentation about ksql in Confluent 4.0.x #502
• join not supported? #493
• LEFT Join statement always return null #491
• Don't start terminated queries on ksql-server startup #482
• Error building kqsl: Non-resolvable parent POM for io.confluent.ksql:ksql-parent:4.0.0-SNAPSHOT #481
• Add basic metrics integration to KSQL #463

Merged pull requests:

• Fix compilation issue group id '113584762' is too big in assemly-plugin #591 (satybald)
• MINOR: remove unused KsqlConfig param from QueryMetadata etc #588 (dguy)
• Fix findbugs errors #587 (ewencp)
• Fix findbugs errors #586 (ewencp)
• Fixed the issue with BaseMetricsReporter. #578 (hjafarpour)
• Updated the docs. #574 (hjafarpour)
• Add a column for the 0.3 release to the version compatibility docs #571 (apurvam)
• KSQL-473: add a package module #570 (rodesai)
• The number of replicas for the command topic should be set by 'ksql.s… #565 (hjafarpour)
• Docs improvement. #563 (hjafarpour)
• Schema inference for tables #562 (hjafarpour)
• Remove redundant "for more information" in DESCRIBE EXTENDED output #560 (miguno)
• KSQL-493: Fix producer thread leak #556 (rodesai)
• Minor updates to the non docker quickstart #552 (apurvam)
• Fix quickstart to have the correct schema registry url #551 (apurvam)
• Clarify that Docker clickstream demo requires 5+ GB of RAM #549 (miguno)
• Minor docs improvements #548 (miguno)
• Improve DESCRIBE and EXPLAIN docs (see PR #539) #547 (miguno)
• Docs updates for 0.3 release #546 (apurvam)
• Add ability to specify the schema registry url to the CLI in local mode. #545 (apurvam)
• Added avro producer for data gen for the new schema registry integrat… #544 (hjafarpour)
• Fixed minor style issues in the docs. #543 (hjafarpour)
• Bump ksql version to 0.3 #542 (apurvam)
• Improve docs on DESCRIBE and EXPLAIN #539 (miguno)
• Add tip on configuring artifactory to ensure builds are working #538 (miguno)
• Add ratings example #535 (blueedgenick)
• Add Idle query and error rate metrics #534 (apurvam)
• don't execute dropped streams/tables, but update metastore #532 (dguy)
• KSQL-484 - Add version compatibility table to the docs #526 (joel-hamill)
• Support DESCRIBE EXTENDED, v2 #522 (bluemonk3y)
• Print more informative error messages #514 (rodesai)
• Add metrics which report the number of running queries #513 (apurvam)
• Describe extend functionality #511 (bluemonk3y)
• Don't run terminated queries at startup #482 #508 (dguy)
• Remove outdated roadmap document #507 (miguno)
• Revert commits which broke the docs #501 (apurvam)
• KSQL-476: Use explicit tags for docker image dependencies #500 (aayars)
• add broker compatibility check #499 (dguy)
• fix regression in app id creation #498 (dguy)
• Make doc links point to GH repo #496 (joel-hamill)
• Fixed the regression for stream-table join. Table should always read … #495 (hjafarpour)
• Add list of actual results to CLITest output when it fails #494 (apurvam)
• change replication factor check when creating topics #492 (dguy)
• Add snapshots repo for Confluent dependencies #490 (aayars)
• Ksql 415 schema registry integration #488 (hjafarpour)
• Fix the sporadically failing CLITests #486 (apurvam)
• Hide user name and password command line flags #485 (apurvam)
• Change jenkins slack channel #484 (hjafarpour)
• Don't replay all previous events found on the command topic #454 #480 (dguy)
• Added basic auth capabilities to KSQL Remote cli #477 (apurvam)
• Adding metric-collection for DESCRIBE EXTEND #475 (bluemonk3y)
• Make key property mandatory in CREATE TABLE statement. #473 (hjafarpour)
• DOCS-127 - Add KSQL doc to CP #472 (joel-hamill)
• Add doc for fail.on.deserialization.error #462 (dguy)
• KSQL-351 - Doc error for ksql-server-start #440 (joel-hamill)

v0.2 (2017-11-20)

Full Changelog

Implemented enhancements:

• Ksql 294 drop source correctly #451

Fixed bugs:

• KSQL does not create log directory #359

Closed issues:

• EXTRACTJSONFIELD type #446
• SELECT statements hang in ksql-cli and server mode #442
• Remove duplicate Metastore fixture #437
• Delimited Integration Test #434
• compile failure with some dependency issue #423
• Fix findbugs warnings #412
• Review exception and error reporting #394
• Provide config to use Stream Deserialization Exception handler #384
• Make QueryStreamWriter use threads properly [KSQL-397] #382
• ksql-cli should be able to accept input from STDIN and a filename via an argument #380
• TEST: Add Stream Table - Left-Join integration test #374
• Demo - Grafana 502 error in Data Source #373
• what is the format of Kafka data that ksql require? #364
• refactor integration tests and enhance KSQLContext #340
• Running 'ksql-cli local' on different kafka port from default #334
• rename ksql- modules #331
• Restructure QueuedSchemaKStream #329
• Refactor core into parser, metastore and common #326
• "ksql-cli local" worked very well when first used and after that it started hanging #320
• Question about query #310
• No value present when joining two tables #308
• LEFT JOIN query results in java.lang.String cannot be cast to org.apache.kafka.streams.kstream.Windowed #305
• ksql-cli hangs after server maintenance, WARN No records received after 30 seconds of polling in log #303
• can not load data in grafana #300
• The demo Dashboard don't load the Data #294
• Kafka avro schema data not reflecting from topic #293
• Possible to avoid running tests? #292
• ksql standalone mode error #290
• Compile SqlBase.g4 less SqlBaseBaseVisitor #287
• Creating stream and associated stream with new topic, appears to be attempting to associate with another topic #285
• CREATE STREAM AS SELECT is not exists KEY property #279
• "Query terminated" not appropriate #270
• Clickstream Demo: Recovering from install errors #262
• Need a way to sample a topic #261
• After starting the docker-quickstart, I can't see any Kafka topics #259
• Readme images #164

Merged pull requests:

• Assign query id only to the persistent queries (CSAS/CTAS). We don't … #461 (hjafarpour)
• Clarify that WHERE clause can refer to any column, including implicit columns #460 (miguno)
• Fixed the regression bug for aggregates with no window. #459 (hjafarpour)
• Bump metrics-client version to 4.1.0-SNAPSHOT in master #458 (apurvam)
• use a random free port in KsqlRestClientTest #457 (dguy)
• reset repartition flag after map #450 (dguy)
• KSQL 420 join criteria validation #447 (hjafarpour)
• Ksql 294 drop source correctly #444 (hjafarpour)
• remove duplicate metastore fixture #438 (bluemonk3y)
• Delimited integration test #435 (bluemonk3y)
• add DDLStatement interface, extract command factory, tidy up, test etc #433 (dguy)
• extract QueryAnalyzer from QueryEngine #432 (dguy)
• KSQL-398: integration test covering quickstart scenarios #431 (apurvam)
• Ksql beacon #429 (mageshn)
• findbugs exclusions #428 (dguy)
• clickstream demo CI images #427 (aayars)
• Clarify the deployment modes #426 (miguno)
• Add example for using --exec #425 (miguno)
• fix more findbugs warnings #424 (dguy)
• Added self documentation to the KSQL config public config variables. #422 (hjafarpour)
• remove checkstlye build plugin as it is provided by the parent pom #421 (dguy)
• fix findbugs warnings in ksql-rest #420 (dguy)
• Fixed the regression bug for CSAS/CTAS result type check. #419 (hjafarpour)
• findbugs warnings in ksql-parser #418 (dguy)
• fix findbugs warnings in examples #417 (dguy)
• findbugs warnings in ksql-engine #416 (dguy)
• fix findbugs in ksql-common #415 (dguy)
• fix findbugs warning in cli #414 (dguy)
• fix findbugs in json deserializer #413 (dguy)
• use mapValues instead of map in SchemaKStream.select #411 (dguy)
• new-tests #407 (TheRealHaui)
• Bring back the commented assertions in StatementExecutorTest and aCom… #406 (hjafarpour)
• move functionality out of PhysicalPlanBuilder into other classes and add tests #405 (dguy)
• Removed unused config variable. #404 (hjafarpour)
• add tests for ExpressionFormatter #399 (dguy)
• remove duplicate ExpressionFormatterQueryRewrite class and move some logic to remove instanceof #398 (dguy)
• Make WindowingIntTest more reliable #397 (dguy)
• Moved duplicate exceptions to one function #396 (samupra)
• CODE: pass over looking at exception handling and reporting [KQL-395] #395 (bluemonk3y)
• fix bad serde package declaration #392 (blueedgenick)
• Ksql 383 clean up internal topics for terminated queries #391 (hjafarpour)
• add test for SelectValueMapper #389 (dguy)
• minor tidy ups to get rid of some unchecked warnings etc #387 (dguy)
• Provide config to use Stream Deserialization Exception handler #384 #385 (dguy)
• CODE: rework threading on QueryStreamWriter #383 (bluemonk3y)
• make join test more reliable #381 (dguy)
• Extract SelectValueMapper from SchemaKStream and SchemaKTable #379 (dguy)
• Put window aggregate logic into the various KsqlWindowExpression classes #377 (dguy)
• move the createsink method out of SchemaKStream #376 (dguy)
• TEST: adding stream-table join #375 (bluemonk3y)
• TEST: adding windowing integration tests, updated streams integration util #371 (bluemonk3y)
• Ksql 386 ksql functions non static #370 (hjafarpour)
• remove jackson dependency in ksql-rest-app. #369 (dguy)
• Remove SourceNode as it is redundant #368 (dguy)
• TEST: Refactoring integration tests from 0.1.x #367 (bluemonk3y)
• MINOR: Use streams 1.0 api methods #365 (dguy)
• After bumping the dependency to 4.0.0 we encountered some issues that… #363 (hjafarpour)
• Revert "Ksql 388 fix 400 build issues" #362 (hjafarpour)
• Ksql 388 fix 400 build issues #361 (hjafarpour)
• Extract methods, remove duplication, etc from PhysicalPlanBuilder #356 (dguy)
• Merge 0.1.x into Master #352 (hjafarpour)
• Reverting adminclient singleton temporarily. #351 (hjafarpour)
• Pom cleanup after refactor #350 (hjafarpour)
• skip bad data in json and delimitted deserializer #347 (dguy)
• MINOR: replace window-unit with TimeUnit #346 (dguy)
• Bluemonk3y 0.1.x code 379 started int test refactor #344 (hjafarpour)
• MINOR: ksqlengine tidy up #343 (dguy)
• MINOR: remove unused imports #342 (dguy)
• 0.1.x [340] started integration test refactoring #341 (bluemonk3y)
• Master #339 (hjafarpour)
• Ksql config refactor #338 (hjafarpour)
• MINOR: remove dead code. make field and method access more restricted #337 (dguy)
• No need to set the streams application.id for the rest server. #336 (hjafarpour)
• First step in better testing tools. Added an integration test tool to… #335 (hjafarpour)
• KSQL-378: content-based routing #333 (ybyzek)
• rename ksql-core to ksql-engine #332 (bluemonk3y)
• Extracted Pipeline into QueuePopulatorSchema #330 (bluemonk3y)
• Fixed the drop table issue. #328 (hjafarpour)
• Refactored the package for GenericRow. #327 (hjafarpour)
• refactoring parser, core and common #325 (bluemonk3y)
• Including the streams config properties in the session with CTAS and … #324 (hjafarpour)
• Clarify how streams and tables are stored in topics #323 (miguno)
• 0.1.x bug fix command queue replay hang #321 (bluemonk3y)
• added persistent information for streams and table #319 (bluemonk3y)
• Small code quality improvements #313 (TheRealHaui)
• add-some-unit-tests #312 (TheRealHaui)
• Clarify KSQL works with AK and CP #302 (miguno)
• Update non-docker-clickstream.md #301 (himani1)
• MINOR: fix checkstyle errors and fail build if there are checkstyle violations #298 (dguy)
• Document how to configure the Kafka bootstrap servers #297 (miguno)
• Add upstream project so build are triggered automatically #296 (ewencp)
• Emit succinct error for missing query file #291 (kirktrue)
• Documentation improvements #289 (miguno)
• Add missing word to roadmap #288 (elliotcm)
• remove build-tools copy, use pluginRepository in pom #286 (aayars)
• Fixed a minor error in the syntax guide. #281 (hjafarpour)
• Feature fix misspelled words #280 (juneng603)
• Improvements to syntax guide #277 (miguno)
• Added LIKE examples to syntax guide and examples. #271 (hjafarpour)
• KSQL screencast image #268 (joel-hamill)
• Fix non-docker quickstart examples #257 (joel-hamill)
• Update slack URL #256 (joel-hamill)
• Add screencast #255 (joel-hamill)
• Doc feedback rollup #254 (joel-hamill)
• KSQL-318 - define roadmap #253 (bluemonk3y)
• Improve examples.md #246 (miguno)

* This Change Log was automatically generated by github_changelog_generator