Skip to content

Releases: cloudfoundry/cf-acceptance-tests

v7.3.0

21 Sep 16:37
72bc323
Compare
Choose a tag to compare

New Tests

-HTTP/2 and gRPC routing compatibility #473 and #479
-Isolated TCP routing compatibility #478

Updated Tests

-apps/loggregator.go

  • reduce the polling interval to avoid overloading log-cache which prevented the CF CLI from streaming logs
  • poll cf logs --recent repeatedly to properly wait for the expected log line to be seen

-windows/lifecycle.go

  • Poll cf apps repeatedly to properly wait for the second instance of the app to start

Other Updates

  • Update golang net package

v7.2.0

12 Apr 18:55
d74b168
Compare
Choose a tag to compare

Notice:

  • Make logging-route-service compatible with Go 1.16

Updated Tests

-apps/lifecycle.go

  • Make app summary memory and disk units optional #458

-services/service_instance_sharing.go

  • Update result for v8 service output #459

-services/service_broker_lifecycle.go
-services/service_instance_lifecycle.go

  • Replaced all v2 API calls with v3 calls #462
  • Fix catalog schema response test #463

Helpers updates

-helpers/services/broker.go

  • Replaced all v2 API calls with v3 calls #462

v7.1.0

08 Feb 19:18
Compare
Choose a tag to compare

Updated Tests

  • Fixed a couple tests that started failing with UAA v75.0.0 release
    • slack thread with additional context
    • #455 and #456
    • There were some nil checks that weren't testing anything and misleading users when they should have failed.
    • The regex in helpers/services/sso.go was expecting the UAA authorization code to only contain letters and numbers, which was a incorrect expectation. For example, as of today, the code can contain dashes "-".
  • services/service_instance_lifecycle.go and credhub/service_keys.go
    • Removed skipOnK8s from create-service-key tests now that that functionality has been fixed for cf-for-k8s
  • routing/multiple_app_ports.go
    • As part of the zero downtime feature work in CAPI, making changes to an app's ports now requires a restart for the changes to take effect. This commit reflects that change by adding a cf restart to the "Multiple App Ports" test. #454

Other Updates

  • added a required property credhub_secret to example config #451
  • test changes to develop branch not only against cf-deployment but also against cf-for-k8s (in the CATS pipeline)

v7.0.0

16 Dec 18:46
Compare
Choose a tag to compare

Notice:

  • This is a major release because we removed the internetless suite. The internetless functionality is not core to open-source CF.

Updated Tests

-services/service_instance_lifecycle.go

  • Relaxed test expectations

Moved Tests

-apps/syslog_drain.go → app_syslog_tcp/syslog_drain.go

  • Split the syslog drain test into a separate suite to allow it to be skipped while still running the apps suite.

Deleted Tests

-internetless/app_external_traffic_denied.go

  • This functionality is not core to open source CF

Other Updates

  • Use vendir to vendor the logging-route-service sample app - this will make sure to actually include the asset files in the released tarball.

v6.7.0

18 Nov 00:21
Compare
Choose a tag to compare

Updated Tests

-services/service_instance_lifecycle.go

  • Relaxes the test expectations to support cli v8.

Other Updates

-dora app

  • Now accepts connections from all addresses.

v6.6.0

04 Nov 19:28
Compare
Choose a tag to compare

Updated Tests

-apps/syslog_drain.go

  • better reflect original intention of the test

-isolation_segments/isolation_segments.go

  • Stop hardcoding the protocol

-apps/loggregator.go

  • increase the timeout to reduce flakiness of test on cf-for-k8s where logging can be slower

-route_services/route_services.go

  • remove obsolete -f flag

-windows/lifecycle.go

  • Use the configured timeout, rather than the hardcoded one

Other updates

  • add uptime endpoint to dora
  • improve sticky session documentation

v6.5.0

29 Sep 17:31
Compare
Choose a tag to compare

Updated Tests

-apps/crashing.go

  • Updated crash event tests to work with Eirini 1.9.0.
    -apps/routing_transparency.go
  • Updated routing transparency tests to work with Istio.

Helpers updates

  • Helpers added for route tests.

-helpers/download/download.go

  • Send curl output to file to avoid droplet binary dump in terminal.

Other Updates

  • Convert calls leveraging v2 Cloud Controller API endpoints to use the v3 CAPI endpoints, as part of VAT's work to deprecate v2 CAPI.
  • Additional tests skipped when running against cf-for-k8s, due to incompatibilities with the platform.

v6.4.0

21 Sep 23:34
Compare
Choose a tag to compare

Updated Tests

-apps/crashing.go

  • There are two fixes to test app crashes:
  1. The id checking for recovery was giving false positives because the post-crash ID was returning an error message which happened to differ from the pre-crash app's ID. It turns out that that IDs are reused on cf-for-k8s but change for cf-deployment.
  2. The two different infrastructure's IDs match different specific regular expressions, so a more general one handles both cases.
  • cf-for-k8s is waiting for a new release of eirini that will handle app.crash events, so that test is skipped for cf-for-k8s but the recovery tests can be run.

v6.3.0

11 Sep 22:30
b48b42e
Compare
Choose a tag to compare

Notice:

  • Cloud Foundry acceptance tests (CATS) now works with CF for Kubernetes

Updated Tests and Helpers

The following general changes affected multiple files, which we won't list here individually:

Some of the assertions have also been changed, with the addition of an informative string to be rendered and emitted when an assertion fails.

Other Updates

-docs/run-on-k8s.md
0d796dd : Covers needed changes for running CATs on CF for Kubernetes.

v6.2.0

10 Aug 02:43
5e23561
Compare
Choose a tag to compare

Notice:

  • This release adds the ability to control which tests will run based on the configuration option infrastructure with possible values kubernetes or vms (default).

Note that CATS is still under construction for Kubernetes environment and we are working towards a running version of CATs in cf-for-k8s

Updated Tests

  • See this PR 429 for list of tests that were updated. Note