Source Trello: Changed last records to last record (#37598)

Signed-off-by: Artem Inzhyyants <artem.inzhyyants@gmail.com> Co-authored-by: Artem Inzhyyants <artem.inzhyyants@gmail.com>
airbytehq · Apr 30, 2024 · f140aa3 · f140aa3
1 parent 1a1b8c9
commit f140aa3
Show file tree

Hide file tree

Showing 9 changed files with 1,371 additions and 107 deletions.
diff --git a/airbyte-integrations/connectors/source-trello/Dockerfile b/airbyte-integrations/connectors/source-trello/Dockerfile
diff --git a/airbyte-integrations/connectors/source-trello/metadata.yaml b/airbyte-integrations/connectors/source-trello/metadata.yaml
@@ -5,6 +5,8 @@ data:
   allowedHosts:
     hosts:
       - api.trello.com
+  connectorBuildOptions:
+    baseImage: docker.io/airbyte/python-connector-base:1.2.0@sha256:c22a9d97464b69d6ef01898edf3f8612dc11614f05a84984451dde195f337db9
   remoteRegistries:
     pypi:
       enabled: true
@@ -17,7 +19,7 @@ data:
   connectorSubtype: api
   connectorType: source
   definitionId: 8da67652-004c-11ec-9a03-0242ac130003
-  dockerImageTag: 1.0.2
+  dockerImageTag: 1.0.3
   dockerRepository: airbyte/source-trello
   documentationUrl: https://docs.airbyte.com/integrations/sources/trello
   githubIssueLabel: source-trello

diff --git a/airbyte-integrations/connectors/source-trello/poetry.lock b/airbyte-integrations/connectors/source-trello/poetry.lock
diff --git a/airbyte-integrations/connectors/source-trello/pyproject.toml b/airbyte-integrations/connectors/source-trello/pyproject.toml
@@ -0,0 +1,29 @@
+[build-system]
+requires = [ "poetry-core>=1.0.0",]
+build-backend = "poetry.core.masonry.api"
+
+[tool.poetry]
+version = "1.0.3"
+name = "source-trello"
+description = "Source implementation for Trello."
+authors = [ "Airbyte <contact@airbyte.io>",]
+license = "MIT"
+readme = "README.md"
+documentation = "https://docs.airbyte.com/integrations/sources/trello"
+homepage = "https://airbyte.com"
+repository = "https://github.com/airbytehq/airbyte"
+[[tool.poetry.packages]]
+include = "source_trello"
+
+[tool.poetry.dependencies]
+python = "^3.9,<3.12"
+airbyte-cdk = "^0"
+
+[tool.poetry.scripts]
+source-trello = "source_trello.run:run"
+
+[tool.poetry.group.dev.dependencies]
+requests-mock = "^1.9.3"
+pytest-mock = "^3.6"
+pytest = "^6.1"
+
diff --git a/airbyte-integrations/connectors/source-trello/requirements.txt b/airbyte-integrations/connectors/source-trello/requirements.txt
diff --git a/airbyte-integrations/connectors/source-trello/setup.py b/airbyte-integrations/connectors/source-trello/setup.py
diff --git a/airbyte-integrations/connectors/source-trello/source_trello/components.py b/airbyte-integrations/connectors/source-trello/source_trello/components.py
@@ -22,7 +22,7 @@ def stream_slices(self) -> Iterable[StreamSlice]:
             board_ids = self.read_all_boards(stream_boards=stream_map["boards"], stream_organizations=stream_map["organizations"])
 
         for board_id in board_ids:
-            yield {"id": board_id}
+            yield StreamSlice(partition={"id": board_id}, cursor_slice={})
 
     def read_all_boards(self, stream_boards: Stream, stream_organizations: Stream):
         """

diff --git a/airbyte-integrations/connectors/source-trello/source_trello/manifest.yaml b/airbyte-integrations/connectors/source-trello/source_trello/manifest.yaml
@@ -1,4 +1,4 @@
-version: 0.51.2
+version: 0.85.0
 type: DeclarativeSource
 
 check:
@@ -49,8 +49,8 @@ definitions:
     pagination_strategy:
       type: CursorPagination
       page_size: 500
-      cursor_value: "{{ (last_records|last)['id'] }}"
-      stop_condition: "{{ not last_records }}"
+      cursor_value: "{{ last_record['id'] }}"
+      stop_condition: "{{ not last_record }}"
   board_id_partition_router:
     - type: CustomPartitionRouter
       class_name: source_trello.components.OrderIdsPartitionRouter

diff --git a/docs/integrations/sources/trello.md b/docs/integrations/sources/trello.md
@@ -74,19 +74,20 @@ The Trello connector should not run into Trello API limitations under normal usa
 
 ## Changelog
 
-| Version | Date       | Pull Request                                             | Subject                                                    |
-|:--------|:-----------|:---------------------------------------------------------|:-----------------------------------------------------------|
-| 1.0.2   | 2023-10-13 | [31205](https://github.com/airbytehq/airbyte/pull/31205) | Improve spec description for board ids                     |
-| 1.0.1   | 2023-10-13 | [31168](https://github.com/airbytehq/airbyte/pull/31168) | Fix `cards` schema                                         |
-| 1.0.0   | 2023-09-08 | [29876](https://github.com/airbytehq/airbyte/pull/29876) | Migrate to Low Code CDK                                    |
-| 0.3.4   | 2023-07-31 | [28734](https://github.com/airbytehq/airbyte/pull/28734) | Updated `expected records` for CAT test and fixed `advancedAuth` broken references                                |
-| 0.3.3   | 2023-06-19 | [27470](https://github.com/airbytehq/airbyte/pull/27470) | Update Organizations schema                                |
-| 0.3.2   | 2023-05-05 | [25870](https://github.com/airbytehq/airbyte/pull/25870) | Added `CDK typeTransformer` to guarantee JSON schema types |
-| 0.3.1   | 2023-03-21 | [24266](https://github.com/airbytehq/airbyte/pull/24266) | Get board ids also from organizations                      |
-| 0.3.0   | 2023-03-17 | [24141](https://github.com/airbytehq/airbyte/pull/24141) | Certify to Beta                                            |
-| 0.2.0   | 2023-03-15 | [24045](https://github.com/airbytehq/airbyte/pull/24045) | Fix schema for boards and cards streams                    |
-| 0.1.6   | 2021-12-28 | [8628](https://github.com/airbytehq/airbyte/pull/8628)   | Updated fields in source-connector specifications          |
-| 0.1.3   | 2021-11-25 | [8183](https://github.com/airbytehq/airbyte/pull/8183)   | Enable specifying board ids in configuration               |
-| 0.1.2   | 2021-11-08 | [7499](https://github.com/airbytehq/airbyte/pull/7499)   | Remove base-python dependencies                            |
-| 0.1.1   | 2021-10-12 | [6968](https://github.com/airbytehq/airbyte/pull/6968)   | Add oAuth flow support                                     |
-| 0.1.0   | 2021-08-18 | [5501](https://github.com/airbytehq/airbyte/pull/5501)   | Release Trello CDK Connector                               |
+| Version | Date       | Pull Request                                             | Subject                                                                            |
+|:--------|:-----------|:---------------------------------------------------------|:-----------------------------------------------------------------------------------|
+| 1.0.3   | 2024-04-30 | [37598](https://github.com/airbytehq/airbyte/pull/37598) | Changed last records to last record                                                |
+| 1.0.2   | 2023-10-13 | [31205](https://github.com/airbytehq/airbyte/pull/31205) | Improve spec description for board ids                                             |
+| 1.0.1   | 2023-10-13 | [31168](https://github.com/airbytehq/airbyte/pull/31168) | Fix `cards` schema                                                                 |
+| 1.0.0   | 2023-09-08 | [29876](https://github.com/airbytehq/airbyte/pull/29876) | Migrate to Low Code CDK                                                            |
+| 0.3.4   | 2023-07-31 | [28734](https://github.com/airbytehq/airbyte/pull/28734) | Updated `expected records` for CAT test and fixed `advancedAuth` broken references |
+| 0.3.3   | 2023-06-19 | [27470](https://github.com/airbytehq/airbyte/pull/27470) | Update Organizations schema                                                        |
+| 0.3.2   | 2023-05-05 | [25870](https://github.com/airbytehq/airbyte/pull/25870) | Added `CDK typeTransformer` to guarantee JSON schema types                         |
+| 0.3.1   | 2023-03-21 | [24266](https://github.com/airbytehq/airbyte/pull/24266) | Get board ids also from organizations                                              |
+| 0.3.0   | 2023-03-17 | [24141](https://github.com/airbytehq/airbyte/pull/24141) | Certify to Beta                                                                    |
+| 0.2.0   | 2023-03-15 | [24045](https://github.com/airbytehq/airbyte/pull/24045) | Fix schema for boards and cards streams                                            |
+| 0.1.6   | 2021-12-28 | [8628](https://github.com/airbytehq/airbyte/pull/8628)   | Updated fields in source-connector specifications                                  |
+| 0.1.3   | 2021-11-25 | [8183](https://github.com/airbytehq/airbyte/pull/8183)   | Enable specifying board ids in configuration                                       |
+| 0.1.2   | 2021-11-08 | [7499](https://github.com/airbytehq/airbyte/pull/7499)   | Remove base-python dependencies                                                    |
+| 0.1.1   | 2021-10-12 | [6968](https://github.com/airbytehq/airbyte/pull/6968)   | Add oAuth flow support                                                             |
+| 0.1.0   | 2021-08-18 | [5501](https://github.com/airbytehq/airbyte/pull/5501)   | Release Trello CDK Connector                                                       |