Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[receiver/sqlquery] add support for logs #20730

Merged
merged 60 commits into from
Jun 14, 2023

Commits on Apr 6, 2023

  1. feat: add config option for logs

    Adds basic configuration option for logs.
    andrzej-stencel committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    03de16d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    38bebb5 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    c7e54fc View commit details
    Browse the repository at this point in the history

Commits on Apr 7, 2023

  1. Configuration menu
    Copy the full SHA
    b0f213e View commit details
    Browse the repository at this point in the history
  2. test: add integration tests for reading logs

    The integration tests are failing now,
    because log collection is not implemented yet.
    Implementing it is the next step.
    The initial implementation in the next step should be the most naive possible:
    just running the provided query every collection interval,
    without any tracking of the data that has already been read.
    
    Perhaps the log collection integration tests
    should be separated from the metrics collection
    integration tests for greater visibility
    into what is working and what is failing.
    andrzej-stencel committed Apr 7, 2023
    Configuration menu
    Copy the full SHA
    b093dc2 View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2023

  1. scrape logs

    dmolenda-sumo committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    d2e96d0 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2023

  1. Configuration menu
    Copy the full SHA
    831f1e0 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2023

  1. feat: panic on query errors from db

    The panic is useful for testing.
    When this feature is complete,
    the panics must be replaced with error logging.
    andrzej-stencel committed Apr 24, 2023
    Configuration menu
    Copy the full SHA
    284a5ee View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    770dbc5 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2023

  1. test(integration): expect 5 log records

    At this stage, the logs query is run only once
    per collector run, e.g. collection_interval is ignored.
    Reflect this in the tests before implementing
    collecting logs on interval.
    andrzej-stencel committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    3efc74a View commit details
    Browse the repository at this point in the history
  2. feat: make body column configurable

    Oracle expects uppercase column names.
    andrzej-stencel committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    ada5a55 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2023

  1. feat: collect logs periodically

    Collecting logs every collection interval.
    To prevent collecting duplicates,
    we need to track the already collected logs,
    which is going to be the next step.
    andrzej-stencel committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    8cb5fe4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e8edb18 View commit details
    Browse the repository at this point in the history
  3. refactor: go mod tidy

    andrzej-stencel committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    2da8e7b View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2023

  1. feat: support tracking processed rows

    This initial implementation supports only integer tracking columns.
    The next type to support should be datetime/timestamp.
    We should also support using persistent storage for the tracking value.
    andrzej-stencel committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    5213532 View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2023

  1. Configuration menu
    Copy the full SHA
    84e645b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    7fb2aa2 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    cf12ef4 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2023

  1. Configuration menu
    Copy the full SHA
    55c232b View commit details
    Browse the repository at this point in the history

Commits on May 11, 2023

  1. Configuration menu
    Copy the full SHA
    6391a24 View commit details
    Browse the repository at this point in the history
  2. Merge pull request #2 from dmolenda-sumo/sqlqueryreceiver-support-tim…

    …estamp-for-tracking-column
    
    SQL Query receiver - support timestamp in tracking column
    dmolenda-sumo authored May 11, 2023
    Configuration menu
    Copy the full SHA
    db391d2 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    1a5175d View commit details
    Browse the repository at this point in the history

Commits on May 12, 2023

  1. fix integration tests

    dmolenda-sumo committed May 12, 2023
    Configuration menu
    Copy the full SHA
    66a772a View commit details
    Browse the repository at this point in the history
  2. Merge pull request #3 from dmolenda-sumo/sqlqueryreceiver-fix-integra…

    …tion-tests
    
    fix integration tests
    dmolenda-sumo authored May 12, 2023
    Configuration menu
    Copy the full SHA
    ef5782d View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    27b4c3f View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    e1e0684 View commit details
    Browse the repository at this point in the history
  5. Merge pull request #5 from dmolenda-sumo/sqlqueryreceiver-add-logs-to…

    …-mysql-integration-test
    
    SQL Query receiver: add logs to mysql integration test
    dmolenda-sumo authored May 12, 2023
    Configuration menu
    Copy the full SHA
    4b58330 View commit details
    Browse the repository at this point in the history

Commits on May 15, 2023

  1. Configuration menu
    Copy the full SHA
    18407d0 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2023

  1. Configuration menu
    Copy the full SHA
    a63f68b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    95e6c31 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    353b38a View commit details
    Browse the repository at this point in the history
  4. test: terminate DB containers after test

    This prevents a "busy port" error when running
    one of the tests repeatedly.
    andrzej-stencel committed May 16, 2023
    Configuration menu
    Copy the full SHA
    0a5ddd3 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    8268a3b View commit details
    Browse the repository at this point in the history
  6. Merge pull request #6 from dmolenda-sumo/persistence

    feat: persist tracking value in storage
    andrzej-stencel authored May 16, 2023
    Configuration menu
    Copy the full SHA
    55c8add View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    099056b View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    a55c95e View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    155de51 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2023

  1. Configuration menu
    Copy the full SHA
    cda1cf9 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d98c0b0 View commit details
    Browse the repository at this point in the history
  3. docs: fix parameter notation in configuration

    The `$` character needs to be escaped with `$$` in Otelcol config files.
    andrzej-stencel committed May 17, 2023
    Configuration menu
    Copy the full SHA
    ef97e41 View commit details
    Browse the repository at this point in the history
  4. chore: go mod tidy

    andrzej-stencel committed May 17, 2023
    Configuration menu
    Copy the full SHA
    6a66195 View commit details
    Browse the repository at this point in the history

Commits on May 18, 2023

  1. fix lint errors

    andrzej-stencel committed May 18, 2023
    Configuration menu
    Copy the full SHA
    553fd46 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    355081b View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    03d04ff View commit details
    Browse the repository at this point in the history
  4. chore: make crosslink

    andrzej-stencel committed May 18, 2023
    Configuration menu
    Copy the full SHA
    fab7a33 View commit details
    Browse the repository at this point in the history
  5. chore: make gotidy

    andrzej-stencel committed May 18, 2023
    Configuration menu
    Copy the full SHA
    6fe88c2 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    c5eddd6 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    152033f View commit details
    Browse the repository at this point in the history
  8. chore: make generate

    andrzej-stencel committed May 18, 2023
    Configuration menu
    Copy the full SHA
    323f5d2 View commit details
    Browse the repository at this point in the history
  9. Merge pull request #7 from kkujawa-sumo/kk-add-traces

    feat(sqlqueryreceiver) add traces to monitor logs received
    andrzej-stencel authored May 18, 2023
    Configuration menu
    Copy the full SHA
    88ed5c8 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    f180fd6 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2023

  1. Configuration menu
    Copy the full SHA
    b192b0f View commit details
    Browse the repository at this point in the history
  2. fix integration test

    andrzej-stencel committed May 23, 2023
    Configuration menu
    Copy the full SHA
    a6f2c5d View commit details
    Browse the repository at this point in the history
  3. test: clean up tests

    After introducing integration test framework
    andrzej-stencel committed May 23, 2023
    Configuration menu
    Copy the full SHA
    9a46ae9 View commit details
    Browse the repository at this point in the history

Commits on May 25, 2023

  1. fix: prevent panic on shutdown

    When the component needs to be shut down before it was properly started
    (for example due to a configuration erro
    like using a storage extension that does not exist),
    we need to check if variables have been initialized
    to prevent panics due to nil pointer dereference.
    andrzej-stencel committed May 25, 2023
    Configuration menu
    Copy the full SHA
    a1ab2d3 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2023

  1. Configuration menu
    Copy the full SHA
    2c50539 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    923df54 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2023

  1. Configuration menu
    Copy the full SHA
    8790642 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2023

  1. Configuration menu
    Copy the full SHA
    cd997f8 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2023

  1. Configuration menu
    Copy the full SHA
    e20996a View commit details
    Browse the repository at this point in the history