Add changes on production environment #2232

etaques · 2023-02-20T13:45:57Z

Add changes on production environment

[FIX] orb helm url (#2154)

[FIX] chart lock url on kind environment (#2156)

…gs. (#2135) [ORB-203] Enable sink status update by listening to otel-collector logs. (#2135)

[FIX] change organization to orb-community (#2157)

feat(maestro): fix message with error in mid-sentence. (#2158)

…2152) * fix group tags editing - make it unable to delete tags * typo(agent): fix no_tap_match status typo * fix(fleet): partial updates for agent and endpoint unit tests * fix(fleet): partial updates for agent and service unit tests

Remove otel collector health_check extension unused (#2159)

Removing logging extension on otel collector (#2160)

[FIX] DeployCollector function (#2162)

* Update README.md

* [FIX] on logic for active and error sinks status * symplify analyzeLogs function * lastRemoteWrite is actually controlled by sinker * fix message * remove comments * remove unnecessary * deployment status should be internally controlled * fix err variable * add comments * fix comment * fix comments * add error if collector was not found * fix error * add changes * add changes * fix maestro lastactivity * fix maestro lastactivity * fix condition for idle * remove idle control on sinker * deployment check

…ry in all sinks (#2150) * feat(migrate): add migrate service, to add/remove openTelemetry, add control flag there to be able to rollback if necessary. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * feat(sinker): remove skip, and add deprecation message. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * feat(sinker): fix deprecation message. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * feat(sinks): add default values for OpenTelemetry sink. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * feat(ui): remove sinks OpenTelemetry flag. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * feat(sinks): fix opentelemetry tag case Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * feat(UI): remove OpenTelemetry flag. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * feat(makefile): add kubectl rollout in makefile. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * feat(migrate): fix identation. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * feat(charts): testing chart migrate true. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * feat(maestro): add otel flag enabled as true. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * feat(maestro): re-add after testing. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> --------- Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

[FIX] refactoring maestro event sourcing for sink status (#2165)

Fix delete sinks on maestro (#2167)

Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

* feat(maestro): update cache with creation of yaml. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * feat(maestro): fix parse of json. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * feat(maestro): add debug log. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> --------- Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

[FIX] maestro event sourcing to update otel collector (#2171)

…p/down. (#2174) Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

* feat(agent): fix context propagation for failure in otel Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * feat(agent): add context propagation. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> --------- Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

* fix(sinks): fix merging of the sinks tags and config. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(sinks): fix tests Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(sinker): fix not removing sinker cache when removing sink. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> --------- Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

* do not skip when lastactivity not found * [FIX] only check last activity after error * fix variables * fix variables --------- Co-authored-by: Luiz Henrique Pegoraro <luiz.pegoraro@encora.com>

…code, to only redis package have redisClient (#2177) * fix(maestro): replace local cache for wait mechanism in getting the deployment state Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(maestro): add secondary step validation Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(maestro): focused every redis integration into redis eventStream service. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> --------- Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

* fix(maestro): fix maestro redis proper client. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(maestro): reduce time to check for pod creation Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> --------- Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

* fix(maestro): added fine tuning to maestro. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(maestro): added fine tuning to maestro. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(maestro): more fine tuning in wait periods for k8s Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(maestro): more fine-tuning in wait periods for k8s. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(sinks): add remote_host validation to prevent users to create sinks with invalid url Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(sinks): fix tests to adapt to new error Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> --------- Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

* fix(maestro): added fine tuning to maestro. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(maestro): added fine tuning to maestro. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(maestro): more fine tuning in wait periods for k8s Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(maestro): more fine-tuning in wait periods for k8s. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(sinks): add remote_host validation to prevent users to create sinks with invalid url Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(sinks): fix tests to adapt to new error Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(sinks): fix error message. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(maestro-): extracted change of status. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> --------- Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

* Revert "fix(redis): add debug logs" This reverts commit 44f4b98. * fix(redis): re-add fix on iteration Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> --------- Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

…nd handling event errors (#2206) * fix(redis): fix breaking out of reading routine because of failure. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(redis): fix breaking out of reading routine because of failure. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(redis): clean up. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> --------- Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

…2211) Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

#2212) * fix(maestro): reverting back to file management due to throttling of k8s api. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(maestro): fix reversion Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> --------- Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

[ORB-673] Set default path for orb-agent.db (#2213)

Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

* add more changes on README * fix gh organization to orb-community

…errors like 429. (#2217) Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

… event status (#2218) * fix(maestro): remove only changing status in active. to go back from errors like 429. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(maestro): alternative fix to delete collectors and create collectors correctly. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> --------- Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> Co-authored-by: Everton H. Taques <97463920+etaques@users.noreply.github.com>

Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

…le/unknown to active (#2221) * fix(sinker): fix active sink not updating Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * Revert "fix(sinker): fix active sink not updating" This reverts commit 5470945. * fix(maestro): alternative fix on sink creation. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(maestro): updating timestamp. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> --------- Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> Co-authored-by: Everton H. Taques <97463920+etaques@users.noreply.github.com>

* fix active * disable go routines to test * Update streams.go * add logs

…erfering with status (#2224) * fix(maestro): ignore old messages, set as active. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(sinker): added different group for sinker when otel is enabled. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> * fix(sinker): added different group for sinker when otel is enabled. Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> --------- Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

* fix install kubectl * Update Makefile

Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

* Update monitor.go * Update kubecontrol.go * change to 10 minutes to be idle * set to change if idle be active if have activity * back to active after idle * Update kubecontrol.go * increase idle time to 15 minutes * fix idle * fix sinker activity * add changes * changes * add changes * add changes * add changes * add changes * add changes * add changes * add changes * add changes * add changes * add changes * add changes

manrodrigues

lgtm

This reverts commit 9e8bcba.

etaques and others added 30 commits January 23, 2023 15:45

[FIX] orb helm url (#2154)

6ec354a

[FIX] orb helm url (#2154)

[FIX] chart lock url on kind environment (#2156)

11d0736

[FIX] chart lock url on kind environment (#2156)

new status for policy with no tap match (#2155)

eb8fecd

[ORB-203] Enable sink status update by listening to otel-collector lo…

905127f

…gs. (#2135) [ORB-203] Enable sink status update by listening to otel-collector logs. (#2135)

[FIX] change organization to orb-community (#2157)

b45eb59

[FIX] change organization to orb-community (#2157)

feat(maestro): fix message with error in mid-sentence. (#2158)

cc40aa3

feat(maestro): fix message with error in mid-sentence. (#2158)

Remove otel collector health_check extension unused (#2159)

6de83b4

Remove otel collector health_check extension unused (#2159)

Removing logging extension on otel collector (#2160)

7d7ba81

Removing logging extension on otel collector (#2160)

[FIX] DeployCollector function (#2162)

04b4dde

[FIX] DeployCollector function (#2162)

Update README.md (#2161)

ec32e0e

* Update README.md

[FIX] adding ownerid on decode GRPC sinks response (#2163)

1d4645a

[FIX] refactoring maestro event sourcing for sink status (#2165)

60ce6ee

[FIX] refactoring maestro event sourcing for sink status (#2165)

Fix delete sinks on maestro (#2167)

bdcd3ee

Fix delete sinks on maestro (#2167)

[Feat] Remove otel collector when it is idle (#2168)

4ad0020

feat(maestro): update cache with creation of yaml. (#2169)

51688e9

Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

[FIX] maestro event sourcing to update otel collector (#2171)

f167e12

[FIX] maestro event sourcing to update otel collector (#2171)

increasing timeout for sink status because of otel (#2172)

4e272d0

feat(migrate): prevent previous migration from executing in migrate u…

944e778

…p/down. (#2174) Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

[FIX] do not skip when lastActivity not found on redis (#2175)

b89a4c6

* do not skip when lastactivity not found * [FIX] only check last activity after error * fix variables * fix variables --------- Co-authored-by: Luiz Henrique Pegoraro <luiz.pegoraro@encora.com>

fix(maestro): added fine tuning to maestro. (#2179)

d4ceb60

Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

lpegoraro and others added 23 commits February 13, 2023 14:44

Revert "fix(redis): add debug logs" (#2205)

6caf604

* Revert "fix(redis): add debug logs" This reverts commit 44f4b98. * fix(redis): re-add fix on iteration Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com> --------- Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

fix(maestro): fix acking messages on error. (#2207)

3250807

Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

add prepare-helm first on run (#2209)

8c219aa

fix(maestro): new configuration handling and creation on kubernetes. (#…

23e20ad

…2211) Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

fix(maestro): remove idle validations. (#2214)

c3ddae2

Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

[ORB-673] Set default path for orb-agent.db (#2213)

97432f8

[ORB-673] Set default path for orb-agent.db (#2213)

WIP: hotfix general css and dataset list table spacings (#2208)

1acfbee

fix(maestro): rollback to complete deployment json (#2216)

c2472a1

Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

[ORB-669] - Add more changes on README (#2215)

cd9d256

* add more changes on README * fix gh organization to orb-community

fix(maestro): remove only changing status in active. to go back from …

0a1ce7b

…errors like 429. (#2217) Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

rollback the changes on db file (#2219)

cf0df09

fix(sinker): fix active sink not updating (#2220)

3b72413

Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

[FIX] set last activity on redis if sink already is active (#2222)

ac75feb

* fix active * disable go routines to test * Update streams.go * add logs

fix(sinker): don't fetch logs older than 5 minutes. (#2225)

15fdf32

Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

fix install kubectl (#2226)

ce9fc45

* fix install kubectl * Update Makefile

fix(maestro): fix deletion. (#2227)

c420b53

Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

feat(maestro): fix subscription (#2229)

0adbec6

Signed-off-by: Luiz Pegoraro <luiz.pegoraro@encora.com>

etaques requested a review from manrodrigues February 20, 2023 13:46

increasing timeout for test sink status (#2233)

ece7c14

manrodrigues approved these changes Feb 20, 2023

View reviewed changes

etaques merged commit 9e8bcba into production Feb 20, 2023

etaques added a commit that referenced this pull request Feb 20, 2023

Revert "Add changes on production environment (#2232)"

d568238

This reverts commit 9e8bcba.

etaques mentioned this pull request Feb 20, 2023

Revert "Add changes on production environment" #2234

Merged

etaques added a commit that referenced this pull request Feb 20, 2023

Revert "Add changes on production environment (#2232)" (#2234)

f43f6e4

This reverts commit 9e8bcba.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add changes on production environment #2232

Add changes on production environment #2232

etaques commented Feb 20, 2023

manrodrigues left a comment

Add changes on production environment #2232

Add changes on production environment #2232

Conversation

etaques commented Feb 20, 2023

manrodrigues left a comment

Choose a reason for hiding this comment