Logbook

This page records a log of the team’s work, thinking, discussions, pains, joys, events, and experiences that happen on a daily basis. It’s supposed to be a kind of Stream of consciousness that can later be searched, analyzed, reviewed in more formal retrospectives.

Rules:

• Log days in reverse chronological order, recent first

• When the stream is getting too big, such that github refuses to render do the following:

  • extract biggest logical section (half-year or quarter) out of this into a correspondingly named Logbook-Year-Hn.md or Logbook-Year-Qn.md page
  • update links on top of this page to make it easier to navigate try to fix all links in the wiki at least
  • notify the team

• Move (and link) recurring sections to relevant dedicated pages.

History

• October 24
• September 24
• August 24
• July 24

2024-H1

• June 24
• May 2024
• April 2024
• March 2024
• February 2024
• January 2024

2023-H2

• December 2023
• November 2023
• October 2023
• September 2023
• August 2023
• July 2023

2023-H1

• June 2023
• May 2023
• April 2023
• March 2023
• February 2023
• January 2023

2022-H2

• December 2022
• November 2022
• October 2022
• September 2022
• August 2022
• July 2022

2022-H1

• June 2022
• May 2022
• April 2022
• March 2022

2021

• 2021

October 2024

2024-10-08

• Today, the team worked on:
  • Aggregator uses stored signing configurations when creating signed entity type #1961: the PR Feat: use stored signing configuration in aggregator when creating signed entity type #1988 has been created and is pending review. It will be merged shortly
  • Prepare new Pythagoras Mithril era #1946: we have kept working on the issue, and the draft PR Feat: implement era switch in e2e tests #1974
  • Refactor Certifier service to sign and send signatures in signer #1945: the PR Signer certifier service sign & send signatures #1979 has been reviewed and merged. The issue is closed
  • Make epoch non optional in RegisterSignerMessage #1956: the PR Make epoch mandatory in RegisterSignerMessage #1986 has been reviewed and merged. The issue is closed
  • Enhance readability of node logs #1981: we have started working on the issue and a draft PR will be created shortly
  • Make Cardano transactions stable in client #1952: we have started working on the issue and the draft PR Make Cardano transaction client stable #1989 has been created. It will be reviewed shortly
  • Feat: sign epoch in genesis certificate #1987: the PR has been reviewed and merged

2024-10-07

• The team has worked on these issues:
  • Aggregator uses stored signing configurations when creating signed entity type #1961: we have started pairing on the issue and the developments have been pushed to the ensemble/1961/use-stored-signing-config-in-aggregator branch. A PR will be created shortly
  • Prepare new Pythagoras Mithril era #1946: we have kept working on the issue, and the draft PR Feat: implement era switch in e2e tests #1974
  • Chore: decommission testing-mainnet network #1978: the PR has been reviewed and merged
  • Refactor Certifier service to sign and send signatures in signer #1945: the PR Signer certifier service sign & send signatures #1979 has been created and is pending review. It will be merged shortly
  • Make epoch non optional in RegisterSignerMessage #1956: the PR Make epoch mandatory in RegisterSignerMessage #1986 has been created and is pending review. It will be merged shortly
  • Configuration of block producer and relays is broken in infra #1984: the PR Fix: topology computation of the Cardano nodes of the signers in infra #1985 has been created, reviewed and merged. The issue is closed
  • Aggregator panics when handling discrepancies at startup in CI #1983: the bug issue has been created
  • Expose Prometheus metrics for aggregator #1980: the issue has been created and groomed
  • Enhance readability of node logs #1981: the issue has been created and groomed
  • Remove chain calls from register-signer route #1982]: the issue has been created and groomed

2024-10-04

• Today, we have worked on these issues:
  • Aggregator uses stored signing configurations when creating signed entity type #1961: we have started pairing on the issue and the developments have been pushed to the ensemble/1961/use-stored-signing-config-in-aggregator branch. A PR will be created shortly
  • Prepare new Pythagoras Mithril era #1946: we have kept working on the issue, and the draft PR Feat: implement era switch in e2e tests #1974
  • Chore: decommission testing-mainnet network #1978: We have decommissioned the testing-preview and the PR has been created and is pending review. It will be merged shortly
  • Additionally, we have rotated the KES keys for the release-preprod and testing-sanchonet networks

2024-10-03

• We have worked on these topics:
  • Release 2437 distribution #1901: following the activation the certification of the Cardano transactions on the release-mainnet network, the first associated certificates have been produced 🎉. The issue is closed
  • Signer computes what to sign on its own #1925]: the PRs Signer self compute signed entity #1970 and Deprecate certificate pending #1972 have been merged. The issue is closed
  • Upgrade to Cardano 9.2.1 #1968: the PR Feat: Support Cardano node 9.2.1 #1969 has been reviewed and merged. The issue is closed
  • Aggregator uses stored signing configurations when creating signed entity type #1961: we have started pairing on the issue and the developments have been pushed to the ensemble/1961/use-stored-signing-config-in-aggregator branch. A PR will be created shortly
  • Prepare new Pythagoras Mithril era #1946: we have kept working on the issue, and the draft PR Feat: implement era switch in e2e tests #1974 has been created and will be ready for review shortly
  • Handle signatures sent too late in the signer #1976: the bug issue has been created. The PR Fix signer stuck if signature already aggregated #1977 has been created, reviewed and merged. The issue is closed
  • Mithril explorer does not display properly on Chrome for Android phone #1944: after investigation this issue is not a bug. This issue is now closed
  • We have also prepared the sprint planning for the next iteration

2024-10-02

• The team has worked on these issues:
  • Release 2437 distribution #1901: we have activated the certification of the Cardano transactions on the release-mainnet network: the aggregator is finalizing its import sequence and should create pending certificates shortly. We expect to see the first certificates produced likely by tomorrow
  • Signer computes what to sign on its own #1925]: the PRs Signer self compute signed entity #1970 and Deprecate certificate pending #1972 have been reviewed and validated. They will be merged shortly
  • Upgrade to Cardano 9.2.1 #1968: We have worked on some flakiness in the CI. The PR Feat: Support Cardano node 9.2.1 #1969 has been reviewed. It will be merged shortly
  • Aggregator uses stored signing configurations when creating signed entity type #1961: we have started pairing on the issue and the developments have been pushed to the ensemble/1961/use-stored-signing-config-in-aggregator branch. A PR will be created shortly
  • Prepare new Pythagoras Mithril era #1946: we have kept working on the issue, and the draft PR Feat: implement era switch in e2e tests #1974 has been created and will be ready for review shortly
  • We have also held worked on the sprint planning for the next iteration

2024-10-01

• Today, the team worked on these topics:
  • Release 2437 distribution #1901: we have kept monitoring the adoption of the new signer version which is currently 66% of stake and we expect to activate the Cardano transactions by the end of the week
  • Aggregator advertises constant signing configurations for an epoch #1924: we have kept pairing on the issue. The PR Make aggregator advertises constant signing configurations for an epoch #1964 has been merged, but it created panics at startup of aggregators. The PR Fix: add migration to resolve deserialization issue with cardano_transactions_signing_config #1971 has been created, reviewed and merged to fix the problem. The testing-preview and testing-sanchonet are back up and have resumed producing certificates. The issue is closed
  • Signer computes what to sign on its own #1925]: the PRs Signer self compute signed entity #1970 and Deprecate certificate pending #1972 have been created and pending review. They will be merged shortly
  • Upgrade to Cardano 9.2.1 #1968: We have worked on some flakiness in the CI. The PR Feat: Support Cardano node 9.2.1 #1969 has been created and is pending review
  • Aggregator uses stored signing configurations when creating signed entity type #1961: we have started pairing on the issue and the developments have been pushed to the ensemble/1961/use-stored-signing-config-in-aggregator branch. A PR will be created shortly
  • Prepare new Pythagoras Mithril era #1946: we have kept working on the issue
  • We have also held our weekly Office Hours meeting on Discord

September 2024

2024-09-30

• Today, we have worked on these issues:
  • Release 2437 distribution #1901: we have kept monitoring the adoption of the new signer version which is currently 65% of stake
  • Aggregator advertises constant signing configurations for an epoch #1924: we have kept pairing on the issue. The PR Make aggregator advertises constant signing configurations for an epoch #1964 is being reviewed. It will be merged shortly
  • Signer computes what to sign on its own #1925]: we have kept working on the issue. The developments have been pushed to the ensemble/1925/signer_self_compute_signed_entity branch and a PR will be created shortly
  • Feat: sign protocol parameters and epoch in certificate #1954: the PR has been merged
  • Breaking change in crane fails Hydra CI #1928: the PR crane fix #1959 has been reviewed and merged. The issue is closed
  • Discrepancy of protocol parameters in epoch settings and pending certificates routes #1963: the bug issue has been created and groomed. The PR Fix: discrepancy protocol parameters #1967 has been created, reviewed and merged. The issue is closed
  • Upgrade to Cardano 9.2.1 #1968: the issue has been created and groomed. The PR Feat: Support Cardano node 9.2.1 #1969 has been created and is pending review
  • Refactor protocol parameters namings in signer/aggregator #1966: the issue has been created and groomed

2024-09-27

• Today, the team worked on these issues:
  • Release 2437 distribution #1901: we have kept monitoring the adoption of the new signer version which is currently 45% of stake
  • Aggregator advertises constant signing configurations for an epoch #1924: we have kept pairing on the issue. The draft PR Make aggregator advertises constant signing configurations for an epoch #1964 has been created and is pending review. It will be merged shortly
  • Signer computes what to sign on its own #1925]: we have kept working on the issue. The developments have been pushed to the ensemble/1925/signer_self_compute_signed_entity branch and a PR will be created shortly
  • Feat: sign protocol parameters and epoch in certificate #1954: the PR has been reviewed and is ready to be merged
  • Breaking change in crane fails Hydra CI #1928: the PR crane fix #1959 is pending review and will be merged shortly
  • Additionally, we have made sure that no test SPO needed to have their KES keys rotated

2024-09-26

• Today, the team worked on these issues:
  • Release 2437 distribution #1901: we have kept monitoring the adoption of the new signer version which is currently 45% of stake
  • Aggregator advertises constant signing configurations for an epoch #1924: we have kept pairing on the issue. The developments have been pushed to the ensemble/1924/store-signing-config branch. A new PR will be created shortly
  • Signer computes what to sign on its own #1925]: we have kept working on the issue. The developments have been pushed to the ensemble/1925/signer_self_compute_signed_entity branch and a PR will be created shortly
  • Feat: sign protocol parameters and epoch in certificate #1954: the PR is pending review and will be merged shortly
  • Breaking change in crane fails Hydra CI #1928: we have worked on the issue and the PR crane fix #1959 has been created and is pending review. It will be merged shortly. Also the PR Fix: hydra CI error when allow lint attribute specifies a reason #1960 has been created, reviewed and merged
  • Make epoch non optional in RegisterSignerMessage #1956: the issue has been created and groomed
  • Remove network field from CardanoDbBeacon #1957: the issue has been created and groomed
  • Remove beacon field in certificate #1958: the issue has been created and groomed

2024-09-25

• Today, we have worked on these topics:
  • Release 2437 distribution #1901: we have kept monitoring the adoption of the new signer version and created the PR Docs: dev blog posts for 2437 distribution #1953 which has been reviewed and merged
  • Aggregator advertises constant signing configurations for an epoch #1924: we have kept pairing on the issue. A new PR will be created shortly
  • Signer computes what to sign on its own #1925]: we have kept working on the issue. The developments have been pushed to the ensemble/1925/signer_self_compute_signed_entity branch
  • Refactor signable builder services to compute full protocol message in signer/aggregator #1941: the PR Refactor: signable builder services compute full protocol message #1942 has been merged. The issue is closed
  • Feat: sign protocol parameters in Genesis certificate #1950: the PR has been reviewed and merged
  • We have also presented updates of the Mithril protocol during the monthly review

2024-09-24

• The team worked on these topics:
  • Release 2437 distribution #1901: we have activated a new pace of signatures on the pre-release-preview network. We have also kept monitoring the adoption of the new signer version
  • Aggregator advertises constant signing configurations for an epoch #1924: we have kept pairing on the issue. The refactoring PR Standardize epoch settings naming #1949 has been reviewed and merged
  • Signer computes what to sign on its own #1925]: we have kept working on the issue. The developments have been pushed to the ensemble/1925/signer_self_compute_signed_entity branch
  • Refactor signable builder services to compute full protocol message in signer/aggregator #1941: the PR Refactor: signable builder services compute full protocol message #1942 has been reviewed and is ready to be merged
  • Prepare new Pythagoras Mithril era #1946: the PR Feat: create new 'Pythagoras' Mithril era #1948 has been reviewed and merged
  • Feat: sign protocol parameters in Genesis certificate #1950: the PR has been reviewed and merged
  • We have also prepared the demo path for the monthly review
  • Additionally, we have held our weekly Office Hours meeting on Discord

2024-09-23

• The team worked on these issues:
  • Release 2437 distribution #1901: we have released the ditribution 2437.1 🚀. We will monitoring the network and we will activate the Cardano transactions signature once enough signer run the latest version of the node
  • Aggregator advertises constant signing configurations for an epoch #1924: we have started pairing on the issue and the developments have been pushed to the ensemble/1924/store-ctx-signing-config-in-epoch-settings branch. We have also created the refactoring PR Standardize epoch settings naming #1949 which is pending review and will be merged shortly
  • Signer computes what to sign on its own #1925]: we have started working on the issue. A draft PR will be created shortly
  • Refactor signable builder services to compute full protocol message in signer/aggregator #1941: the PR Refactor: signable builder services compute full protocol message #1942 is pending review and will be merged shortly
  • Prepare new Pythagoras Mithril era #1946: the issue has been created and groomed. A first PR Feat: create new 'Pythagoras' Mithril era #1948 has been created and is pending review. It will be merged shortly. We will resume working on the issue
  • Refactor Certifier service to sign and send signatures in signer #1945: we have created and groomed the issue
  • Make Cardano transactions stable in client #1952: we have created and groomed the issue
  • Release 2440 distribution #1943: we have created and groomed the issue

2024-09-20

• We have worked on these subjects:
  • Release 2437 distribution #1901: we have kept monitoring the network and expect to release the 2437 distribution early next week
  • Retrieve custom signing configurations with epoch settings in signer #1923: the PR Retrieve custom signing configuration with epoch settings in Signer #1939 has been reviewed and merged. The issue is closed
  • Enhance mithril-common logging #1940: the PR has been created, reviewed and merged
  • Aggregator advertises constant signing configurations for an epoch #1924: we have started pairing on the issue and the developments have been pushed to the ensemble/1924/store-ctx-signing-config-in-epoch-settings branch
  • Signer computes what to sign on its own #1925]: we have started working on the issue. A draft PR will be created shortly
  • Refactor signable builder services to compute full protocol message in signer/aggregator #1941: the issue has been created and groomed. the draft PR Refactor: signable builder services compute full protocol message #1942 has been created
  • We have also made sure that no test SPO needed to have their KES keys rotated

2024-09-19

• We have worked on these subjects:
  • Release 2437 distribution #1901: the new 2437.1-pre pre-release distribution has been created and deployed on the pre-release-preview network. We will keep monitoring the network and expect to release the 2437 distribution early next week
  • Aggregator buffers signatures for unknown open message #1900: the PR Aggregator single signatures buffer #1934 has been reviewed and merged. The issue is closed
  • Refactor state machine of the signer #1922: the PR refactor signer state machine #1931 has been merged. The issue is closed
  • Retrieve custom signing configurations with epoch settings in signer #1923: the PR Retrieve custom signing configuration with epoch settings in Signer #1939 has been created and reviewed. Some modifications are being implemented before we can merged the PR
  • We have also worked on preparing the sprint planning for the next iteration

2024-09-18

• Today, we have worked on these issues:
  • Release 2437 distribution #1901: we have kept investigating the problem we have with the signature of the Cardano transactions in pre-release-preview. We have analyzed the logs and database extracts received from some SPOs and we have identified the origin of the problem. A detailed explanation is available at https://github.com/input-output-hk/mithril/issues/1938#issuecomment-2358850467. The fix PR Fix: data inconsistency in Cardano transactions stores #1936 has been reviewed and merged. We will create new pre-release 2437.1-pre shipping the fix tomorrow
  • Cardano transactions certification stopped in pre-release-preview #1938: the fix PR Fix: data inconsistency in Cardano transactions stores #1936 has been reviewed and merged. The issue is closed
  • Aggregator buffers signatures for unknown open message #1900: the PR Aggregator single signatures buffer #1934 has been updated with latest modification following the review. It will be merged shortly
  • Refactor state machine of the signer #1922: the PR refactor signer state machine #1931 is ready to be merged
  • Retrieve custom signing configurations with epoch settings in signer #1923: we have kept working on the issue and the developments have been pushed to the ensemble/1923/retrieve-custom-signing-config-with-epoch-settings branch. A new PR will be created shortly

2024-09-17

• We have worked on these topics:
  • Release 2437 distribution #1901: we have kept investigating the problem we have with the signature of the Cardano transactions in pre-release-preview. We have noticed in some SPOs database that there exists a discrepancy in the block range root computation. We will try to understand under which circumstances this can happen and create a fix
  • Aggregator buffers signatures for unknown open message #1900: the PR Aggregator single signatures buffer #1934 has been reviewed. The implementation was lacking some support for authenticated messages that come from a trusted source. We have re-designed the part which was the source of the problem and some modifications have been applied to the PR. It will be reviewed shortly
  • Refactor state machine of the signer #1922: the PR refactor signer state machine #1931 has been reviewed and validated. It will be merged shortly
  • Retrieve custom signing configurations with epoch settings in signer #1923: we have started working on the issue and we will create a PR shortly

2024-09-16

• Today, the team worked on:
  • Release 2437 distribution #1901: we have kept investigating the Cardano transactions not being consistently signed in the pre-release-preview network. We have not identified yet the source of the problem. We will keep investigating tomorrow and evaluate if we need to create a new pre-release to fix the problem
  • Aggregator buffers signatures for unknown open message #1900: the PR Aggregator single signatures buffer #1934 is being reviewed and will be merged shortly
  • Refactor state machine of the signer #1922: we have kept pairing on the issue and the PR refactor signer state machine #1931 has been updated and will be reviewed shortly
  • Test multiple signer versions in the e2e test #1935: the issue has been created and groomed

2024-09-13

• Today, we worked on these issues:
  • Release 2437 distribution #1901: we have decided to wait until almost all the signers run a version >0.2.170 before we can activate the certification of the Cardano stake distribution. We have also noticed that the signature of the Cardano transactions stopped working on pre-release-preview and we suspect that a state corruption may have happened between stable and unstable versions of the Cardano transactions. We will keep investigating and probably create a fix with a new pre-release distribution
  • Aggregator buffers signatures for unknown open message #1900: the PR Aggregator single signatures buffer #1934 has been created and is pending review
  • Refactor state machine of the signer #1922: we have kept pairing on the issue and the PR refactor signer state machine #1931 has been reviewed. The PR will be merged shortly
  • Enhance Cardano transaction prover benchmark #1933: the PR has been created, reviewed and merged
  • We have also checked if some of our test SPOs needed to have their KES keys rotated: this was not needed

2024-09-12

• Today, we have worked on these topics:
  • Release 2437 distribution #1901: we have released the 2437.0-pre which has been deployed to the pre-release-network. We have noticed some problem with the signers running the previous version of the signer when we have activated the certification of the Cardano stake distribution: the signers were crashing and restarted to register to the aggregator. We have deactivated the certification until we notice enough signers run the latest version in order to minimize the crashes on the signer. We have also identified where the problem lies in the code, and it is due to some todo!() which was shipped with previous versions. This is not something that will happen with the Cardano transactions once activated on the release-mainnet: outdated signers will just log an error when they see a pending certificate for a signed entity type they don't know yet. We will keep monitoring the deployment until we are ready to create the release distribution. It is expected to be the case early next week
  • Aggregator buffers signatures for unknown open message #1900: we have kept working on the issue and the developments have been pushed to the ensemble/1900/aggregator_signatures_buffer branch. A PR will be created shortly
  • Refactor state machine of the signer #1922: we have kept pairing on the issue and the draft PR refactor signer state machine #1931 has been updated is pending review: we have dealt with some flakiness in the end to end test in the CI. The PR will be merged shortly

2024-09-11

• Today, the team has worked on these topics:
  • Aggregator buffers signatures for unknown open message #1900: we have kept working on the issue and the developments have been pushed to the ensemble/1900/aggregator_signatures_buffer branch. A PR will be created shortly
  • Test Cardano transaction chain rollbacks #1840: we have been able to witness a successful rollback in extreme conditions on a modified e2e test. We will work in improving the testability of the feature in a near future. The issue is closed
  • Panic on rollback on slot number not recorded in the Cardano transactions store #1929: the PR Enhance Cardano transactions rollbacks #1917 has been reviewed and merged. The issue is closed
  • Release 2436 distribution #1901: we have prepared the preliminary PRs Update CHANGELOG for 2437.0 distribution release #1932 and Rotate documentation for 2437 distribution #1930. We expect to create the 2437.0-pre pre-release tomorrow
  • Refactor state machine of the signer #1922: we have kept pairing on the issue and the draft PR refactor signer state machine #1931 has been created and is pending review

2024-09-10

• Today, we have worked on these issues:
  • Signer retrieves registrations with epoch settings route #1897: the PR signer retrieves registrations with epoch settings route #1913 has been merged. The issue is closed
  • Aggregator buffers signatures for unknown open message #1900: we have kept working on the issue and the developments have been pushed to the ensemble/1900/aggregator_signatures_buffer branch. A PR will be created shortly
  • Test Cardano transaction chain rollbacks #1840: we have kept working on the issue and kept working on the PR Enhance Cardano transactions rollbacks #1917 which is pending review
  • Release 2436 distribution #1901: we will resume working on this issue when the issue #1840 is closed
  • Refactor state machine of the signer #1922: we have paired on the issue and the developments have been pushed to the ensemble/1922/refactor-signer-state-machine branch. A PR will be created shortly
  • Breaking change in crane fails Hydra CI #1928: the issue has been created
  • We have also held our weekly Office Hours meeting in Discord

2024-09-09

• We have worked on the following issues:
  • Signer retrieves registrations with epoch settings route #1897: we have kept working on the issue. The PR signer retrieves registrations with epoch settings route #1913 has been reviewed and it will be merged shortly
  • Aggregator buffers signatures for unknown open message #1900: we have kept working on the issue and the developments have been pushed to the ensemble/1900/aggregator_signatures_buffer branch. A PR will be created shortly
  • Test Cardano transaction chain rollbacks #1840: we have kept working on the issue and kept working on the PR Enhance Cardano transactions rollbacks #1917 as we have noticed that some work is still needed to complete the fix
  • Release 2436 distribution #1901: the PR Update dependencies for release 2437 #1919 has been reviewed and merged. The PR Enhance upgrade dependency runbook #1926 has been created, reviewed and merged. We will keep working on this issue shortly
  • Make Cardano transactions preloading infinite in signer #1920: the PR Feat: add infinite Cardano transactions preloader in signer #1921 has been reviewed and merged. The issue is closed
  • Refactor state machine of the signer #1922: the issue has been created and groomed
  • Retrieve custom signing configurations with epoch settings in signer #1923: the issue has been created and groomed
  • Aggregator advertises constant signing configurations for an epoch #1924: the issue has been created and groomed
  • Signer computes what to sign on its own #1925: the issue has been created and groomed

2024-09-06

• The team has worked on these topics:
  • Signer retrieves registrations with epoch settings route #1897: we have kept working on the issue. The PR signer retrieves registrations with epoch settings route #1913 has been reviewed and is being updated. It will be merged shortly
  • Aggregator buffers signatures for unknown open message #1900: we have kept working on the issue and the developments have been pushed to the ensemble/1900/aggregator_signatures_buffer branch. A PR will be created shortly
  • Test Cardano transaction chain rollbacks #1840: we have kept working on the issue and created the PR Enhance Cardano transactions rollbacks #1917 is pending review and will be merged shortly
  • Release 2436 distribution #1901: the PR Add a script to update all dependencies #1916 has also been reviewed and merged. The PR Update dependencies for release 2437 #1919 has been created and is pending review
  • Make Cardano transactions preloading infinite in signer #1920: the issue has been created and groomed. The PR Feat: add infinite Cardano transactions preloader in signer #1921 has been created and is pending review
  • Fix clippy warnings from Rust 1.81 #1918: the PR has been created, reviewed and merged
  • We have updated the configuration of the signature of the Cardano transactions on the testing-preview networks to 0 blocks depth from the tip and with pace of a signature every 15 blocks
  • We have also relaunched the import of the Cardano transactions from scracth on the dev-mainnet network and the preloading took ~7h
  • Finally, we have rotated the KES keys of the SPOs we operate on the tesing-preview and pre-release-preview networks

2024-09-05

• We have worked on these topics:
  • Signer retrieves registrations with epoch settings route #1897: we have kept working on the issue. The PR signer retrieves registrations with epoch settings route #1913 is being reviewed. It will be merged shortly
  • Aggregator buffers signatures for unknown open message #1900: we have kept working on the issue and the developments have been pushed to the ensemble/1900/aggregator_signatures_buffer branch. A PR will be created shortly
  • Test Cardano transaction chain rollbacks #1840: we have kept working on the issue and created the draft PR Enhance Cardano transactions rollbacks #1917 which embeds a fix for some edge cases detected on the rollback handling. The PR will be merged shortly
  • Release 2436 distribution #1901: we kept working on the issue and the PR update dependencies for release 2436 #1915 has been updated as there is a breaking change on nix dependencies that we use. We have also noticed some problems in the deployment scenario of the Cardano transactions certification that could create delays in signature of other data. We are investigating the problem and we will adjust the plan or propose a fix shortly. In the mean time, the distribution will probably be postponed to 2437. The PR Add a script to update all dependencies #1916 has also been created and is pending review
  • We have also prepared the sprint planning for the next iteration

2024-09-04

• The team worked on these issues:
  • Follow-up Chang hard-fork #1910: the PR Chore: post Chang hard fork cleanup #1912 has been reviewed and merged. The issue is closed
  • Signer retrieves registrations with epoch settings route #1897: we have kept working on the issue. The PR signer retrieves registrations with epoch settings route #1913 is being reviewed. It will be merged shortly
  • Aggregator buffers signatures for unknown open message #1900: we have kept working on the issue and the developments have been pushed to the ensemble/1900/aggregator_signatures_buffer branch. A PR will be created shortly
  • Seamless transition of features from unstable to stable in client WASM #1911: the PR Refactor: seamless unstable to stable transition in WASM client #1914 has been reviwed and merged. This closes the issue
  • Test Cardano transaction chain rollbacks #1840: we have resumed our work on the issue and we have decided to create some test scenario on the devnet in order to witness a rollback as we haven't seen any in month on the mainnet test networks we run. We have achieved to witness a full rollback triggered on the devnet and we have discovered an edge cased which is not correctly handled: if the slot number on which the rollback is done is not registered in the Cardano transactions store (this happens if no transaction were recorded on the block), this creates a panic on the aggregator/signer. We will fix the problem and keep on investigating how rollbacks operate
  • Release 2436 distribution #1901: we have started working on the issue, and the PR update dependencies for release 2436 #1915 has been created and is pending review

2024-09-03

• Today, we have worked on these topics:
  • Follow-up Chang hard-fork #1910: we have prepared the upgrade of the Cardano nodes to 9.1.1 with the creation of the PR Chore: post Chang hard fork cleanup #1912 which is pending review. The PR also brings some cleanup on the CI and devnet code following the Chang hard-fork on the mainnet. It will be merged shortly
  • Signer retrieves registrations with epoch settings route #1897: we have kept working on the issue. The PR signer retrieves registrations with epoch settings route #1913 has been created and is pending review. It will be merged shortly
  • Aggregator buffers signatures for unknown open message #1900: we have kept working on the issue and the developments have been pushed to the ensemble/1900/aggregator_signatures_buffer branch. A PR will be created shortly
  • Cargo Deny complains about LGPL-3.0 licenses #1786: the PR feat: Make rug-backend optional for mithril-client crate #1884 has been merged. This closes the issue
  • Seamless transition of features from unstable to stable in client WASM #1911: the issue has been created and groomed. The draft PR Refactor: seamless unstable to stable transition in WASM client #1914 has been created and is pending review. It will be merged shortly
  • CIP-???? | Decentralized Message Queue #876: we have kept answering the comments received during the review process and we have updated the CIP accordingly. We have also attended the CIP review meeting of the week
  • Finally, we have attended the Mithril Office hours meeting on Discord

2024-09-02

• The team worked on these issues:
  • Follow-up Chang hard-fork #1910: the issue has been created and groomed. We have followed-up on the Chang hardfork problems with the ledger state computation: all the Cardano nodes we operate on the mainnet have been restarted to avoid the problem
  • Signer retrieves registrations with epoch settings route #1897: we have kept working on the issue. The developments have been pushed to the branch ensemble/1897/signer_retrieves_registrations_with_epoch_settings_route. A new PR will be created shortly
  • Add message signed in signature HTTP messages #1899: the PR Optional signed message in registered signatures #1909 has been reviewed and merged. The issue is closed
  • Aggregator buffers signatures for unknown open message #1900: we have started working on the issue and the developments have been pushed to the ensemble/1900/aggregator_signatures_buffer branch. A PR will be created shortly
  • Cargo Deny complains about LGPL-3.0 licenses #1786: the PR feat: Make rug-backend optional for mithril-client crate #1884 will be merged once the commits are signed
  • CIP-???? | Decentralized Message Queue #876: we have kept answering the comments received during the review process and we have updated the CIP accordingly

August 2024

2024-08-30

• We have worked on the following issues:
  • Signer retrieves registrations with epoch settings route #1897: we have kept working on the issue. The developments have been pushed to the branch ensemble/1897/signer_retrieves_registrations_with_epoch_settings_route. A new PR will be created shortly
  • Add message signed in signature HTTP messages #1899: the PR Optional signed message in registered signatures #1909 has been created and is pending review. It will be merged shortly
  • Cargo Deny complains about LGPL-3.0 licenses #1786: we have reviewed the PR feat: Make rug-backend optional for mithril-client crate #1884. It will be merged shortly
  • CIP-???? | Decentralized Message Queue #876: we have kept answering the comments received during the review process and we will keep updating the CIP shortly
  • We have also scaffold a repository for the Mithril technical working group: https://github.com/cardano-scaling/wg-mithril
  • Finally, we have check that no test SPOs needed to have their KES keys rotated

2024-08-29

• Today, the team worked on the following issues:
  • Optimize memory usage of signer for Cardano transactions #1903: the PR Optimize memory usage of signer for Cardano transactions #1904 has been reviewed and merged. Als the PR docs: update signer footprint in SPO setup guide #1907 has been created, reviewed and merged. The issue is closed
  • Signer retrieves registrations with epoch settings route #1897: we have kept working on the issue. The developments have been pushed to the branch ensemble/1897/signer_retrieves_registrations_with_epoch_settings_route. A new PR will be created shortly
  • Aggregator exposes Cardano transactions signing configuration #1898: the PR Add Cardano transactions signing configuration in Aggregator '/' route #1905 has been created, reviewed and merged. The issue is closed
  • Reorganize signer dependencies #1906: the issue has been created and groomed. We have created, reviewed and merged the PR Reorganize signer dependencies #1908. The issue is closed
  • Add message signed in signature HTTP messages #1899: we have started working on the issue. A PR will be created shortly
  • Cargo Deny complains about LGPL-3.0 licenses #1786: we have reviewed the PR feat: Make rug-backend optional for mithril-client crate #1884. It will be merged shortly
  • CIP-???? | Decentralized Message Queue #876: we have kept answering the comments received during the review process and we will keep updating the CIP shortly

2024-08-28

• Today, we have worked on the following topics:
  • Mithril signature diffusion with Cardano network layer PoC #1837: the draft prototype PR POC - Mithril signature diffusion with a "fake Cardano network layer" #1902 has been reviewed. The issue is closed
  • Optimize memory usage of signer for Cardano transactions #1903: the PR Optimize memory usage of signer for Cardano transactions #1904 has been reviewed and it will be merged shortly
  • Signer retrieves registrations with epoch settings route #1897: we have kept working on the issue. A new PR will be created shortly
  • Aggregator exposes Cardano transactions signing configuration #1898: we have kept working on the issue. The developments have been pushed to the djo/1898/aggregator_root_route-cardano_transactions_signing_config branch. A PR will be created shortly
  • Finally, we have held our Monthly Review meeting

2024-08-27

• We have worked on the following issues:
  • Mithril signature diffusion with Cardano network layer PoC #1837: the draft prototype PR POC - Mithril signature diffusion with a "fake Cardano network layer" #1902 has been created and is pending review
  • Optimize memory usage of signer for Cardano transactions #1903: the issue has been created and groomed. We have also created the draft PR Optimize memory usage of signer for Cardano transactions #1904 which is pending review
  • Signer retrieves registrations with epoch settings route #1897: we have kept working on the issue. A new PR will be created shortly
  • Aggregator exposes Cardano transactions signing configuration #1898: we have started to work on the issue. A new PR will be created shortly
  • Finally, we have held our weekly Office Hours meeting on Discord

2024-08-26

• Today, the team has worked on the following issues:
  • Mithril signature diffusion with Cardano network layer PoC #1837: we have kept working on the implementation of the fake cardano network layer and developments have been pushed to the djo/1837/POC/multisig_diffusion_network_layer branch
  • Cardano stake distribution is not signed on the correct epoch #1895: the PR Fix: Cardano stake distribution certification epoch discrepancy #1896 has been reviewed and merged, which closes the issue
  • Signer retrieves registrations with epoch settings route #1897: we have created and groomed the issue. We have also started working on the issue
  • Aggregator exposes Cardano transactions signing configuration #1898: the issue has been created and groomed
  • Add message signed in signature HTTP messages #1899: the issue has been created and groomed
  • Aggregator buffers signatures for unknown open message #1900: the issue has been created and groomed
  • Release 2436 distribution #1901: the issue has been created and groomed
  • We have also worked on preparing the demo for the next monthly review meeting
  • Finally, we have experimented on different strategies to minimize the memory usage of the signer when signing the Cardano transactions

2024-08-23

• Today, we have worked on the following topics:
  • Mithril signature diffusion with Cardano network layer PoC #1837: we have kept working on the implementation of the fake cardano network layer and developments will be pushed to a new branch shortly
  • Create repository dependencies upgrade runbook #1813: the PR Create repository dependencies upgrade runbook #1893 has been merged. The issue is closed
  • feat: support file:// URLs for snapshot locations #1885: the PR has been reviewed and merged
  • Cardano stake distribution is not signed on the correct epoch #1895: the bug issue has been created and the PR Fix: Cardano stake distribution certification epoch discrepancy #1896 has been created and is pending review. It will be merged shortly
  • We have also worked on preparing the demo for the next monthly review meeting
  • Finally, we have checked if some test SPOs needed their KES keys to be rotated, which was not the case

2024-08-22

• We have worked on the following topics:
  • Mithril signature diffusion with Cardano network layer PoC #1837: we are working on the implementation of the fake cardano network layer and developments will be pushed to a new branch shortly
  • Future proof options for mithril client #1878: the PR Add support for custom HTTP Headers in Mithril client WASM library #1890 has been reviewed and merged. The issue is closed
  • Document Cardano Stake Distribution #1844: the issue is closed
  • Create repository dependencies upgrade runbook #1813: the PR Create repository dependencies upgrade runbook #1893 has been reviewed and will be merged shortly
  • fix: macOS e2e local tests fails on M3 silicon processors #1767: the PR has been reviewed and merged
  • We have also prepared the sprint planning for the next iteration

2024-08-21

• Today, the team has worked on these topics:
  • Mithril signature diffusion with Cardano network layer PoC #1837: we've continued to work on the issue.
  • Future proof options for mithril client #1878: the PR Add support for custom HTTP Headers in Mithril client WASM library #1890 has been reviewed. It will be merged soon.
  • Document Cardano Stake Distribution #1844:
    • The PR Add missing Cardano stake distribution example in developer documentation #1891 has been reviewed and merged. The issue will be closed when the blog post will be published.
    • The draft PR Create dev blog post for certification of Cardano stake distribution #1892 has been created.
  • Create repository dependencies upgrade runbook #1813: the PR Create repository dependencies upgrade runbook #1893 has been created and is ready for review.

2024-08-20

• The team worked on these issues today:
  • Mithril signature diffusion with Cardano network layer PoC #1837: we've continued to work on the issue.
  • Future proof options for mithril client #1878: the PR Add support for custom HTTP Headers in Mithril client WASM library #1890 has been created and is ready for review.
  • Document Cardano Stake Distribution #1844: the PR Add missing Cardano stake distribution example in developer documentation #1891 has been created and is ready for review.

2024-08-19

• Today, we have worked on these topics:
  • Mithril signature diffusion with Cardano network layer PoC #1837: we have started working on the issue.
  • Future proof options for mithril client #1878: we keep working on the issue, and the developments have been pushed to the dlachaume/1878/mithril-client-future-proof-options branch.
  • Document Cardano Stake Distribution #1844: the PR Document Cardano Stake Distribution #1889 has been reviewed and merged. The issue will be closed when the blog post will be published.

2024-08-16

• The team worked on these issues today:
  • Future proof options for mithril client #1878: we have started working on the issue, and the developments have been pushed to the dlachaume/1878/mithril-client-future-proof-options branch.
  • Document Cardano Stake Distribution #1844: the PR Document Cardano Stake Distribution #1889 is pending review.

2024-08-14

• We have worked on these topics today:
  • Implement Cardano Stake Distribution in WASM client #1881: the PR Implement Cardano stake distribution in mithril-client WASM #1887 has been reviewed and merged. The issue is closed.
  • Update explorer for Cardano Stake Distribution #1843: the PR Add new tab Cardano Stake Distribution in the explorer #1888 has been reviewed and merged. The issue is closed.
  • Document Cardano Stake Distribution #1844: the PR Document Cardano Stake Distribution #1889 has been created and is ready for review.

2024-08-13

• Today, the team worked on these issues:
  • Implement Cardano Stake Distribution in WASM client #1881: the PR Implement Cardano stake distribution in mithril-client WASM #1887 is pending review.
  • Update explorer for Cardano Stake Distribution #1843: the PR Add new tab Cardano Stake Distribution in the explorer #1888 has been created and is ready for review.

2024-08-12

• Today we have worked on these topics:
  • Implement Cardano Stake Distribution in client CLI #1880: the PR Implement Cardano stake distribution commands in mithril-client CLI #1883 has been updated, reviewed and merged. The issue is closed.
  • Implement Cardano Stake Distribution in WASM client #1881: the PR Implement Cardano stake distribution in mithril-client WASM #1887 has been created updated and is ready for review.

2024-08-09

• The team worked on these issues today:
  • Implement Cardano Stake Distribution in WASM client #1881: the draft PR Implement Cardano stake distribution in mithril-client WASM #1887 has been created to verify the Mithril Client multi-platform test with the new features. The work is still in progress.
  • Implement Cardano Stake Distribution in client CLI #1880: the PR Implement Cardano stake distribution commands in mithril-client CLI #1883 is pending review.

2024-08-08

• We have worked on these topics:
  • Implement Cardano Stake Distribution in client CLI #1880: the PR Implement Cardano stake distribution commands in mithril-client CLI #1883 has been created and is pending review.
  • Implement Cardano Stake Distribution in WASM client #1881: we have started working on the issue, and the developments have been pushed to the dlachaume/1881/implement-cardano-stake-distribution-in-client-wasm branch.

2024-08-07

• Today, we have worked on these issues:
  • Implement Cardano Stake Distribution in client library #1842: the PR Implement Cardano stake distribution in mithril-client library #1882 has been merged. The issue is closed
  • Implement Cardano Stake Distribution in client CLI #1880: we have started working on the issue, and the developments have been pushed to the dlachaume/1880/implement-cardano-stake-distribution-in-client-cli branch.

2024-08-06

• Today, the team has worked on these topics:
  • Implement Cardano Stake Distribution in client library #1842: the PR Implement Cardano stake distribution in mithril-client library #1882 has been created and reviewed. It will be merged soon
  • CIP for Mithril signature diffusion through Cardano network #1775: the buffer PR on the Cardano Scaling CIPs fork Draft Cardano Decentralized Message Queue CIP #1 has been updated following the review comments. The draft CIP PR has been created on the CIPs repository CIP-???? | Decentralized Message Queue. The issue is closed

2024-08-05

• Today we have worked on these topics:
  • Test Cardano transaction chain rollbacks #184: We have kept monitoring the rollbacks, but we did not record one yet. We will try to make modifications on the pre-loader to import transactions along the way in a test branch and see if we notice some rollbacks
  • CIP for Mithril signature diffusion through Cardano network #1775: the buffer PR on the Cardano Scaling CIPs fork Draft Cardano Decentralized Message Queue CIP #1 is being reviewed. We will update it following some review comments. It will be converted as a PR on the CIP repository shortly
  • Implement routes for Cardano Stake Distribution in aggregator REST API #1841: the PR Implement Cardano stake distribution HTTP routes #1872 has been updated, reviewed and merged. The issue is closed
  • Future proof options for mithril client #1878: the issue has been created and groomed
  • We have also kept prototyping new Merkle tree data stores backends to minimize the memory usage on the SPO infrastructure

2024-08-02

• The team worked on these issues today:
  • Test Cardano transaction chain rollbacks #184: We have kept monitoring if a roll backward is recorded. If we don't see one, we will probably have to make modification on the pre-loader to import transactions along the way
  • dev-mainnet not signing Cardano transaction after full import #1875: the dev-mainnet has resumed producing certificates for the Cardano transaction consistently. We have also upgraded the dev-mainnet and testing-mainnet to Cardano node 9.1.0
  • CIP for Mithril signature diffusion through Cardano network #1775: we have created a buffer PR on the Cardano Scaling CIPs fork Draft Cardano Decentralized Message Queue CIP #1
  • Implement routes for Cardano Stake Distribution in aggregator REST API #1841: the PR Implement Cardano stake distribution HTTP routes #1872 has been updated and will be ready for final review shortly
  • We have also started prototyping new Merkle tree data stores backends to minimize the memory usage on the SPO infrastructure
  • Finally, we have checked that none of our test SPOs needed their KES keys to be rotated

2024-08-01

• We have worked on these topics today:
  • Test Cardano transaction chain rollbacks #184: the issue was blocked by issue #1875 which has been fixed. We have reset the dev-mainnet networks stores for the Cardano transactions. We'll keep monitoring if a roll back is recorded on the Mithril importers
  • dev-mainnet not signing Cardano transaction after full import #1875: the PR Fix: ChainReaderBlockStreamer skips RollForward blocks at the tip #1877 has been created, reviewed and merged
  • CIP for Mithril signature diffusion through Cardano network #1775: we are creating a new buffer PR on the Cardano Scaling repository on which we will ask for a first round of review from the contributors before we move forward to the CIPs repository PR creation
  • Implement routes for Cardano Stake Distribution in aggregator REST API #1841: the PR Implement Cardano stake distribution HTTP routes #1872 has updated and will be ready for final review shortly
  • Add a trend line showing long-term evolution of Cardano DB restorations #1876: the issue has been created and fixed. It is now closed

July 2024

2024-07-31

• We have worked on these issues:
  • Benchmark signer footprint on SPO infrastructure #1826: the PR Monitor Mithril nodes footprint and the PR Update Mithril signer footprint with Cardano transactions #1874 have been reviewed and merged. This closes the issue
  • Test Cardano transaction chain rollbacks #184: we are still trying to witness a rollback recorded by the Chain Reader. In the mean time, we have discovered a bug which occurs when the depth from the tip of the chain is 0 (see issue #1875). We will work on a fix shortly and keep trying to observe a rollback
  • dev-mainnet not signing Cardano transaction after full import #1875: the bug issue has been created and we have investigated the source of the problem. We will create a fix PR shortly
  • CIP for Mithril signature diffusion through Cardano network #1775: we are creating a new buffer PR on the Mithril repository on which we will ask for a first round of review from the contributors before we move forward to the CIPs repository PR creation
  • Make SignedEntityType in RegisterSignatureMessage non optional #1863: the PR Make signed_entity_type non optional in RegisterSignatureMessage #1870 has been merged, the issue is closed
  • Implement routes for Cardano Stake Distribution in aggregator REST API #1841: the PR Implement Cardano stake distribution HTTP routes #1872 has been created and is pending review. It will be merged shortly
  • Duplicate page on /index.html of website #1867: the PR Add a redirection on index.html to clean url #1869 has been reviewed and merged. The issue is closed

2024-07-30

• Today, the team has worked on these topics:
  • Release 2430 distribution #1830: we have released the 2430.0 distribution which has been deployed on the release-mainnet and release-preprod networks. The Cardano transaction certification has been activated on the release-preprod network and has started to produce its first certificates for this type of data. The issue is closed
  • Benchmark signer footprint on SPO infrastructure #1826: we have kept working on the issue and the PR Monitor Mithril nodes footprint has been created and is pending review. It will be merged shortly
  • Test Cardano transaction chain rollbacks #184: we have hard times witnessing a rollback which is probably due to the fact that we don't constantly scan the chain: the few rollbacks on the Cardano chain are 1 block long so this is transparent for the Mithirl nodes. We will try another attempt shortly
  • CIP for Mithril signature diffusion through Cardano network #1775: we have kept working on the draft branch on a fork jpraynaud:CIPs:cip-decentralized-message-queue. Once it is ready, we will create a draft PR on the CIPs repository
  • Make SignedEntityType in RegisterSignatureMessage non optional #1863: the PR Make signed_entity_type non optional in RegisterSignatureMessage #1870 has been created and is pending review. It will be merged shortly
  • Implement routes for Cardano Stake Distribution in aggregator REST API #1841: we have started to work on the issue and we have pushed the first developments on the dlachaume/1841/implement-cardano-stake-distribution-routes branch. A PR will be created shortly
  • Duplicate page on /index.html of website #1867: we have created and groomed the issue. The draft PR Add a redirection on index.html to clean url #1869 has been created and is pending review
  • We have also held our weekly office hours meeting on Discord

2024-07-29

• Today, the team has worked on these topics:
  • Release 2430 distribution #1830: the pre-release is working correctly and we will release it shortly
  • Implement signable and artifacts builders for Cardano Stake Distribution #1832: we have kept pairing on the PR Implement signable and artifact builders for Cardano Stake Distribution #1847 which has been reviewed and merged. The issue is closed
  • Benchmark signer footprint on SPO infrastructure #1826: we have kept working on the issue, and the developments have been pushed to the jpraynaud/1826-mithril-nodes-footprint branch. A PR will be created shortly
  • Test Cardano transaction chain rollbacks #184: we are still monitoring the dev-mainnet network and we will complete the test shortly
  • CIP for Mithril signature diffusion through Cardano network #1775: we have started creating a draft branch on a fork jpraynaud:CIPs:cip-decentralized-message-queue. Once it is ready, we will create a draft PR on the CIPs repository
  • Make SignedEntityType in RegisterSignatureMessage non optional #1863: the issue has been created and groomed
  • Typos in repository #1862: the issue has been created and groomed. The PR Fix typos #1865 has been created, reviewed and merged

2024-07-26

• Today, the team has worked on these topics:
  • Release 2430 distribution #1830: the issue has been groomed. We have created the 2430.0-pre pre-release distribution. It has been deployed on the pre-release-preview network on which we have activated the certification of Cardano transaction and deployed Cardano node 9.1.0. We expect to have the first certificate created for this new type of data in a few days once enough SPOs have upgraded their Mithril signer node. The release is expected for early next week. The following PRs have been created, reviewed and merged: Upgrade Rust dependencies #1858, Upgrade release-mainnet aggregator VM data disk #1859 and Update CHANGELOG for 2430 distribution release #1860
  • Implement signable and artifacts builders for Cardano Stake Distribution #1832: we have kept pairing on the PR Implement signable and artifact builders for Cardano Stake Distribution #1847 to fix some problem due to offset needed to sign correctly the Cardano stake distribution. It will be merged shortly
  • Refactor SlotNumber type #1851: the PR Replace SlotNumber alias with dedicated structure #1854 has been reviewed and merged. The issue is closed
  • Slow import of Cardano transactions in testing-mainnet #1849: The issue is closed
  • Benchmark signer footprint on SPO infrastructure #1826: we have started working on the issue, and the first developments have been pushed to the jpraynaud/1826-mithril-nodes-footprint branch. A PR will be created shortly
  • Test Cardano transaction chain rollbacks #184: we are still monitoring the dev-mainnet network and we will complete the test shortly
  • Upgrade Cardano node 9.1.0 #1855: the deployment of Cardano node 9.1.0 on thetesting-preview and testing-sanchonet has worked successfully. The issue is closed
  • CIP for Mithril signature diffusion through Cardano network #1775: we will a draft branch before we create a draft PR on the CIP repository
  • Finally, we have checked that none of our test SPOs needed KES key rotation

2024-07-25

• Today, the team has worked on these topics:
  • Implement signable and artifacts builders for Cardano Stake Distribution #1832: the PR Implement signable and artifact builders for Cardano Stake Distribution #1847 is being updated before final review. It will be merged shortly
  • Refactor SlotNumber type #1851: the PR Replace SlotNumber alias with dedicated structure #1854 has been created and is pending review. It will be merged shortly
  • Slow import of Cardano transactions in testing-mainnet #1849: We have made another test of disk upgrade on the testing-mainnet network and have prepared the upgrade process
  • Test Cardano transaction chain rollbacks #184: we have decided to run the test on the dev-mainnet network where a rollback is more likely to occur. We are monitoring and will complete the test shortly
  • Upgrade Cardano node 9.1.0 #1855: the issue has been created and groomed. We have paired on the issue and we have created the PR Support Cardano node 9.1.0 #1856 has been created, reviewed and merged
  • fix: clippy warnings with Rust 1.80.0 the PR has been created, reviewed and merged
  • CIP for Mithril signature diffusion through Cardano network #1775: we will a draft branch before we create d draft PR on the CIP repository
  • Finally, we have prepared the sprint planning for the next iteration

2024-07-24

• Today, we have worked on these issues:
  • Implement signable and artifacts builders for Cardano Stake Distribution #1832: the PR Implement signable and artifact builders for Cardano Stake Distribution #1847 is being updated before we can merge it. We have investigated the source of some flakiness in the CI and we have worked in a fix that should be merged shortly
  • Refactor SlotNumber type #1851: the issue has been created and we have started pairing on it. A PR will be created shortly
  • ChainReader is stuck in Agency is theirs error #1836: the PR fix: ChainReader fails on find_intersect_point without agency #1852 has been reviewed and merged, which closes the issue
  • Slow import of Cardano transactions in testing-mainnet #1849: the PR Upgrade infrastructure deployment with disk configurations #1850 as been updated as we have noticed some problem during a test upgrade on testing-mainnet. We will make another test shortly and complete the upgrade process
  • Test Cardano transaction chain rollbacks #184: we are still waiting for a rollback to happen in the testing-preview. We will likely make the test on the dev-mainnet network where the probability of having a fork is higher
  • CIP for Mithril signature diffusion through Cardano network #1775: we have kept working on the redaction of the draft CIP

2024-07-23

• We have worked on these topics:
  • Implement signable and artifacts builders for Cardano Stake Distribution #1832: the PR Implement signable and artifact builders for Cardano Stake Distribution #1847 has been created and is pending review. We are investigating some flakiness in the CI and we will merge the PR as soon as it is fixed
  • Refactor BlockNumber type #1755: the PR Replace BlockNumber alias with dedicated structure #1846 has been updated and merged. The issue is closed
  • Refactor SlotNumber type #1851: the issue has been created and we have started pairing on it. A PR will be created shortly
  • ChainReader is stuck in Agency is theirs error #1836: the PR fix: ChainReader fails on find_intersect_point without agency #1852 has been created and is pending review. It will be merged shortly
  • Slow import of Cardano transactions in testing-mainnet #1849: we have created the PR Upgrade infrastructure deployment with disk configurations #1850 which extends the configuration of the disks in the terraform deployments. We have also bootstrapped a new dev-mainnet network to properly test the upgrade pbefore activating it in production
  • fix: Resource not Reset when given back to Pool #1848: the PR has been reviewed and merged
  • Test Cardano transaction chain rollbacks #184: we have started working on the issue and we should have results shortly
  • CIP for Mithril signature diffusion through Cardano network #1775: we have kept working on the redaction of the draft CIP
  • Finally, we have held our weekly Office hours meeting in Discord

2024-07-22

• We have worked on these topics:
  • Implement signable and artifacts builders for Cardano Stake Distribution #1832: the PR Implement signable and artifact builders for Cardano Stake Distribution #1847 has been created and is pending review. It will be merged shortly
  • Refactor BlockNumber and SlotNumber types #1755: the PR Replace BlockNumber alias with dedicated structure #1846 has been created and is being reviewed. It will be merged shortly
  • testing-sanchonet does not sign Cardano transactions #1845: we have investigated the problem and we have found that it is happening only on testing-sanchonet network. We have completed the issue with some explanation and we will optimize the chunk importer of the signer which is responsible for this problem in a separate issue. This issue is closed
  • CIP for Mithril signature diffusion through Cardano network #1775: we have kept working on the redaction of the draft CIP
  • ChainReader is stuck in Agency is theirs error #1836: we have started investigating the problem in the chain reader
  • Slow import of Cardano transactions in testing-mainnet #1849: the issue has been created and investigated. We will keep working on it to upgrade the disks of the VMs
  • fix: Resource not Reset when given back to Pool #1848: the PR has been created and is pending review. It will be merged shortly
  • Finally, we have worked on the demo path for the monthly review meeting

2024-07-19

• The team has worked on these issues:
  • Implement signable and artifacts builders for Cardano Stake Distribution #1832: we have kept pairing on the issue and developments have been pushed to the dlachaume/1832/implement-signable-artifact-builders-for-cardano-stake-distribution branch. A PR will be created shortly
  • Refactor BlockNumber and SlotNumber types #1755: we have kept working on the issue. The developments ahve been published to the ensemble/1755/block_slot_number_type branch and a PR will be created shortly
  • testing-mainnet and testing-sanchonet do not sign Cardano transactions #1845: the bug issue has been created and is being investigated
  • CIP for Mithril signature diffusion through Cardano network #1775: we have kept working on the redaction of the draft CIP
  • ChainReader is stuck in Agency is theirs error #1836: we are still investigating the bug
  • We have also proceeded to the rotation of the KES keys of the test SPO running in the release-preprod network
  • Finally, we have worked on the demo path for the monthly review meeting

2024-07-18

• We have worked on these issues:
  • Upgrade testing-sanchonet for respin with Cardano 9.0.0 #1822: the genesis certificate has been created and the network has resumed producing certificates. The issue is closed
  • Implement signable and artifacts builders for Cardano Stake Distribution #1832: we have kept working on the issue and developments have been pushed to the dlachaume/1832/implement-signable-artifact-builders-for-cardano-stake-distribution branch. A PR will be created shortly
  • Refactor BlockNumber and SlotNumber types #1755: we have started working on the issue and a PR will be created shortly
  • Make Certificate messages beacon field optional #1807: the PR Make deprecated beacon field optional in Certificate & CertificateList messages #1839 has been reviewed and merged. The issue is closed
  • CIP for Mithril signature diffusion through Cardano network #1775: we have kept working on the redaction of the draft CIP
  • ChainReader is stuck in Agency is theirs error #1836: we are still investigating the bug
  • Test Cardano transaction chain rollbacks #1840: the issue has been created and groomed
  • Cardano Stake Distribution Certification #955: the epic has been sliced and groomed
    • Implement routes for Cardano Stake Distribution in aggregator REST API #1841: the issue has been created and groomed
    • Implement sub-commands for Cardano Stake Distribution in client #1842: the issue has been created and groomed
    • Update explorer for Cardano Stake Distribution #1843: the issue has been created and groomed
    • Document Cardano Stake Distribution #1844: the issue has been created and groomed

2024-07-17

• Today, the team worked on these topics:
  • Cleanup Immutable File in Cardano transaction #1825: the PR cleanup immutable file in cardano transation #1838 has been created, reviewed and merged. The issue is closed
  • Upgrade testing-sanchonet for respin with Cardano 9.0.0 #1822: the test SPO has successfully registered to the protocol and we should be able to create a genesis certificate tomorrow
  • CIP for Mithril signature diffusion through Cardano network #1775: we have kept working on the redaction of the draft CIP
  • Implement signable and artifacts builders for Cardano Stake Distribution #1832: we have kept working on the issue and developments have been pushed to the dlachaume/1832/implement-signable-artifact-builders-for-cardano-stake-distribution branch. A PR will be created shortly
  • A recorded but non certified Cardano transaction creates an error in prover #1819: the issue has been fixed and closed
  • Make Certificate messages beacon field optional #1807: we have paired on the issue and the PR Make deprecated beacon field optional in Certificate & CertificateList messages #1839 has been created and is pending review
  • ChainReader is stuck in Agency is theirs error #1836: we are still investigating the bug
  • Mithril signature diffusion with Cardano network layer PoC #1837: the epic has been created and groomed

2024-07-16

• Today, the team has worked on these issues:
  • Cardano transaction importer does not import the last block advertised as certified #1785: the PR Bugfix: Block range computation ignored last block range & last block range if it finished with empty blocks #1820 has been reviewed and merged, and the PR Make upper bound of ChainReaderBlockStreamer inclusive #1835 has been created, reviewed and merged. The issue is closed
  • Non blocking artifact production in aggregator #1792: the PR non blocking artifact production in aggregator #1828 has been reviewed and merged. This closes the issue
  • Upgrade testing-sanchonet for respin with Cardano 9.0.0 #1822: the testing-sanchonet has been respun, era markers have been set in the chain and the test SPO has been created. We need to wait for few epochs before the network resumes signing
  • Document Prometheus metrics and Grafana Dahsboard for signer #1834: the issue has been created and groomed. The PR Add metrics table in the "Activate Prometheus endpoint" section #1833 has been created, reviewed and merged, and it closes the issue
  • CIP for Mithril signature diffusion through Cardano network #1775: we have kept working on the redaction of the draft CIP
  • Implement signable and artifacts builders for Cardano Stake Distribution #1832: the issue has been created and groomed. We have started working on it and a draft PR will be created shortly
  • ChainReader is stuck in Agency is theirs error #1836: the bug issue has been created. A fix PR will created shortly
  • Release 2430 distribution #1830: the issue has been created and groomed
  • We have also held our weekly office hours meeting on discord

2024-07-15

• We have worked on these issues:
  • Release 2428 distribution #1810: the distribution 2428.0 has been released and deployed on the release-mainnet and release-preprod networks
  • Cardano transaction importer does not import the last block advertised as certified #1785: the PR Bugfix: Block range computation ignored last block range & last block range if it finished with empty blocks #1820 is being reviewed. It will be merged shortly
  • Non blocking artifact production in aggregator #1792: we have kept pairing on the issue and the PR non blocking artifact production in aggregator #1828 has been created and is pending review. It will be merged shortly
  • Upgrade testing-sanchonet for respin with Cardano 9.0.0 #1822: the PR Respin testing-sanchonet with Cardano 9.0.0 #1829 has been created, reviewed and merged. The testing-sanchonet network is being respun
  • CIP for Mithril signature diffusion through Cardano network #1775: we have kept working on the redaction of the draft CIP
  • Benchmark signer footprint on SPO infrastructure #1826: the issue has been created and groomed

2024-07-12

• Today the team worked on the following topics:
  • Release 2428 distribution #1810: we have created the PR Rotate documentation for 2423 distribution #1732. It will be merged with the expected release of the new distribution next week
  • Cardano transaction importer does not import the last block advertised as certified #1785: the PR Bugfix: Block range computation ignored last block range & last block range if it finished with empty blocks #1820 has been created and is pending review. It will be merged shortly
  • Non blocking artifact production in aggregator #1792: we have paired on the issue and the developments have been pushed to the ensemble/1792/non-blocking-artifact-production-in-aggregator branch. A PR will be created shortly
  • CIP for Mithril signature diffusion through Cardano network #1775: we have kept working on the redaction of the draft CIP
  • Calibrate Cardano transaction signature parameters #1814: the PR Configure Cardano transaction signing parameters with CI/CD #1815 has been reviewed and merged. The issue is closed
  • Signer make test command fails #1816: the bug issue has been created. The PR Fix Signer make test command errors #1817 has been created, reviewed and merged, which closes the issue
  • Finally, we have checked if some test SPOs needed to have their KES keys rotated, which was not the case

2024-07-11

• We have worked on the following issues:
  • Release 2428 distribution #1810: we have released the pre-release distribution 2428.0-pre which has been deployed to the pre-release-preview network
  • Cardano transaction importer does not import the last block advertised as certified #1785: we are still investigating the problem. A new PR will be created shortly
  • Non blocking artifact production in aggregator #1792: we have paired on the issue and the developments have been pushed to the ensemble/1792/non-blocking-artifact-production-in-aggregator branch. A PR will be created shortly
  • CIP for Mithril signature diffusion through Cardano network #1775: we have kept working on the redaction of the draft CIP
  • Calibrate Cardano transaction signature parameters #1814: the issue has been created and groomed. The PR Configure Cardano transaction signing parameters with CI/CD #1815 has been created and is pending review

2024-07-10

• Today, we have worked on these issues:
  • Release 2428 distribution #1810: we have prepared the new distrobution pre-release with the PRs Upgrade dependencies #1811 and Update CHANGELOG with 2428 distribution release #1812 which have been created, reviewed and merged. We have also prepared some warmup node for fast switch to Cardano 9.0.0 on the pre-release-preview, release-preprod and release-mainnet networks
  • CIP for Mithril signature diffusion through Cardano network #1775: we have kept working on the redaction of the draft CIP
  • Cardano transaction importer does not import the last block advertised as certified #1785: we are still investigating the problem. A new PR will be created shortly
  • Non blocking artifact production in aggregator #1792: we have paired on the issue and the developments have been pushed to the ensemble/1792/non-blocking-artifact-production-in-aggregator branch. A PR will be created shortly
  • Optimize Cardano transaction prover performances with parallelization #1756: the PR Parallelize Cardano Transaction prover #1781 has been closed as the performance were not improved by the parallelization. The issue is closed

2024-07-09

• Today, we worked on these issues:
  • Resource exhausted on Cardano node socket #1803: the bug is fixed and the issue is closed
  • Certificate pending route overwhelms the Cardano node in aggregator #1804: the PR Remove call to chain observer on pending certificate route #1808 has been created, reviewed and merged. The issue is closed
  • CIP for Mithril signature diffusion through Cardano network #1775: we have kept working on the redaction of the draft CIP
  • Cardano transaction importer does not import the last block advertised as certified #1785: we are still investigating the problem. A new PR will be created shortly
  • Upgrade Cardano node 9.0.0 #1787: the PR Refactor: Cardano node configuration in infra #1806 has been reviewed and merged. The PR Support Cardano node 9.0.0 #1809 has been created, reviewed and merged. The issue is closed
  • Non blocking artifact production in aggregator #1792: we have paired on the issue and the developments have been pushed to the ensemble/1792/non-blocking-artifact-production-in-aggregator branch. A PR will be created shortly
  • Release 2428 distribution #1810: the issue has been created and groomed

2024-07-08

• Today, the team has worked on the following topics:
  • Resource exhausted on Cardano node socket #1803: the bug is being fixed
  • Certificate pending route overwhelms the Cardano node in aggregator #1804: we have paired on the issue and the developments have been pushed to the ensemble/1804/remove_call_to_chain_observer_on_pending_certificate_route branch. A PR will be created shortly
  • CIP for Mithril signature diffusion through Cardano network #1775: we have kept working on the redaction of the draft CIP
  • Cardano transaction importer does not import the last block advertised as certified #1785: we have kept working on the issue has the problem is not completely fixed
  • Upgrade Cardano node 8.12.2 #1787: the PR Refactor: Cardano node configuration in infra #1806 has been created and is pending review. It will be merged shortly
  • Make Certificate messages beacon field optional #1807: the issue has been created and groomed
  • UpkeepService tests flakiness #1802: the PR has been created, reviewed and merged

2024-07-05

• Today, the team has worked on these issues:
  • Resource exhausted on Cardano node socket #1803: the bug issue has been created and investigated
  • Certificate pending route overwhelms the Cardano node in aggregator #1804: the issue has been created
  • CIP for Mithril signature diffusion through Cardano network #1775: we have kept working on the modeling of the network cost and the redaction of the n2n mini protocol in the draft CIP
  • Finally, we have checked if some test SPOs needed to have their KES keys rotated, which was not the case

2024-07-04

• Today, the team has worked on these issues:
  • Upgrade Cardano node 8.12.2 #1787: the PR Fix: Support Cardano 8.12 #1799 has been created, reviewed and merged. We now need to find a way to handle properly the mainnet configuration for 8.12 which is still labeled as pre-release in the Cardano books. We will create a PR shortly
  • Cardano transaction importer does not import the last block advertised as certified #1785: the PR Bugfix: Can't generate proof for transactions on the last signed block number #1795 has been reviewed and merged. We are monitoring the results on the test networks to make sure the problem is fixed
  • Aggregator/Signer preload transactions when Cardano transactions certification is not activated #1782: the PR Preload Cardano transactions based on Aggregator's Signing Capability #1796 has been reviewed and merged. The issue is closed
  • Lint Markdown/JavaScript files in repository #1754:the PR Standardize Javascript and Markdown code formatting #1783 has been reviwed and merged. The issue is closed
  • Optimize Cardano transaction prover performances with parallelization #1756: the draft PR has been updated and will be ready for review shortly
  • fix: macOS e2e local tests fails on M3 silicon processors #1767: the PR has been reviewed and needs to be updated to address the review comments

2024-07-03

• Today, we have worked on the following topics:
  • Upgrade Cardano node 8.12.2 #1787: we have discovered many problems with the activation of 8.12 and we have worked on it today. The testing-preview network is working but needs another fix on the used configurations. The testing-sanchonet network has been rolled back to 8.11.0-sancho
  • Cardano transactions import blocks aggregator and signer #1797: the bug issue has been created and the PR Fix: aggregator and signer blocked during Cardano transactions import #179 has been created, reviewed and merged. The issue is closed
  • Cardano transaction importer does not import the last block advertised as certified #1785: the PR Bugfix: Can't generate proof for transactions on the last signed block number #1795 has been created and is pending review. It will be merged shortly
  • Aggregator/Signer preload transactions when Cardano transactions certification is not activated #1782: the PR Preload Cardano transactions based on Aggregator's Signing Capability #1796 has been created and is pending review. It will be merged shortly
  • SQLite WAL files are not truncated in signer and aggregator #1707: the issue is closed
  • fix: macOS e2e local tests fails on M3 silicon processors #1767: the PR has been reviewed and needs to be updated to address the review comments
  • Lint Markdown/JavaScript files in repository #1754: we have created the draft PR Standardize Javascript and Markdown code formatting #1783. It will be merged shortly
  • Optimize Cardano transaction prover performances with parallelization #1756: the draft PR has been updated and will be ready for review shortly

2024-07-02

• Today, we have worked on the following issues:
  • Upgrade Cardano node 8.12.2 #1787: the PR Support Cardano node 8.12.2 #1788 has been reviewed and merged
  • SQLite WAL files are not truncated in signer and aggregator #1707: the PR Upkeep service for aggregator & signer #1791 has been reviewed and merged
  • Cardano signatures are not produced on testing-sanchonet #1750: the PR Fix sanchonet blocks parsing #1794 has been created, reviewed and merged. The testing-sanchonet has resumed certification of the Cardano transactions. The issue is closed
  • fix: macOS e2e local tests fails on M3 silicon processors #1767: the PR has been reviewed and needs to be updated to address the review comments
  • Lint Markdown/JavaScript files in repository #1754: we have created the draft PR Standardize Javascript and Markdown code formatting #1783. It will be merged shortly
  • Optimize Cardano transaction prover performances with parallelization #1756: the draft PR has been updated and will be ready for review shortly
  • Cardano transaction importer does not import the last block advertised as certified #1785: we have kept working on the issue and the developments have been pushed to the djo/1785/last_tx_not_proved branch
  • Aggregator/Signer preload transactions when Cardano transactions certification is not activated #1782: the issue has been groomed. We have started pairing on it. The developments have been pushed to the ensemble/1762/preload-cardano-ctx-when-ctx-not-activated branch. A PR will be created shortly
  • Additionally, we have held our weekly Office Hours meeting on Discord

2024-07-01

• Today, the team has worked on the following issues:
  • Upgrade Cardano node 8.12.1 #1787: the PR Support Cardano node 8.12.1 #1788 has been updated. It will be ready for review shortly
  • Conditional embedding of Cardano CLI in Docker images #1725: the PR Conditional embedding cardano cli in docker image #1789 has been reviewed and merged. The issue is closed
  • SQLite WAL files are not truncated in signer and aggregator #1707: we have created the PR Upkeep service for aggregator & signer #1791 which is pending review
  • Cardano signatures are not produced on testing-sanchonet #1750: the PR fix: fix CBOR decoding of Conway params update #473 has been created on pallas repository and will be merged shortly. When the 0.27.1 patched version is released, we will create a PR with the fix
  • fix: macOS e2e local tests fails on M3 silicon processors #1767: the PR has been reviewed and needs to be updated to address the review comments
  • Lint Markdown/JavaScript files in repository #1754: we have created the draft PR Standardize Javascript and Markdown code formatting #1783. It will be merged shortly
  • Fix aggregator Cardano transaction prover benchmark tool #1790: the PR has been merged
  • Optimize Cardano transaction prover performances with parallelization #1756: the draft PR has been updated and will be ready for review shortly
  • Non blocking artifact production in aggregator #1792: the issue has been created and groomed
  • Explorer does not handle invalid transaction hashes #1784: the issue has been groomed
  • Resource Pool acquire timeout when being updated #1793: the issue has been created and groomed