Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merge upstream/release/2.6 into upstream/google/2.6 #15317

Merged
merged 28 commits into from
Oct 14, 2024
Merged

Merge upstream/release/2.6 into upstream/google/2.6 #15317

merged 28 commits into from
Oct 14, 2024

Conversation

techbasset
Copy link
Contributor

jgmoore-or and others added 27 commits October 1, 2024 14:18
@jgmoore-or
DAOS-16634 mercury: Update source build in release 2.6 with ucx patch. (
1044efa 
#15214)

Signed-off-by: Joseph Moore <joseph.moore@intel.com>
@phender
DAOS-16648 build: Tag 2.6.1 rc3 (#15226)
4cf4172 
Tag third release candidate for 2.6.1.

Signed-off-by: Phil Henderson <phillip.henderson@intel.com>
@gnailzenh @mchaarawi
DAOS-9355 doc: DAOS 2.6.1 release notes (#15235)
80a2e09 
2.6.1 release notes document

Signed-off-by: Liang Zhen <liang.zhen@intel.com>
Signed-off-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
Co-authored-by: Mohamad Chaarawi <mohamad.chaarawi@intel.com>
@jolivier23
DAOS-16445 client: Add function to cycle OIDs non-sequentially (#14999)…
70a7ea5 
… (#15117)

We've noticed that with sequential order, object placement is poor.

We get 40% fill for 8GiB files with 25 ranks and 16 targets per rank
with EC_2P1G8. With this patch, we get a much better distribution.

This patch adds the following:

1. A function for cycling oid.hi incrementing by a large prime
2. For DFS, randomize the starting value
3. Modify DFS to cycle OIDs using the new function.

Signed-off-by: Jeff Olivier <jeffolivier@google.com>
@phender
DAOS-16566 test: Update server/multiengine_persocket.py (#15127) (#15198
18b9138 
)

Update the server/multiengine_persocket.py test to use test harness
methods to ensure compatability with future test harness updates.  Also
add a test_mode option to allow verification of all but the PMem
reconfiguration in CI.

Signed-off-by: Phil Henderson <phillip.henderson@intel.com>
@phender
DAOS-16480 test: Increase expected range for dirty_pages metric (#15097…
16cc101 
…) (#15136)

Increase the upper expected bounds for the
engine_pool_checkpoint_dirty_pages_samples metric.

Signed-off-by: Phil Henderson <phillip.henderson@intel.com>
@daltonbohning
DAOS-16577 test: remove hw tag from deployment/disk_failure.py (#15138)…
9c8746e 
… (#15247)

Remove hw tag from deployment/disk_failure.py
since it is not expected to work in CI

Signed-off-by: Dalton Bohning <dalton.bohning@intel.com>
@daltonbohning
DAOS-15776 test: remove DataMoverTestBase.create_pool (#15079) (#15254)
b116591 
Replace DataMoverTestBase.create_pool with self.get_pool

Signed-off-by: Dalton Bohning <dalton.bohning@intel.com>
@daltonbohning
DAOS-16298 test: improve get_clush_command timeout (#15113) (#15252)
c05c486 
Make timeout in get_clush_command per host instead of for all hosts.

Signed-off-by: Dalton Bohning <dalton.bohning@intel.com>
@daltonbohning
DAOS-16550 test: use correct stonewall file with mdtest (#15109) (#15249
b3868b6 
)

Use a dynamic stonewall file with mdtest instead of hardcoded path.

Signed-off-by: Dalton Bohning <dalton.bohning@intel.com>
@daltonbohning
DAOS-16567 test: remove unused IorCommand.log_metrics (#15128) (#15246)
507e9e7 
Signed-off-by: Dalton Bohning <dalton.bohning@intel.com>
@daltonbohning
DAOS-623 test: Support running independent io sys admin steps (#15134) (
26f39c0 
#15248)

Support running independent io sys admin steps from the yaml.

Signed-off-by: Dalton Bohning <dalton.bohning@intel.com>
@mjean308
DAOS-16540 test: include extra yaml for soak md on ssd (#15104) (#15124)
1cb8101 
Signed-off-by: Maureen Jean <maureen.jean@intel.com>
@wiliamhuang
DAOS-16628 client: reset eq counter to zero after fork() in IL (#15187)…
3243349 
… (#15257)

Signed-off-by: Lei Huang <lei.huang@intel.com>
@tanabarr
DAOS-16482 control: Increase min hugepages for single tgt count (#15115…
6673515 
…) (#15259)

DMA buffer allocations may fail for single target count due to
insufficient hugepages available. Increase minimum number of hugepages
for single target count when in PMem mode.

Signed-off-by: Tom Nabarro <tom.nabarro@intel.com>
@daltonbohning
DAOS-15778 test: remove DataMoverTestBase.posix_local_test_paths (#14802
f65edd6 
) (#15262)

remove DataMoverTestBase.posix_local_test_paths in favor of local
references

Signed-off-by: Dalton Bohning <dalton.bohning@intel.com>
@tanabarr
DAOS-16487 control: Require hostname for nvme set-faulty & replace (#…
148267e 
…15074) (#15260)

Makes --host option mandatory for dmg storage set nvme-faulty, dmg
storage replace nvme and dmg telemetry metrics. These commands should
only be run on a single host which should be explicitly specified.

Also remove --no-reint flag from replace nvme command.

Signed-off-by: Tom Nabarro <tom.nabarro@intel.com>
@phender
DAOS-16027 test: Adding daos_test REBUILD31-34 subtests (#14584) (#15256
eb3b342 
)

Adding rebuild tests currently not executed by daos_test/rebuild.py.

Signed-off-by: Phil Henderson <phillip.henderson@intel.com>
@tanabarr
DAOS-16487 test: fix dmg c helper for set-faulty changes (#15151) (#1…
3ebf80f 
…5261)

Fix missing reference to --host in C test helper and update some doc
references.

Signed-off-by: Tom Nabarro <tom.nabarro@intel.com>
@daltonbohning
DAOS-16447 test: set D_IL_REPORT per test (#15012) (#15251)
a61ab80 
set D_IL_REPORT per test instead of setting defaults values in
utilities. This allows running without it set.

Signed-off-by: Dalton Bohning <dalton.bohning@intel.com>
@daltonbohning
DAOS-16548 test: add ftest lint check for invalid test_ tag (#15106) (#…
29cd12f 
…15285)

Check that test_ tags are only used specifically for the one method they
tag.

Signed-off-by: Dalton Bohning <dalton.bohning@intel.com>
@shimizukko
DAOS-16076 test: Automate dmg scale test to be run on Aurora (#14616) (…
6feb969 
…#15126)

Steps:
1. Format storages
2. System query
3. Create a 100% pool that spans all engines
4. Pool query
5. Pool destroy
6. Create 49 pools spanning all the engines with each pool using a 1/50th of the capacity
7. Pool list
8. Get around 80 pool metrics
9. Destroy all 49 pools
10. System stop
11. System start

Signed-off-by: Makito Kano <makito.kano@intel.com>
@daltonbohning
DAOS-16590 test: misc ftest/performance updates (#15144) (#15266)
2a021be 
- Add variants for mdtest with RP_3G1
- Update ec cell size to 1MiB for mdtest and ior easy

Signed-off-by: Dalton Bohning <dalton.bohning@intel.com>
@phender
DAOS-16589 test: Support Functional Hardware Medium VMD stage (#15166) (
a1c6beb 
#15295)

Add Build with parameters option to run the stage. Enable some basic
harness tests to run in the stage.

Enable a stage for functional tests that require VMD hardware.

Signed-off-by: Phil Henderson <phillip.henderson@intel.com>
@tanabarr
DAOS-16667 client: bump hadoop-common from 3.3.6 to 3.4.0 (#15194) (#…
daa77f4 
…15272)

Bumps org.apache.hadoop:hadoop-common from 3.3.6 to 3.4.0.

---
updated-dependencies:
- dependency-name: org.apache.hadoop:hadoop-common
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>
@daltonbohning
DAOS-16509 test: replace IorTestBase.execute_cmd with run_remote (#15070
d85eb82 
) (#15250)

replace usage of IorTestBase.execute_cmd with run_remote

Signed-off-by: Dalton Bohning <dalton.bohning@intel.com>
@techbasset
Merge remote-tracking branch 'origin/release/2.6' into ncmurphy/googl…
19136b1 
…e/2.6

Required-githooks: true
@github-actions GitHub Actions
Copy link

Errors are component not formatted correctly,Ticket number prefix incorrect,PR title is malformatted. See https://daosio.atlassian.net/wiki/spaces/DC/pages/11133911069/Commit+Comments,Unable to load ticket data
https://daosio.atlassian.net/browse/Merge

@techbasset
Merge upstream/release/2.6 into upstream/google/2.6
c62b057 
Allow-unstable-test: true

Required-githooks: true
@jolivier23 jolivier23 merged commit f9f9c18 into google/2.6 Oct 14, 2024
47 of 50 checks passed
@jolivier23 jolivier23 deleted the ncmurphy/google/2.6 branch October 14, 2024 22:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@cdavis28 cdavis28 cdavis28 approved these changes

Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.