Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test_dsync: add test_expectfail.sh, test_existence.sh, and stubs for two other tests #596

Merged
merged 2 commits into from
Nov 12, 2024

Conversation

ofaaland
Copy link
Collaborator

@ofaaland ofaaland commented Nov 6, 2024

Add the following tests:

  • test_expectfail.sh: add tests for missing source or destination parent
  • test_existence.sh: verify set of files synced is correct

Add stubs for the following tests:

  • test_metadata.sh: verify metadata of synced files is correct
  • test_data.sh: verify data in synced files is correct

Add a small set of bash functions for performing set operations, for use with dsync tests.

Add a small test driver and two data files for testing the bash functions.

@ofaaland
Copy link
Collaborator Author

ofaaland commented Nov 6, 2024

@gonsie @carbonneau1 I intend this to be a template for other tests, so this is a good time to discuss or object to anything about how I implemented these tests - writing tests as shell scripts, the organization of the tests, the fact that they're single-node tests, etc. Thanks!

@ofaaland ofaaland requested a review from carbonneau1 November 6, 2024 02:17
@ofaaland
Copy link
Collaborator Author

ofaaland commented Nov 6, 2024

Hi @carbonneau1 please see the two new commits, running dsync under "mpirun", and copying a directory tree from /usr/include for use as test data.

@ofaaland ofaaland force-pushed the b-dsync-test-noopts-2 branch from bf5030b to 0421087 Compare November 6, 2024 02:46
@ofaaland ofaaland force-pushed the b-dsync-test-noopts-2 branch 6 times, most recently from 71b1c88 to 8e76635 Compare November 7, 2024 19:15
Copy link
Collaborator

@daltonbohning daltonbohning left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mostly a cursory overview. I think bash here is fine, since that's the easiest interface.

# - file with differing data is not copied if --contents arg is not used and metadata match
#
# Notes:
# - does not test whether data copes are spread across nodes/tasks evenly
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
# - does not test whether data copes are spread across nodes/tasks evenly
# - does not test whether data copies are spread across nodes/tasks evenly

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed

@ofaaland ofaaland force-pushed the b-dsync-test-noopts-2 branch from 8e76635 to 10d9b98 Compare November 12, 2024 23:55
Add a small set of bash functions for performing set operations,
for use with dsync tests.

Add a small test driver and two data files for testing the bash
functions.

Signed-off-by: Olaf Faaland <faaland1@llnl.gov>
Add the following tests:
	test_expectfail.sh: add tests for missing source or destination parent
	test_existence.sh: verify set of files synced is correct

Add stubs for the following tests:
	test_metadata.sh: verify metadata of synced files is correct
	test_data.sh: verify data in synced files is correct

Signed-off-by: Olaf Faaland <faaland1@llnl.gov>
@ofaaland ofaaland force-pushed the b-dsync-test-noopts-2 branch from 10d9b98 to 91611a2 Compare November 12, 2024 23:57
@ofaaland ofaaland merged commit 7d59002 into hpc:main Nov 12, 2024
@ofaaland ofaaland deleted the b-dsync-test-noopts-2 branch November 13, 2024 20:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants