Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue with Docker image from 21.4.414+ #1989

Closed
bdwyertech opened this issue May 13, 2021 · 5 comments
Closed

Issue with Docker image from 21.4.414+ #1989

bdwyertech opened this issue May 13, 2021 · 5 comments
Assignees
Labels
Aspect: Packaging Distribution of the projects 'compiled' artifacts. Platform: Docker Triage: Needs Information Indicates an issue needs more information in order to work on it. Type: Bug Does not work as expected.

Comments

@bdwyertech
Copy link

bdwyertech commented May 13, 2021

Description

From container version 4.14.14+, test-kitchen seems to be broken. When it does a cookbook synchronization to the remote (kitchen-ec2), all files in the cookbooks are empty/blank within the kitchen/cookbooks folder on the remote. I have done a diff on the two containers and cannot figure it out. system packages are identical and the diff between workstation 21.4.413 and 414 does not seem to reflect anything which would break this.

Works great on all images up to and including chef/chefworkstation:21.4.413, but its broken on chef/chefworkstation:21.4.414+

# 21.4.414
[ec2-user@ip-10-1-2-3 ~]$ cat ~/kitchen/cookbooks/test/metadata.rb
[ec2-user@ip-10-1-2-3 ~]$

# 21.4.413
[ec2-user@ip-10-1-2-3 ~]$ cat ~/kitchen/cookbooks/test/metadata.rb
name 'test'
version '0.0.1'
depends 'myorg_aws_chef_server_app'

depends 'hostsfile'
depends 'ssl_certificate'

Diff with packaged deps
image

A container diff shows some difference in sizes of some of the compiled libraries.

container-diff diff chef/chefworkstation:21.4.413 chef/chefworkstation:21.4.414 --type=file

Chef Workstation Version

chef/chefworkstation:21.4.414+

Platform Version

Docker (Mac Big Sur)

@bdwyertech bdwyertech added the Status: Untriaged An issue that has yet to be triaged. label May 13, 2021
@bdwyertech
Copy link
Author

bdwyertech commented May 14, 2021

this is quite strange... berks vendor from within the container also generates empty files -- the only non-empty file is metadata.json

image

@bdwyertech
Copy link
Author

bdwyertech commented May 14, 2021

The Berkshelf scratch directory looks good, it seems that the destination is what turns up empty. Quite strange. Stuck a couple sleep statements in, this is quite odd.

https://github.com/berkshelf/berkshelf/blob/6c7be8d7ff0a5f370490b47597e84ffbbaef3e88/lib/berkshelf/berksfile.rb#L688

This means that out of no where, this function is behaving differently... hmm...

https://github.com/berkshelf/berkshelf/blob/6c7be8d7ff0a5f370490b47597e84ffbbaef3e88/lib/berkshelf/file_syncer.rb#L56

It seems that FileUtils.cp is behaving erratically. Swapping to FileUtils.mv had the same effect. So strange...

@bdwyertech
Copy link
Author

bdwyertech commented May 14, 2021

Related: docker/for-linux#1015

Adding --mount type=tmpfs,destination=/tmp to my docker launch config made all of this go away... This is very strange, why would two images have two different results.

@skkprogress skkprogress added Type: Bug Does not work as expected. Platform: Docker Aspect: Packaging Distribution of the projects 'compiled' artifacts. and removed Status: Untriaged An issue that has yet to be triaged. labels Jun 17, 2021
@i5pranay93 i5pranay93 self-assigned this Jul 6, 2021
@vkarve-chef vkarve-chef added the Triage: Needs Information Indicates an issue needs more information in order to work on it. label Jul 30, 2021
@i5pranay93
Copy link
Contributor

i5pranay93 commented Aug 23, 2021

@bdwyertech hey, can you please send me some of the steps that results into this issue, I am not able to reproduce the same at my end.

@bdwyertech
Copy link
Author

Issue has been resolved about a month ago as per my account team. My pipes work fine now on latest images.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Aspect: Packaging Distribution of the projects 'compiled' artifacts. Platform: Docker Triage: Needs Information Indicates an issue needs more information in order to work on it. Type: Bug Does not work as expected.
Projects
None yet
Development

No branches or pull requests

4 participants