Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

1 bit mask for Dropout #15968

Open
eric-haibin-lin opened this issue Aug 21, 2019 · 4 comments · May be fixed by #16735
Open

1 bit mask for Dropout #15968

eric-haibin-lin opened this issue Aug 21, 2019 · 4 comments · May be fixed by #16735
Labels
Feature request Operator

Comments

@eric-haibin-lin
Copy link
Member

Currently the mask generated by dropout op uses the same dtype and shape as the input. 1 bit per coordinate should be sufficient. Since dropout is heavily used after activations, this will save a lot of memory for training.

@ptrendx @DickJC123 @PatricZhao @TaoLv
@mxnet-label-bot
Copy link
Contributor

Hey, this is the MXNet Label Bot.
Thank you for submitting the issue! I will try and suggest some labels so that the appropriate MXNet community members can help resolve it.
Here are my recommended labels: Feature

@frankfliu
Copy link
Contributor

@mxnet-label-bot add [feature request, operator]

@eric-haibin-lin
Copy link
Member Author

@apeforest

@apeforest
Copy link
Contributor

Working on it now.

@apeforest apeforest mentioned this issue Oct 8, 2019
Closed
7 tasks
@apeforest apeforest linked a pull request Nov 6, 2019 that will close this issue
Open
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
Feature request Operator
Projects
None yet
Milestone
No milestone
5 participants
@eric-haibin-lin @apeforest @marcoabreu @frankfliu @mxnet-label-bot