Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SentimentNet_XJY_ZJUT #63

Merged
merged 45 commits into from
Apr 7, 2021
Merged

SentimentNet_XJY_ZJUT #63

merged 45 commits into from
Apr 7, 2021

Conversation

JingyangXiang
Copy link
Contributor

SentimentNet 更新 参照来源-->mindspore
具体使用请查看sentimentnet.md

@leonwanghui
Copy link
Contributor

@zjuter0126 Could u add the download_dataset method for the LSTM dataset, or specify it in the document.

@JingyangXiang
Copy link
Contributor Author

JingyangXiang commented Apr 3, 2021

@zjuter0126 Could u add the download_dataset method for the LSTM dataset, or specify it in the document.

I have update the sentimentnet.md and upload glove_path.jpg and acllmdb_path.jpg to specify the way to download_dataset.

@leonwanghui
Copy link
Contributor

@zjuter0126 If so, I suggest you could add a new ***Dataset in data module, so that users could directly call this function in other network.

@JingyangXiang
Copy link
Contributor Author

@zjuter0126 If so, I suggest you could add a new ***Dataset in data module, so that users could directly call this function in other network.
I have add my imdb.py into tinyms/data file ,it can run in my enviroment.However, it show my pr failed,it can't pass the check.

@JingyangXiang
Copy link
Contributor Author

@zjuter0126 If so, I suggest you could add a new ***Dataset in data module, so that users could directly call this function in other network.
I have add my imdb.py into tinyms/data file ,it can run in my enviroment.However, it show my pr failed,it can't pass the check.

I find it lack of the lib gensim.I add it into the requriment.txt and it seems to work well.

@leonwanghui
Copy link
Contributor

@zjuter0126 Overall LGTM, but could u remove all the image files and correct some pylint warning? Thanks!

@JingyangXiang JingyangXiang reopened this Apr 5, 2021
@JingyangXiang
Copy link
Contributor Author

@zjuter0126 Overall LGTM, but could u remove all the image files and correct some pylint warning? Thanks!

I find the source of warnings comes from mindspore==1.1.1,when I use mindspore_gpu==1.2.0rc1,they disapear.You can download it by
'''
pip install https://ms-release.obs.cn-north-4.myhuaweicloud.com/1.2.0-rc1/MindSpore/gpu/ubuntu_x86/cuda-10.1/mindspore_gpu-1.2.0rc1-cp37-cp37m-linux_x86_64.whl --trusted-host ms-release.obs.cn-north-4.myhuaweicloud.com -i https://pypi.tuna.tsinghua.edu.cn/simple
'''
You can see the warnings disapear.

And I add it into my branch.You can see it in 1.1.1.jpg and 1.2.0.jpg

@leonwanghui
Copy link
Contributor

@zjuter0126 Got it, we will upgrade mindpore to v1.2.0 sometime later after it being published, so if you can remove the binary pictures, I guess this PR could be merged.

@leonwanghui
Copy link
Contributor

@zjuter0126 BTW, could u append the instruction of training and evaluation guidelines in the comments of your PR? So other developers could follow it, thanks!

@JingyangXiang
Copy link
Contributor Author

@zjuter0126 BTW, could u append the instruction of training and evaluation guidelines in the comments of your PR? So other developers could follow it, thanks!

As you suggest,I add training and evaluate guidelines in test/st/sentiment.py and put test file sentimentnet.py into it.And I also delete 1.1.1.jpg and 1.2.0.jpg.

@leonwanghui
Copy link
Contributor

@zjuter0126 It seems that the evaluation code doesn't work, could u share some guidelines? Thanks!

@leonwanghui
Copy link
Contributor

@zjuter0126 I found the issue, which is that --preprocess is not required because aclImdb_train.mindrecord0 and aclImdb_test.mindrecord0 are both created during training step, so --preprocess (even --aclimdb_path and --glove_path) should be removed.

BTW, the --checkpoint_path is missing in the guideline.

@JingyangXiang
Copy link
Contributor Author

@zjuter0126 I found the issue, which is that --preprocess is not required because aclImdb_train.mindrecord0 and aclImdb_test.mindrecord0 are both created during training step, so --preprocess (even --aclimdb_path and --glove_path) should be removed.

BTW, the --checkpoint_path is missing in the guideline.

Thanks for your suggestions.I correct my preprocess ways so it can work well when preprocessed data have been create.Even though, maybe it is not so beautiful.

Copy link
Contributor

@leonwanghui leonwanghui left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@hannibalhuang hannibalhuang self-requested a review April 7, 2021 02:21
Copy link
Collaborator

@hannibalhuang hannibalhuang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@hannibalhuang hannibalhuang merged commit 8996902 into tinyms-ai:main Apr 7, 2021
@JingyangXiang JingyangXiang deleted the sentimentnet branch May 24, 2021 13:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants