Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

requirements.txt依赖冲突 #14

Closed
prophesier opened this issue May 14, 2022 · 19 comments
Closed

requirements.txt依赖冲突 #14

prophesier opened this issue May 14, 2022 · 19 comments

Comments

@prophesier
Copy link

paddlespeech==0.2.0
spleeter==2.3.0
这两条会产生如下的冲突报错


ERROR: Cannot install -r requirements.txt (line 2) and -r requirements.txt (line 4) because these package versions have conflicting dependencies.

The conflict is caused by:
    paddlespeech 0.2.0 depends on librosa==0.8.1
    spleeter 2.3.0 depends on librosa==0.8.0
@jerryuhoo
Copy link
Owner

要不先安装spleeter再安装paddlespeech吧,用librosa==0.8.1的版本,这两个官方发布的包用的librosa版本冲突也没办法,但是应该不会影响使用

@prophesier
Copy link
Author

prophesier commented May 15, 2022

今天又试了一下,我发现这个安装有两个独立的错误,
其一是上面提到的依赖冲突问题,
其二是单独安装paddlespeech的时候,里面其中一个依赖项dtaidistance在build wheel的时候会报错。

先说第二点:google了一下说这个是windows的bug,尝试多种解决方法未果(包括提到好像换numpy版本可以,但是我试了依然报错),后来发现单独安装dtaidistance不会报错,猜测可能只有某个版本的dtaidistance会有问题。最后把requirements.txt里面改为了paddlespeech==0.2.0 dtaidistance>2.3.1解决了这个报错。安装可以正常安装,不过安装完之后pip提示一些jupyter的东西依赖冲突。。希望之后没事。

然后是第一点,由于spleeter的release就两个版本,另一个太老了,都不支持librosa0.8.1。所以试图找到共用的版本失败。尝试先安装spleeter再安装paddlespeech。最后用的是librosa0.8.1.事实证明这个方法不行,命令行调用spleeter会直接报错终止。
然后我采用的方法是分两个环境分别装spleeter和paddlespeech,手动进行文本前端的处理。前面都是正常的,但是用sh文件里spleeter相关的语句每次只能处理到素材的第二个片段,然后就会报错弹出(一闪而过看不清报的什么错)

坑太多实在不想去debug了,最后决定彻底放弃命令行版的spleeter,直接用spleeterGUI,gui版本是支持同时拖进去多个文件的,算是比较完美解决去背景音这一步了,也不需要搞两个环境切来切去,就去背景这步手动用gui搞一下就可以了。

@prophesier
Copy link
Author

然后在2.4步的时候会报如下错误
image

@jerryuhoo
Copy link
Owner

jerryuhoo commented May 15, 2022

PaddlePaddle/PaddleSpeech#1617
会不会是paddlespeech 0.2.0版本没安装成功?windows安装我确实没测试过,我在linux上安装感觉坑会少一点

@prophesier
Copy link
Author

prophesier commented May 15, 2022

看了一下,应该是paddleaudio那一部分没有安装,按照issue里面的方法去试了,结果发现就是paddleaudio依赖dtaidistance这个包,回到了前面dtaidistance==2.3.1安装不了的问题上,报错如下:
`
Building wheel for dtaidistance (pyproject.toml) ... error
error: subprocess-exited-with-error

× Building wheel for dtaidistance (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [248 lines of output]
WARNING: Numpy was not found, preparing a version without Numpy support.
running bdist_wheel
running build
running build_py
creating build
creating build\lib.win-amd64-cpython-38
creating build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\alignment.py -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\dp.py -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\dtw.py -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\dtw_barycenter.py -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\dtw_ndim.py -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\dtw_ndim_visualisation.py -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\dtw_visualisation.py -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\dtw_weighted.py -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\ed.py -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\exceptions.py -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\preprocessing.py -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\util.py -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\util_numpy.py -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance_init_.py -> build\lib.win-amd64-cpython-38\dtaidistance
creating build\lib.win-amd64-cpython-38\dtaidistance\clustering
copying dtaidistance\clustering\hierarchical.py -> build\lib.win-amd64-cpython-38\dtaidistance\clustering
copying dtaidistance\clustering\kmeans.py -> build\lib.win-amd64-cpython-38\dtaidistance\clustering
copying dtaidistance\clustering\medoids.py -> build\lib.win-amd64-cpython-38\dtaidistance\clustering
copying dtaidistance\clustering\visualization.py -> build\lib.win-amd64-cpython-38\dtaidistance\clustering
copying dtaidistance\clustering_init_.py -> build\lib.win-amd64-cpython-38\dtaidistance\clustering
creating build\lib.win-amd64-cpython-38\dtaidistance\subsequence
copying dtaidistance\subsequence\dtw.py -> build\lib.win-amd64-cpython-38\dtaidistance\subsequence
copying dtaidistance\subsequence_init_.py -> build\lib.win-amd64-cpython-38\dtaidistance\subsequence
running egg_info
writing dtaidistance.egg-info\PKG-INFO
writing dependency_links to dtaidistance.egg-info\dependency_links.txt
writing requirements to dtaidistance.egg-info\requires.txt
writing top-level names to dtaidistance.egg-info\top_level.txt
reading manifest file 'dtaidistance.egg-info\SOURCES.txt'
reading manifest template 'MANIFEST.in'
no previously-included directories found matching 'experiments'
no previously-included directories found matching 'venv'
no previously-included directories found matching 'tests_pycache_'
no previously-included directories found matching 'tests\output'
adding license file 'LICENSE'
writing manifest file 'dtaidistance.egg-info\SOURCES.txt'
copying dtaidistance\dtaidistancec_dtw.pxd -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\dtaidistancec_dtw_omp.pxd -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\dtaidistancec_ed.pxd -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\dtaidistancec_globals.pxd -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\dtw_c.pyx -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\dtw_cc.c -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\dtw_cc.pxd -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\dtw_cc.pyx -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\dtw_cc_omp.c -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\dtw_cc_omp.pyx -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\ed_cc.c -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\ed_cc.pyx -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\util_numpy_cc.c -> build\lib.win-amd64-cpython-38\dtaidistance
copying dtaidistance\util_numpy_cc.pyx -> build\lib.win-amd64-cpython-38\dtaidistance
creating build\lib.win-amd64-cpython-38\dtaidistance\lib
creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC
creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw.c -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw_openmp.c -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_ed.c -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\Makefile -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\readme.md -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_benchmark.c -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw.h -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw_openmp.h -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_ed.h -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_globals.c -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_globals.h -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_tests_dtw.c -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_tests_matrix.c -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\main.c -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.pbxproj -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj
creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\contents.xcworkspacedata -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace
creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\xcshareddata
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\xcshareddata\IDEWorkspaceChecks.plist -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\xcshareddata
creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata
creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceC.xcscheme -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceCBenchmark.xcscheme -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceCTestDTW.xcscheme -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceCTestMatrix.xcscheme -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes
creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata
creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad
creating build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger\Breakpoints_v2.xcbkptlist -> build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger
ERROR: The C extension could not be compiled
error: could not create 'build\lib.win-amd64-cpython-38\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger\Breakpoints_v2.xcbkptlist': No such file or directory
running bdist_wheel
running build
running build_py
creating build\lib
creating build\lib\dtaidistance
copying dtaidistance\alignment.py -> build\lib\dtaidistance
copying dtaidistance\dp.py -> build\lib\dtaidistance
copying dtaidistance\dtw.py -> build\lib\dtaidistance
copying dtaidistance\dtw_barycenter.py -> build\lib\dtaidistance
copying dtaidistance\dtw_ndim.py -> build\lib\dtaidistance
copying dtaidistance\dtw_ndim_visualisation.py -> build\lib\dtaidistance
copying dtaidistance\dtw_visualisation.py -> build\lib\dtaidistance
copying dtaidistance\dtw_weighted.py -> build\lib\dtaidistance
copying dtaidistance\ed.py -> build\lib\dtaidistance
copying dtaidistance\exceptions.py -> build\lib\dtaidistance
copying dtaidistance\preprocessing.py -> build\lib\dtaidistance
copying dtaidistance\util.py -> build\lib\dtaidistance
copying dtaidistance\util_numpy.py -> build\lib\dtaidistance
copying dtaidistance_init_.py -> build\lib\dtaidistance
creating build\lib\dtaidistance\clustering
copying dtaidistance\clustering\hierarchical.py -> build\lib\dtaidistance\clustering
copying dtaidistance\clustering\kmeans.py -> build\lib\dtaidistance\clustering
copying dtaidistance\clustering\medoids.py -> build\lib\dtaidistance\clustering
copying dtaidistance\clustering\visualization.py -> build\lib\dtaidistance\clustering
copying dtaidistance\clustering_init_.py -> build\lib\dtaidistance\clustering
creating build\lib\dtaidistance\subsequence
copying dtaidistance\subsequence\dtw.py -> build\lib\dtaidistance\subsequence
copying dtaidistance\subsequence_init_.py -> build\lib\dtaidistance\subsequence
running egg_info
writing dtaidistance.egg-info\PKG-INFO
writing dependency_links to dtaidistance.egg-info\dependency_links.txt
writing requirements to dtaidistance.egg-info\requires.txt
writing top-level names to dtaidistance.egg-info\top_level.txt
reading manifest file 'dtaidistance.egg-info\SOURCES.txt'
reading manifest template 'MANIFEST.in'
no previously-included directories found matching 'experiments'
no previously-included directories found matching 'venv'
no previously-included directories found matching 'tests_pycache_'
no previously-included directories found matching 'tests\output'
adding license file 'LICENSE'
writing manifest file 'dtaidistance.egg-info\SOURCES.txt'
copying dtaidistance\dtaidistancec_dtw.pxd -> build\lib\dtaidistance
copying dtaidistance\dtaidistancec_dtw_omp.pxd -> build\lib\dtaidistance
copying dtaidistance\dtaidistancec_ed.pxd -> build\lib\dtaidistance
copying dtaidistance\dtaidistancec_globals.pxd -> build\lib\dtaidistance
copying dtaidistance\dtw_c.pyx -> build\lib\dtaidistance
copying dtaidistance\dtw_cc.c -> build\lib\dtaidistance
copying dtaidistance\dtw_cc.pxd -> build\lib\dtaidistance
copying dtaidistance\dtw_cc.pyx -> build\lib\dtaidistance
copying dtaidistance\dtw_cc_omp.c -> build\lib\dtaidistance
copying dtaidistance\dtw_cc_omp.pyx -> build\lib\dtaidistance
copying dtaidistance\ed_cc.c -> build\lib\dtaidistance
copying dtaidistance\ed_cc.pyx -> build\lib\dtaidistance
copying dtaidistance\util_numpy_cc.c -> build\lib\dtaidistance
copying dtaidistance\util_numpy_cc.pyx -> build\lib\dtaidistance
creating build\lib\dtaidistance\lib
creating build\lib\dtaidistance\lib\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\Makefile -> build\lib\dtaidistance\lib\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\readme.md -> build\lib\dtaidistance\lib\DTAIDistanceC
creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_benchmark.c -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw.c -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw.h -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw_openmp.c -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw_openmp.h -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_ed.c -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_ed.h -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_globals.c -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_globals.h -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_tests_dtw.c -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_tests_matrix.c -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\main.c -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.pbxproj -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj
creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\contents.xcworkspacedata -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace
creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\xcshareddata
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\xcshareddata\IDEWorkspaceChecks.plist -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\xcshareddata
creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata
creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceC.xcscheme -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceCBenchmark.xcscheme -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceCTestDTW.xcscheme -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceCTestMatrix.xcscheme -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes
creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata
creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad
creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger\Breakpoints_v2.xcbkptlist -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger
creating build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcschemes
copying dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcschemes\xcschememanagement.plist -> build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcschemes
installing to build\bdist.win-amd64\wheel
running install
running install_lib
creating build\bdist.win-amd64
creating build\bdist.win-amd64\wheel
creating build\bdist.win-amd64\wheel\dtaidistance
copying build\lib\dtaidistance\alignment.py -> build\bdist.win-amd64\wheel.\dtaidistance
creating build\bdist.win-amd64\wheel\dtaidistance\clustering
copying build\lib\dtaidistance\clustering\hierarchical.py -> build\bdist.win-amd64\wheel.\dtaidistance\clustering
copying build\lib\dtaidistance\clustering\kmeans.py -> build\bdist.win-amd64\wheel.\dtaidistance\clustering
copying build\lib\dtaidistance\clustering\medoids.py -> build\bdist.win-amd64\wheel.\dtaidistance\clustering
copying build\lib\dtaidistance\clustering\visualization.py -> build\bdist.win-amd64\wheel.\dtaidistance\clustering
copying build\lib\dtaidistance\clustering_init_.py -> build\bdist.win-amd64\wheel.\dtaidistance\clustering
copying build\lib\dtaidistance\dp.py -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\dtaidistancec_dtw.pxd -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\dtaidistancec_dtw_omp.pxd -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\dtaidistancec_ed.pxd -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\dtaidistancec_globals.pxd -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\dtw.py -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\dtw_barycenter.py -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\dtw_c.pyx -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\dtw_cc.c -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\dtw_cc.pxd -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\dtw_cc.pyx -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\dtw_cc_omp.c -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\dtw_cc_omp.pyx -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\dtw_ndim.py -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\dtw_ndim_visualisation.py -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\dtw_visualisation.py -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\dtw_weighted.py -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\ed.py -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\ed_cc.c -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\ed_cc.pyx -> build\bdist.win-amd64\wheel.\dtaidistance
copying build\lib\dtaidistance\exceptions.py -> build\bdist.win-amd64\wheel.\dtaidistance
creating build\bdist.win-amd64\wheel\dtaidistance\lib
creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC
creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_benchmark.c -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw.c -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw.h -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw_openmp.c -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_dtw_openmp.h -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_ed.c -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_ed.h -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_globals.c -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_globals.h -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_tests_dtw.c -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\dd_tests_matrix.c -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC\main.c -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC
creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.pbxproj -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj
creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\contents.xcworkspacedata -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace
creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\xcshareddata
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\xcshareddata\IDEWorkspaceChecks.plist -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\project.xcworkspace\xcshareddata
creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata
creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceC.xcscheme -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceCBenchmark.xcscheme -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceCTestDTW.xcscheme -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes\DTAIDistanceCTestMatrix.xcscheme -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcshareddata\xcschemes
creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata
creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad
creating build\bdist.win-amd64\wheel\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger
copying build\lib\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger\Breakpoints_v2.xcbkptlist -> build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger
error: could not create 'build\bdist.win-amd64\wheel.\dtaidistance\lib\DTAIDistanceC\DTAIDistanceC.xcodeproj\xcuserdata\wannes.xcuserdatad\xcdebugger\Breakpoints_v2.xcbkptlist': No such file or directory
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for dtaidistance
Successfully built paddleaudio
Failed to build dtaidistance
ERROR: Could not build wheels for dtaidistance, which is required to install pyproject.toml-based projects
`
没有查到可用的解决方法,感觉无解了。回头用linux再试试吧

@prophesier
Copy link
Author

试着直接编辑了一下paddleaudio的setup.py,把对dtaidistance版本的依赖给删了,然后成功安装并进行2.4的文本生成了

@prophesier
Copy link
Author

prophesier commented May 15, 2022

步骤2.6 data_filter.py 运行时首先报错gbk编码打不开txt文件,修改代码后报错如下:

(paddle) F:\code\VtuberTalk>python tools/data_filter.py --path F:\code\VtuberTalk\data\wav_temp\tf\split\
Traceback (most recent call last):
  File "tools/data_filter.py", line 48, in <module>
    process(args, outdir)
  File "tools/data_filter.py", line 32, in process
    move(path, file, outdir)
  File "tools/data_filter.py", line 12, in move
    os.replace(os.path.join(root_path, file_name), os.path.join(output_path, file_name))
PermissionError: [WinError 32] 另一个程序正在使用此文件,进程无法访问。: 'F:\\code\\VtuberTalk\\data\\wav_temp\\tf\\split\\tf_006_00.txt' -> 'F:\\code\\VtuberTalk\\data\\wav_temp\\tf\\split\\../useless\\tf_006_00.txt'

进程冲突,检查代码后将process这个函数改成了这样,最后成功运行

def process(args, outdir):
    path=args.path
    files=os.listdir(path)
    files = sorted_alphanumeric(files)
    count = [0] * 600
    for file in files:
        if file.endswith('.txt'):
            pass
        else:
            continue
        position = path + file
        line_len=0
        with open(position , 'r', encoding='utf-8') as f:
            for line in f.readlines():
                line_len = len(line)
                count[line_len] += 1
        if line_len < int(args.min) or line_len > int(args.max):
            move(path, file, outdir)
    for i in range(len(count)):
        print("长度为", i, "的有", count[i], "条。")

原来版本是在withopen里面直接调用move函数引起了报错

@jerryuhoo
Copy link
Owner

data_filter的作用是把上一步生成的txt里过长和过短的给删除,这样修改的话只能判断txt里最后一行的长度了

@prophesier
Copy link
Author

emm, 因为这个filter是直接在split的目录里面找的txt文件,是还没整合过的,每个txt文件本来就只有一行,所以应该是没问题的

@jerryuhoo
Copy link
Owner

emm, 因为这个filter是直接在split的目录里面找的txt文件,是还没整合过的,每个txt文件本来就只有一行,所以应该是没问题的

哦对对对,太久没用了我都忘了,确实是应该只有一行的,我修改一下,应该先close文件再移动的。

@prophesier
Copy link
Author

步骤2.10中,提取features过程中使用单人speedyspeech,发现运行speedyspeech下的preprocess.py报错,

from paddlespeech.t2s.data.get_feats import LogMelFBank

这句找不到对应的module
对比fastspeech2的preprocess发现需要改为

from paddlespeech.t2s.datasets.get_feats import LogMelFBank

然后正常运行

@jerryuhoo
Copy link
Owner

已修复

@prophesier
Copy link
Author

额额好快,发现speedyspeech里面还有一些问题, 首先上面同样的引入错误也出现在am_batch_fn.py中
然后preprocess.py的252行

    elif args.dataset == "other":
        sub_num_dev = 100
        wav_dir = rootdir / "wav"
...

文件路径应该是

    elif args.dataset == "other":
        sub_num_dev = 100
        wav_dir = rootdir / "wav_temp"
...

另外normalize过程在首页的命令里面少了--speaker-dict=dump/speaker_id_map.txt这个参数,在sh文件里是正常的

@prophesier
Copy link
Author

speaker_id_map这个好像是多人才需要,但是单人不加这个会报错,sh文件中即使是单人也加上了

@jerryuhoo
Copy link
Owner

jerryuhoo commented May 19, 2022

wav_temp这个地方我应该是忘记写了,在mfa之后加一个第8步,把wav_temp/speaker/split的内容复制到wav/speaker中。之后run_train.sh里用的都是wav,wav_temp在制作数据集完成之后就可以删了。想了一下应该还是要在mfa之前做,毕竟制作数据集目前只能做处理单人的,如果要处理多人的数据集就还要再运行一遍脚本。

@prophesier
Copy link
Author

好的谢谢,看了一下程序里好像也判断了要是有split文件夹就用里面的wav文件,所以我之前直接改了倒是也没出问题。
然后gui部分的话很多文件路径写死了,找不到就会闪退,比如默认的fastspeech,我模型用的是speedyspeech就会报错,这个你大概后续还会调整吧?我暂时自己改了改让它不闪退能生成语音了。想问下这个要是想训练出一个差不多还可以用的模型要大概多少原始数据,跑多少epoch呢?有没有直接拿预训练模型进行finetune的方法?

@jerryuhoo
Copy link
Owner

我把文档里单人的删了吧,paddlespeech可能之后改过,如果都需要speaker-dict的话单人的应该和多人的一样?

想问下这个要是想训练出一个差不多还可以用的模型要大概多少原始数据,跑多少epoch呢?有没有直接拿预训练模型进行finetune的方法?

目前按照#7 我说的方法,finetune的话我觉得起码一个人需要300句,每句长1s-3s,大概3-50个字左右都行,fastspeech batch size设置为8的情况下跑20万步以上吧,反正差不多大概收敛了就行,hifigan vocoder得finetune一下,如果从头开始训练起码40万步以上。

@jerryuhoo
Copy link
Owner

目前官方没有speedyspeech的多人模型,所以建议结合一下aishell3的数据集一起训练,可以先训练一个纯aishell3的多人模型,然后再把制作好的数据集替换掉某个SSB****文件夹,wav和TextGrid文件夹都要替换,然后重新run_train.sh,在normalize这步之前停一下,把phone-dict.txt替换为之前训练好的字典,而不是用刚刚生成的字典。

@prophesier
Copy link
Author

好的,我再翻翻paddle仓库教程研究研究,谢谢了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants