Improve Sciebo downloads

[nilshee]

solves #110

[septatrix]

I currently have no Mooble room with sciebo available so I am not really able to test this. Feedback from anyone else would be appreciated though in generall I am in favor of improving the Sciebo scraping

[D-VR]

What is the status of this? Anything left open or are we good to go?

[nilshee]

There are still a couple of bugs, I haven't had the time to fix.

Also, naming the folders for the Sciebo downloads needs a solution. Maybe the Section headers in Moodle as folder names (if folder-share). Currently, the trailing hash of the link is used as folder name.

[nilshee]

Also, some lecturers put the same Sciebo link on multiple sites cf. Post-quantum cryptography. I'm not sure how to handle that. Are relative symlinks an option or should we drop duplicates with a warning?

Also, in the same Moodle room, there is a sciebo link for the videos folder and direct links to the videos.

Does anyone have ideas on how to solve these problems? Or will we download everything multiple times?

[septatrix]

For now it should be finde to do the native approach and download them multiple times. Improving it can be done in a separate PR. Automatically detecting those cases it probably a bit more annoying to get right.

[D-VR]

For now it should be finde to do the native approach and download them multiple times. Improving it can be done in a separate PR. Automatically detecting those cases it probably a bit more annoying to get right.

there's also issues with link finding in general, even in the current search it will try out the same link multiple times.
I had started looking into it, but didn't have the time to do anything.
So yeah duplication is fine for now