Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce normalize and normalization schema. #130

Merged
merged 11 commits into from
Dec 19, 2023
Prev Previous commit
import future annotations as we support py3.8+
rgaudin authored and mgautierfr committed Dec 18, 2023
commit 0bfddc9216a1807c4c3266db3b0f80b633735275
2 changes: 2 additions & 0 deletions src/warc2zim/url_rewriting.py
Original file line number Diff line number Diff line change
@@ -36,6 +36,8 @@
by slightly simplifying the path and keeping only the usefull arguments in the querystring.
"""

from __future__ import annotations

import logging
import re
from urllib.parse import urlsplit, urlunsplit, quote, unquote, parse_qs, urlencode
2 changes: 2 additions & 0 deletions src/warc2zim/utils.py
Original file line number Diff line number Diff line change
@@ -2,6 +2,8 @@
# -*- coding: utf-8 -*-
# vim: ai ts=4 sts=4 et sw=4 nu

from __future__ import annotations

import pkg_resources
from bs4 import BeautifulSoup