Move the query string filter to a proper list

[fmarier]

The following query parameters will require extra functionality in the query string filter:

• Filter out Drip's email tracker from URLs #8975 (exempt same-site requests from the filter, i.e. Exempt intra-site requests from the query string filter #9020)
• Filter out Marketo's email tracker from URLs #9018 (avoid removing parameters when other parameters are present)

We should design a list format that will support all of these use cases.

In addition, instead of being hard-coded in code, the list should ideally be shipped via the component updater and be hosted in a public repo for others to contribute to.

[fmarier]

#8975 doesn't require a list format change and is therefore not blocked on the current issue.

Since #9018 is the only tracking parameter that requires a list format change, let's wait until we have a few more examples before we migrate to a more flexible system.

[Th3l5D]

Hello @fmarier

Is there any news for this feature?
I would like to know if there is any plan to integrate this kind of feature globally, in order to have something like https://gitlab.com/KevinRoebert/ClearUrls/ which have a nice query filter ( https://gitlab.com/KevinRoebert/ClearUrls/blob/master/data/data.min.json )

[fmarier]

@Th3l5D Thanks for the link. It is one of the extensions I looked at while putting together our own list.

The goal of our feature is to block cross-site tracking (see https://github.com/brave/brave-browser/wiki/Query-String-Filter) and so our list format wouldn't have to be as comprehensive what ClearUrls has, which aims at cleaning URLs of all unnecessary bits.

Work is progressing on our filter. It's alreay in release, we've recently added new trackers, and have identified a few more that need to be looked at or blocked.

[fmarier]

Unassigning since we're not actively working on this at the moment.

[antonok-edm]

Note that $removeparam support is coming in brave/brave-core#15943

[fmarier]

@ShivanKaul and I were just discussing this.

As a first step, I suggested using the same list format as https://github.com/brave/adblock-lists/blob/master/brave-lists/clean-urls.json which would allow us to move these two hard-coded lists to a new https://github.com/brave/adblock-lists/blob/master/brave-lists/query-filter.json list:

• global rules (*://*/*): https://github.com/brave/brave-core/blob/cdfe99bd6b9d7c8f6b7eb0b05b3db795ec7e4ca2/components/query_filter/utils.cc#L23-L123
• domain-specific rules: https://github.com/brave/brave-core/blob/cdfe99bd6b9d7c8f6b7eb0b05b3db795ec7e4ca2/components/query_filter/utils.cc#L139-L150

and we can leave the smallest block hard-coded for now since it's only three entries: https://github.com/brave/brave-core/blob/cdfe99bd6b9d7c8f6b7eb0b05b3db795ec7e4ca2/components/query_filter/utils.cc#L125-L132