Code

Handle existing URLs in citations#91

Code

Open

nemobis wants to merge 67 commits intodissemin:masterdissemin/oabot:masterfrom nemobis:T196255nemobis/oabot:T196255Copy head branch name to clipboard

+362-125

Commits

Commits on Dec 6, 2023

• Update copyright guidance link

  Show description for 5623edf
  nemobis

  committed
  5623edf

  Copy full SHA for 5623edf

• Revert "Remove multiprocessing"

  Show description for 997191d
  nemobis

  committed
  997191d

  Copy full SHA for 997191d

• Make refresh faster

  Show description for 83529b5
  nemobis

  committed
  83529b5

  Copy full SHA for 83529b5

• Only add blank URL parameters where already present

  nemobis

  committed
  72bdbef

  Copy full SHA for 72bdbef

• Set header to python3, that's what we use already

  nemobis

  committed
  49812ac

  Copy full SHA for 49812ac

• Better handle existing links

  Show description for 7d32576
  nemobis

  committed
  7d32576

  Copy full SHA for 7d32576

• Don't fetch non-existing URL

  nemobis

  committed
  338018e

  Copy full SHA for 338018e

• Check for URL presence

  nemobis

  committed
  20c9caf

  Copy full SHA for 20c9caf

• Time out after 5 seconds on PDF test fetch

  Show description for dd4f6fe
  nemobis

  committed
  dd4f6fe

  Copy full SHA for dd4f6fe

• Use HTTPS

  nemobis

  committed
  1421a33

  Copy full SHA for 1421a33

• Default for undefined oa_status in resp

  nemobis

  committed
  412939b

  Copy full SHA for 412939b

• Randomise titles to prefill

  nemobis

  committed
  548a67b

  Copy full SHA for 548a67b

• Shuffle properly

  nemobis

  committed
  63c764e

  Copy full SHA for 63c764e

• Use session, handle exception for missing resp

  nemobis

  committed
  79b13c9

  Copy full SHA for 79b13c9

• Handle requests exception

  nemobis

  committed
  e5fe463

  Copy full SHA for e5fe463

• Also consider unknown OA status when no Unpaywall data

  nemobis

  committed
  5c06e03

  Copy full SHA for 5c06e03

Commits on Dec 7, 2023

• Handle Unpaywall connection errors

  nemobis

  committed
  45f3431

  Copy full SHA for 45f3431

• Fix typo in template

  nemobis

  committed
  963ef8d

  Copy full SHA for 963ef8d

• Preserve Unpaywall oa_status, add tests, reduce url-access=limited

  nemobis

  committed
  16e7389

  Copy full SHA for 16e7389

• Avoid spaces in comment edit

  nemobis

  committed
  d066248

  Copy full SHA for d066248

• Actually return default oa_status

  nemobis

  committed
  0ec5f89

  Copy full SHA for 0ec5f89

• Define oa_status default earlier

  nemobis

  committed
  f8ffb30

  Copy full SHA for f8ffb30

• Attempt to add preview in logged out main page

  nemobis

  committed
  323acaa

  Copy full SHA for 323acaa

• Undefined page_name

  nemobis

  committed
  7f55818

  Copy full SHA for 7f55818

• Undefined orig_hash

  nemobis

  committed
  826c8e4

  Copy full SHA for 826c8e4

Commits on Dec 9, 2023

• Simplify condition

  Show description for c372e43
  nemobis

  committed
  c372e43

  Copy full SHA for c372e43

• Check for existence

  nemobis

  committed
  0d25ec4

  Copy full SHA for 0d25ec4

• Check for length

  nemobis

  committed
  00c422e

  Copy full SHA for 00c422e

• Don't check for http link

  nemobis

  committed
  b4f32fa

  Copy full SHA for b4f32fa

Commits on Dec 10, 2023

• Change classification for replaced URLs

  nemobis

  committed
  5c24f47

  Copy full SHA for 5c24f47

• Prefer PMC for links; doi-access can be done separately

  nemobis

  committed
  2f52df8

  Copy full SHA for 2f52df8

• Exclude some domains from url-access=subscription

  nemobis

  committed
  1b1885f

  Copy full SHA for 1b1885f

• Show the proposed edit, useful when there's no link

  nemobis

  committed
  5b231e6

  Copy full SHA for 5b231e6

• Avoid previews when there's no link

  Show description for e724814
  nemobis

  committed
  e724814

  Copy full SHA for e724814

• Avoid url-access comment-only changes

  nemobis

  committed
  2170d4c

  Copy full SHA for 2170d4c

• Add more no-subscription domains from the top 100

  nemobis

  committed
  787304c

  Copy full SHA for 787304c

• Check each template parameter when there are multiple in bot.py

  nemobis

  committed
  cb8febf

  Copy full SHA for cb8febf

• Join back together when multiple changes approved

  nemobis

  committed
  fdcb42f

  Copy full SHA for fdcb42f

• Follow redirects when checking URLs

  Show description for c92ed6e
  nemobis

  committed
  c92ed6e

  Copy full SHA for c92ed6e

• Use correct url variable

  nemobis

  committed
  c7db11e

  Copy full SHA for c7db11e

• Check for variable existence in template

  nemobis

  committed
  c0e5b35

  Copy full SHA for c0e5b35

• Use correct name of variable in template

  nemobis

  committed
  1deb1a9

  Copy full SHA for 1deb1a9

• Revert "Check for variable existence in template"

  Show description for a6bf16d
  nemobis

  committed
  a6bf16d

  Copy full SHA for a6bf16d

Commits on Dec 14, 2023

• Also consider URL archival aliases

  nemobis

  committed
  61f9c3a

  Copy full SHA for 61f9c3a

Commits on Dec 31, 2023

• Update default edit summary as links aren't always added

  nemobis

  committed
  d092a88

  Copy full SHA for d092a88

• Show proposed edit in frontpage (also when no link is available)

  nemobis

  committed
  04baf29

  Copy full SHA for 04baf29

Commits on Jan 1, 2024

• Avoid relative import

  Show description for e426f0a
  nemobis

  committed
  e426f0a

  Copy full SHA for e426f0a

• Add server_default sequence

  Show description for 44a752a
  nemobis

  committed
  44a752a

  Copy full SHA for 44a752a

• Use autoincrement in userstats table

  Show description for 98318a2
  nemobis

  committed
  98318a2

  Copy full SHA for 98318a2

• Update UserStats comment to new database schema, OAuth ID

  nemobis

  committed
  324745c

  Copy full SHA for 324745c

• Add query to update the leaderboard

  Show description for 4917289
  nemobis

  committed
  4917289

  Copy full SHA for 4917289

• Restore SS directory, move url-access edits too

  nemobis

  committed
  b79a076

  Copy full SHA for b79a076

• Clarify scope of Sherpa/Romeo advice: publisher information

  nemobis

  committed
  79643eb

  Copy full SHA for 79643eb

• Check existing URL also when not adding a new one

  nemobis

  committed
  1cd6152

  Copy full SHA for 1cd6152

• Add test case for existing URL on closed DOI

  nemobis

  committed
  76e5bb8

  Copy full SHA for 76e5bb8

• Continue looking for OA URLs and IDs if DOI is gold/hybrid/bronze

  nemobis

  committed
  5b2012c

  Copy full SHA for 5b2012c

• Remove extra printing

  nemobis

  committed
  c784a67

  Copy full SHA for c784a67

Commits on Jan 2, 2024

• Don't use requests session with multithreading

  nemobis

  committed
  8b0776f

  Copy full SHA for 8b0776f

Commits on Jan 4, 2024

• Remove special-casing for hdl, citeseerx

  Show description for ddab25a
  nemobis

  committed
  ddab25a

  Copy full SHA for ddab25a

• Avoid undefined variable in frontpage

  nemobis

  committed
  21985ab

  Copy full SHA for 21985ab

• Handle filenames beginning by hyphen, avoid error: "invalid option"

  nemobis

  committed
  ce32e5f

  Copy full SHA for ce32e5f

• Revert "Don't use requests session with multithreading"

  Show description for 8676a52
  nemobis

  committed
  8676a52

  Copy full SHA for 8676a52

Commits on Jan 6, 2024

• Restore citeseerx special casing

  Show description for 8895319
  nemobis

  committed
  8895319

  Copy full SHA for 8895319

Commits on Jan 7, 2024

• Ignore OAI-PMH title matches on old PMC records

  Show description for 1b49d99
  nemobis

  committed
  1b49d99

  Copy full SHA for 1b49d99

• Avoid SyntaxWarning: "is" with a literal. Did you mean "=="?

  nemobis

  committed
  ad91db6

  Copy full SHA for ad91db6

Commits on Jan 10, 2024

• Also move https links away

  nemobis

  committed
  f3770c0

  Copy full SHA for f3770c0

Commits on Jan 13, 2024

• Rank of osti.gov under other identifiers

  Show description for ee62454
  nemobis

  committed
  ee62454

  Copy full SHA for ee62454