Skip to content

CLI tool for populating Airsequel with data. Includes a crawler for GitHub repos metadata.

Notifications You must be signed in to change notification settings

Airsequel/Airput

Folders and files

NameName
Last commit message
Last commit date
Nov 21, 2023
Feb 20, 2024
Nov 19, 2023
Jan 8, 2024
Jun 13, 2020
Feb 20, 2024
Nov 19, 2023
Feb 20, 2024
Jan 3, 2024
Jan 29, 2024
Feb 20, 2024
Jan 3, 2024
Jan 8, 2024

Repository files navigation

Airput

CLI tool for populating Airsequel with data. Includes a crawler for metadata of GitHub repos.

Usage

⬆️ Airput ⬆️

Usage: airput COMMAND

  CLI tool for populating Airsequel with data.

Available options:
  -h,--help                Show this help text

Available commands:
  upload                   Upload files to a database via the REST API. Expects
                           3 columns: `name`, `filetype`, and `content`.
  github-upload            Upload metadata for a single GitHub repo
  github-search            Search for GitHub repos and upload their metadata.

                           If several search queries are provided, they will be
                             executed one after the other.

                           WARNING: If a search returns more than 1000 repos,
                             the results will be truncated.

                           Good search options are:
                           - language:haskell
                           - stars:>=10
                           - stars:10..50
                           - created:2023-10
                           - archived:true

TODOs

  • Add column is_private and only crawl private repos if --private is passed
  • Add subcommand to load list of repos from Airsequel and update them
  • Move bin-calculation.py to Airsequel
  • Store if account is a person or an organization
  • Store all languages for a repo
  • Repos created per week chart
  • Add CLI flag to choose between OverwriteRepo and AddRepo

Related

About

CLI tool for populating Airsequel with data. Includes a crawler for GitHub repos metadata.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published