BDO-REST-API

Scraper for Black Desert Online community data with a built-in API server. It currently supports EU, NA, and SA regions (KR support is in development).

Projects using this API

• BDO Leaderboards (Website, sources): web-based leaderboards for Black Desert Online.
• Ikusa (Website, sources): powerful tool that allows you to analyze your game logs and gain valuable insights into your combat performance.
• GuildYapper (Discord server): Discord bot with various features for BDO guilds such as guild and player history logging, and automatic trial Discord management (more features TBA).
• BDO Concierge (Discord server): Discord bot for organising events in a guild bosses alliance.

How to start using it

There are two ways to use this scraper for your needs:

• By querying https://bdo.hemlo.cc/communityapi/v1 — this is the "official" instance hosted by me.
• If you want to have more control over the API, host the scraper yourself using one of the following methods:
  • As a Docker container: the image is available on DockerHub.
  • Natively: build the binary from source as described in this guide.

API documentation can be viewed here.

Flags

If you host the API yourself, either via Docker or natively, you can control some of its features by executing it with flags.

Available flags:

• -cachettl
  • Allows to specify cache TTL in minutes
  • Type: unsigned integer
  • Default value: 180
• -maintenancettl
  • Allows to limit how frequently scraper can check for maintenance end in minutes
  • Type: unsigned integer
  • Default value: 5
• -port
  • Allows to specify API server's port
  • Type: unsigned integer
  • Default value: 8001
  • Also available as PORT environment variable (doesn't work in Docker)
• -proxy
  • Allows to specify a list of proxies to make requests to BDO servers through
  • Type: string, space-separated list of IP addresses or URLs
  • Default value: none, requests are made directly
  • Also available as PROXY environment variable
• -ratelimit
  • Sets the maximum number of requests per minute per IP address
  • Type: unsigned integer
  • Default value: 512
• -verbose
  • Allows to put the app into verbose mode and print out additional logs to stdout
  • Default value: none, no additional output is produced

You can use them like this:

./bdo-rest-api -cachettl 30
# or
docker container run -p 8001:8001 bdo-rest-api -cachettl 30

Contributing

Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.

Known bugs

There is a number of bugs that the official BDO website has. This scraper does not do anything about them for the sake of simplicity, so your apps may need to use workarounds.

By the way

This is a fan-created project that is not affiliated with or endorsed by Pearl Abyss.