Skip to content

Commit

Permalink
Python backend based PyTorch backend documentations (#94)
Browse files Browse the repository at this point in the history
* Update docs

* Update copyright
  • Loading branch information
kthui authored Jan 11, 2024
1 parent 33be446 commit 1cc481a
Showing 1 changed file with 12 additions and 3 deletions.
15 changes: 12 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
<!--
# Copyright 2021-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# Copyright 2021-2024, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
#
# Redistribution and use in source and binary forms, with or without
# modification, are permitted provided that the following conditions
Expand Down Expand Up @@ -80,8 +80,8 @@ used to execute both TensorFlow 1 and TensorFlow 2 models. The
[tensorflow_backend](https://github.com/triton-inference-server/tensorflow_backend)
repo contains the documentation and source for the backend.

**PyTorch**: The PyTorch backend is used to execute TorchScript
models. The
**PyTorch**: The PyTorch backend is used to execute PyTorch models in both
TorchScript and PyTorch 2.0 formats. The
[pytorch_backend](https://github.com/triton-inference-server/pytorch_backend)
repo contains the documentation and source for the backend.

Expand Down Expand Up @@ -215,6 +215,15 @@ Triton image as:
... # other files needed by mybackend
```

Starting from 24.01, the default backend shared library name can be changed by
providing the `runtime` setting in the model configuration. For example,

```
runtime: "my_backend_shared_library_name.so"
```

A model may choose a specific runtime implementation provided by the backend.

### Triton Backend API

A Triton backend must implement the C interface defined in
Expand Down

0 comments on commit 1cc481a

Please sign in to comment.