Skip to content

Commit

Permalink
[docs] Update and harmonize guids for deployment
Browse files Browse the repository at this point in the history
This updates and harmonizes the guides for the different deployment
configurations. Several identical sections are provided as snippets.

* Updates docs regarding ROCm support
* Adds a subsection on downloading the runtime from a release
* Adds instructions on checking for CUDA and ROCm support

This superseds #18173 and #18655.

skip-ci: Doc updates only
  • Loading branch information
marbre committed Oct 11, 2024
1 parent 1e155cc commit ae74fb8
Show file tree
Hide file tree
Showing 7 changed files with 132 additions and 102 deletions.
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
=== "Stable releases"

Stable release packages are
[published to PyPI](https://pypi.org/user/google-iree-pypi-deploy/).

``` shell
python -m pip install iree-compiler iree-runtime
```

=== ":material-alert: Nightly releases"

Nightly releases are published on
[GitHub releases](https://github.com/iree-org/iree/releases).

``` shell
python -m pip install \
--find-links https://iree.dev/pip-release-links.html \
--upgrade iree-compiler iree-runtime
```

!!! tip
`iree-compile` and other tools are installed to your python module
installation path. If you pip install with the user mode, it is under
`${HOME}/.local/bin`, or `%APPDATA%Python` on Windows. You may want to
include the path in your system's `PATH` environment variable:

```shell
export PATH=${HOME}/.local/bin:${PATH}
```
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
$ iree-run-module --list_drivers

cuda: NVIDIA CUDA HAL driver (via dylib)
hip: HIP HAL driver (via dylib)
local-sync: Local execution using a lightweight inline synchronous queue
local-task: Local execution using the IREE multithreading task system
vulkan: Vulkan 1.x (dynamic)
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
=== "Stable releases"

Stable release packages are
[published to PyPI](https://pypi.org/user/google-iree-pypi-deploy/).

``` shell
python -m pip install iree-runtime
```

=== ":material-alert: Nightly releases"

Nightly releases are published on
[GitHub releases](https://github.com/iree-org/iree/releases).

``` shell
python -m pip install \
--find-links https://iree.dev/pip-release-links.html \
--upgrade iree-runtime
```
48 changes: 12 additions & 36 deletions docs/website/docs/guides/deployment-configurations/cpu.md
Original file line number Diff line number Diff line change
Expand Up @@ -46,35 +46,7 @@ Python packages are regularly published to
[Python Bindings](../../reference/bindings/python.md) page for more details.
The core `iree-compiler` package includes the LLVM-based CPU compiler:

=== "Stable releases"

Stable release packages are
[published to PyPI](https://pypi.org/user/google-iree-pypi-deploy/).

``` shell
python -m pip install iree-compiler
```

=== ":material-alert: Nightly releases"

Nightly releases are published on
[GitHub releases](https://github.com/iree-org/iree/releases).

``` shell
python -m pip install \
--find-links https://iree.dev/pip-release-links.html \
--upgrade iree-compiler
```

!!! tip
`iree-compile` is installed to your python module installation path. If you
pip install with the user mode, it is under `${HOME}/.local/bin`, or
`%APPDATA%Python` on Windows. You may want to include the path in your
system's `PATH` environment variable:

```shell
export PATH=${HOME}/.local/bin:${PATH}
```
--8<-- "docs/website/docs/guides/deployment-configurations/_iree-compiler-from-release.md"

#### :material-hammer-wrench: Build the compiler from source

Expand All @@ -101,15 +73,19 @@ along with the appropriate executable loaders for your application.
You can check for CPU support by looking for the `local-sync` and `local-task`
drivers:

```console hl_lines="4 5"
$ iree-run-module --list_drivers

cuda: CUDA (dynamic)
local-sync: Local execution using a lightweight inline synchronous queue
local-task: Local execution using the IREE multithreading task system
vulkan: Vulkan 1.x (dynamic)
```console hl_lines="5 6"
--8<-- "docs/website/docs/guides/deployment-configurations/_iree-run-module-driver-list.md"
```

#### :octicons-package-16: Download the runtime from a release

Python packages are regularly published to
[PyPI](https://pypi.org/user/google-iree-pypi-deploy/). See the
[Python Bindings](../../reference/bindings/python.md) page for more details.
The core `iree-runtime` package includes the local CPU HAL drivers:

--8<-- "docs/website/docs/guides/deployment-configurations/_iree-runtime-from-release.md"

#### :material-hammer-wrench: Build the runtime from source

Please make sure you have followed the
Expand Down
53 changes: 24 additions & 29 deletions docs/website/docs/guides/deployment-configurations/gpu-cuda.md
Original file line number Diff line number Diff line change
Expand Up @@ -33,35 +33,7 @@ Python packages are regularly published to
[Python Bindings](../../reference/bindings/python.md) page for more details.
The core `iree-compiler` package includes the CUDA compiler:

=== "Stable releases"

Stable release packages are
[published to PyPI](https://pypi.org/user/google-iree-pypi-deploy/).

``` shell
python -m pip install iree-compiler
```

=== ":material-alert: Nightly releases"

Nightly releases are published on
[GitHub releases](https://github.com/iree-org/iree/releases).

``` shell
python -m pip install \
--find-links https://iree.dev/pip-release-links.html \
--upgrade iree-compiler
```

!!! tip
`iree-compile` is installed to your python module installation path. If you
pip install with the user mode, it is under `${HOME}/.local/bin`, or
`%APPDATA%Python` on Windows. You may want to include the path in your
system's `PATH` environment variable:

```shell
export PATH=${HOME}/.local/bin:${PATH}
```
--8<-- "docs/website/docs/guides/deployment-configurations/_iree-compiler-from-release.md"

#### :material-hammer-wrench: Build the compiler from source

Expand All @@ -78,6 +50,29 @@ the IREE compiler, then enable the CUDA compiler target with the

Next you will need to get an IREE runtime that includes the CUDA HAL driver.

You can check for CUDA support by looking for a matching driver and device:

```console hl_lines="3"
--8<-- "docs/website/docs/guides/deployment-configurations/_iree-run-module-driver-list.md"
```

```console hl_lines="3"
$ iree-run-module --list_devices

cuda://GPU-00000000-1111-2222-3333-444444444444
local-sync://
local-task://
```

#### :octicons-package-16: Download the runtime from a release

Python packages are regularly published to
[PyPI](https://pypi.org/user/google-iree-pypi-deploy/). See the
[Python Bindings](../../reference/bindings/python.md) page for more details.
The core `iree-runtime` package includes the CUDA HAL driver:

--8<-- "docs/website/docs/guides/deployment-configurations/_iree-runtime-from-release.md"

#### :material-hammer-wrench: Build the runtime from source

Please make sure you have followed the
Expand Down
30 changes: 29 additions & 1 deletion docs/website/docs/guides/deployment-configurations/gpu-rocm.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,12 @@ or [Linux](https://rocm.docs.amd.com/en/latest/deploy/linux/quick_start.html).

#### :octicons-package-16: Download the compiler from a release

!!! note "Currently ROCm is **NOT supported** for the Python interface."
Python packages are regularly published to
[PyPI](https://pypi.org/user/google-iree-pypi-deploy/). See the
[Python Bindings](../../reference/bindings/python.md) page for more details.
The core `iree-compiler` package includes the ROCm compiler:

--8<-- "docs/website/docs/guides/deployment-configurations/_iree-compiler-from-release.md"

#### :material-hammer-wrench: Build the compiler from source

Expand All @@ -47,6 +52,29 @@ the IREE compiler, then enable the ROCm compiler target with the

Next you will need to get an IREE runtime that includes the HIP HAL driver.

You can check for HIP support by looking for a matching driver and device:

```console hl_lines="4"
--8<-- "docs/website/docs/guides/deployment-configurations/_iree-run-module-driver-list.md"
```

```console hl_lines="3"
$ iree-run-module --list_devices

hip://GPU-00000000-1111-2222-3333-444444444444
local-sync://
local-task://
```

#### :octicons-package-16: Download the runtime from a release

Python packages are regularly published to
[PyPI](https://pypi.org/user/google-iree-pypi-deploy/). See the
[Python Bindings](../../reference/bindings/python.md) page for more details.
The core `iree-runtime` package includes the HIP HAL driver:

--8<-- "docs/website/docs/guides/deployment-configurations/_iree-runtime-from-release.md"

#### :material-hammer-wrench: Build the runtime from source

Please make sure you have followed the
Expand Down
48 changes: 12 additions & 36 deletions docs/website/docs/guides/deployment-configurations/gpu-vulkan.md
Original file line number Diff line number Diff line change
Expand Up @@ -83,35 +83,7 @@ Python packages are regularly published to
[Python Bindings](../../reference/bindings/python.md) page for more details.
The core `iree-compiler` package includes the SPIR-V compiler:

=== "Stable releases"

Stable release packages are
[published to PyPI](https://pypi.org/user/google-iree-pypi-deploy/).

``` shell
python -m pip install iree-compiler
```

=== ":material-alert: Nightly releases"

Nightly releases are published on
[GitHub releases](https://github.com/iree-org/iree/releases).

``` shell
python -m pip install \
--find-links https://iree.dev/pip-release-links.html \
--upgrade iree-compiler
```

!!! tip
`iree-compile` is installed to your python module installation path. If you
pip install with the user mode, it is under `${HOME}/.local/bin`, or
`%APPDATA%Python` on Windows. You may want to include the path in your
system's `PATH` environment variable:

```shell
export PATH=${HOME}/.local/bin:${PATH}
```
--8<-- "docs/website/docs/guides/deployment-configurations/_iree-compiler-from-release.md"

#### :material-hammer-wrench: Build the compiler from source

Expand All @@ -135,13 +107,8 @@ Next you will need to get an IREE runtime that supports the Vulkan HAL driver.

You can check for Vulkan support by looking for a matching driver and device:

```console hl_lines="6"
$ iree-run-module --list_drivers

cuda: CUDA (dynamic)
local-sync: Local execution using a lightweight inline synchronous queue
local-task: Local execution using the IREE multithreading task system
vulkan: Vulkan 1.x (dynamic)
```console hl_lines="7"
--8<-- "docs/website/docs/guides/deployment-configurations/_iree-run-module-driver-list.md"
```

```console hl_lines="6"
Expand All @@ -153,6 +120,15 @@ $ iree-run-module --list_devices
vulkan://00000000-1111-2222-3333-444444444444
```

#### :octicons-package-16: Download the runtime from a release

Python packages are regularly published to
[PyPI](https://pypi.org/user/google-iree-pypi-deploy/). See the
[Python Bindings](../../reference/bindings/python.md) page for more details.
The core `iree-runtime` package includes the Vulkan HAL drivers:

--8<-- "docs/website/docs/guides/deployment-configurations/_iree-runtime-from-release.md"

#### :material-hammer-wrench: Build the runtime from source

Please make sure you have followed the
Expand Down

0 comments on commit ae74fb8

Please sign in to comment.