DirectML

SD.Next includes support for PyTorch-DirectML.

How to

Add --use-directml on commandline arguments.

For details, go to Installation.

Performance

The performance is quite bad compared to ROCm.

If you are familiar with Linux system, we recommend ROCm.

FAQ

DirectML does not collect garbage memory.

PyTorch-DirectML does not access graphics memory by indexing. Because PyTorch-DirectML's tensor implementation extends OpaqueTensorImpl, we cannot access the actual storage of a tensor.

An error occurs with no error message.

If you met RuntimeError with no error message (or empty), please report us via GitHub issue or Discord. (please check whether there's a duplicated issue)

It does not work properly with FP16.

If it works with FP32, please report us via GitHub issue or Discord. (please check whether there's a duplicated issue)

The terminal is suddenly frozen during generation.

Please report us via GitHub issue or Discord. (please check whether there's a duplicated issue)

Olive (experimental support)

Refer to ONNX Runtime.