Setup and Quick Start

Getting started with hls4ml is very easy. There are several installation options available and once installed, it takes only a few lines of code to run your first synthesis.

Installation

The latest release of hls4ml can be installed with pip:

pip install hls4ml

If you want to use our profiling toolbox, you might need to install extra dependencies:

pip install hls4ml[profiling]

Warning

Previously, versions of hls4ml were made available on conda-forge. These are outdated and should NOT be used. Installing with pip is currently the only supported method.

Development version

hls4ml is rapidly evolving and many experimental features and bugfixes are available on the development branch. Development version can be installed directly from git:

pip install git+https://github.com/fastmachinelearning/hls4ml@main

Dependencies

The hls4ml library requires python 3.10 or later, and depends on a number of Python packages and external tools for synthesis and simulation. Python dependencies are automatically managed by pip or conda.

  • TensorFlow (version 2.8 to 2.14) and QKeras are required by the Keras converter. One may want to install newer versions of QKeras from GitHub. Newer versions of TensorFlow can be used, but QKeras and hl4ml do not currently support Keras v3.

  • ONNX (version 1.4.0 and newer) is required by the ONNX converter.

  • PyTorch package is optional. If not installed, the PyTorch converter will not be available.

Running C simulation from Python requires a C++11-compatible compiler. On Linux, a GCC C++ compiler g++ is required. Any version from a recent Linux should work. On MacOS, the clang-based g++ is enough. For the oneAPI backend, one must have oneAPI installed, along with the FPGA compiler, to run C/SYCL simulations.

To run FPGA synthesis, installation of following tools is required:

  • Xilinx Vivado HLS 2018.2 to 2020.1 for synthesis for Xilinx FPGAs using the Vivado backend.

  • Vitis HLS 2022.2 or newer is required for synthesis for Xilinx FPGAs using the Vitis backend.

  • Intel Quartus 20.1 to 21.4 for the synthesis for Intel/Altera FPGAs using the Quartus backend.

  • oneAPI 2024.1 to 2025.0 with the FPGA compiler and recent Intel/Altera Quartus for Intel/Altera FPGAs using the oneAPI backend.

Catapult HLS 2024.1_1 or 2024.2 can be used to synthesize both for ASICs and FPGAs.

Quick Start

For basic concepts to understand the tool, please visit the Concepts chapter. Here we give line-by-line instructions to demonstrate the general workflow.

import hls4ml
import tensorflow as tf
from tensorflow.keras.layers import Dense

# Construct a basic keras model
model = tf.keras.models.Sequential()
model.add(Dense(64, input_shape=(16,), name='Dense', kernel_initializer='lecun_uniform', kernel_regularizer=None))
model.add(Activation(activation='elu', name='Activation'))
model.add(Dense(32, name='Dense2', kernel_initializer='lecun_uniform', kernel_regularizer=None))
model.add(Activation(activation='elu', name='Activation2'))

# This is where you would train the model in a real-world scenario

# Generate an hls configuration from the keras model
config = hls4ml.utils.config_from_keras_model(model)

# You can print the config to see some default parameters
print(config)

# Convert the model to an hls project using the config
hls_model = hls4ml.converters.convert_from_keras_model(
   model=model,
   hls_config=config,
   backend='Vitis'
)

Once converted to an HLS project, you can connect the project into the Python runtime and use it to run predictions on a numpy array:

import numpy as np

# Compile the hls project and link it into the Python runtime
hls_model.compile()

# Generate random input data
X_input = np.random.rand(100, 16)

# Run the model on the input data
hls_prediction = hls_model.predict(X_input)

After that, you can use Vitis HLS to synthesize the model:

# Use Vitis HLS to synthesize the model
# This might take several minutes
hls_model.build()

# Optional: print out the report
hls4ml.report.read_vivado_report('my-hls-test')

Done! You’ve built your first project using hls4ml! To learn more about our various API functionalities, check out our tutorials here.

If you want to configure your model further, check out our Configuration page.

Existing examples

  • Training codes and examples of resources needed to train the models can be found in the tutorial.

  • Examples of model files and weights can be found in example_models directory.

Uninstalling

To uninstall hls4ml:

pip uninstall hls4ml

If installed with conda, remove the package with:

conda remove hls4ml