From source

postvec-server is an ordinary workspace member and builds with cargo: it needs the Rust toolchain and protoc, which compiles the wire contract in proto/ninference.proto. The pgrx toolchain and PostgreSQL headers belong to the extension.

cargo build --release -p postvec-server
sudo install -m 0755 target/release/postvec-server /usr/local/bin/

The published packages and image carry the CPU build. A GPU node is a source build with an execution provider feature:

cargo build --release -p postvec-server --features ort-cuda    # or ort-tensorrt

The node needs ONNX Runtime and at least one model under the engine root, /opt/postvec by default: install the postvec-onnxruntime and postvec-model-* packages, or copy such a tree there. --root names another tree.

# Local development, plaintext.
postvec-server --insecure

# With a certificate pair.
postvec-server \
  --ssl-cert /etc/postvec-server/tls.crt \
  --ssl-cert-key /etc/postvec-server/tls.key

A pair dropped at $root/certs/server.crt and $root/certs/server.key is found without flags. The discovery listener requires TLS unless --insecure is set.

The dashboard needs a built postvec-server/web-ui, passed with --web-ui or installed at $root/server/ui, which is where the packages put it:

cd postvec-server/web-ui
npm ci && npm run build
postvec-server --web-ui "$PWD/dist" --insecure

See models to install more models.

License

postvec-server is Business Source License 1.1 (source-available). Personal production use, non-production environments and a 30-day production evaluation per organization are free. Production use by an organization needs postvec pro. License.

Next: connect PostgreSQL.

• Docker
• Packages
• Dashboard
• Reference