So you have been trying the latest Generative AI Models, but not the ones that run in 3rd parties, but LOCAL Models.

You are powering probably with your own laptop or small server and want to see how and if they are struggling.

This is the perfect moment to install NetData (with Docker)

Why NetData?

While cloud-based monitoring services abound, self-hosting Netdata emerges as an alternative for monitoring your HomeLab, granting you control, data privacy, and cost savings.

Netdata runs seamlessly on various systems, including physical and virtual servers, containers, and IoT devices - Supporting Linux, FreeBSD, and MacOS.

Checking Status

Are our AI Apps also alive?

The Netdata Project

Get a quick overview on how your home server is handling service loads

SelfHosting Netdata

Installing NetData with Docker

For this guide, I assume that you have Docker and Docker compose installed in your local machine.

We are going to be using the NetData Docker Image .

The docker-compose file that I recommend to use is this one (optionally you can use it together with NGINX Proxy Manager):

version: '3.8'
services:
  netdata:
    container_name: netdata
    image: netdata/netdata
    ports:
      - '19999:19999'
    volumes:
      - netdataconfig:/etc/netdata
      - netdatalib:/var/lib/netdata
      - netdatacache:/var/cache/netdata
      - '/etc/passwd:/host/etc/passwd:ro'
      - '/etc/group:/host/etc/group:ro'
      - '/proc:/host/proc:ro'
      - '/sys:/host/sys:ro'
      - '/etc/os-release:/host/etc/os-release:ro'
    restart: unless-stopped
    cap_add:
      - SYS_PTRACE
    security_opt:
      - apparmor=unconfined
    #networks: ["nginx_nginx_network"] #optional 
 
volumes:
  netdataconfig:
  netdatalib:
  netdatacache:

# networks: #optional
#   nginx_nginx_network: #optional
#     external: true #optional

This is it. Now you have your HomeLab monitoring setup with NetData and Docker.

You can visit your Dashboard at: http:localhost:19999

I recommend you to have a look to the options - I Find the sensors section particularly interesting:

Net Data Sensors

Netdata with SSL

If you need SSL certificates, you can always install Netdata with NGINX


FAQ

Free Monitoring Tools

highlight.io: The open source, full-stack monitoring platform. Error monitoring, session replay, logging, distributed tracing, and more.

Free and open log management

syslog-ng is an enhanced log daemon, supporting a wide range of input and output methods: syslog, unstructured text, queueing, SQL & NoSQL.

  • Zabbix
  • Sensu
  • Webmin

You can also get Netdata working in SBC like: Raspberry Pi or Orange Pi’s. Small LLMs also work in these!

DIY Monitoring Tools