2018-12-10 11:58:09 -05:00
|
|
|
services:
|
|
|
|
|
postgres:
|
2019-08-14 10:33:49 -04:00
|
|
|
extends:
|
|
|
|
|
file: docker-compose.common.yml
|
|
|
|
|
service: postgres
|
2018-12-13 16:29:47 -05:00
|
|
|
tmpfs: /var/lib/postgresql/data
|
2018-12-10 11:58:09 -05:00
|
|
|
minio:
|
2019-08-14 10:33:49 -04:00
|
|
|
extends:
|
|
|
|
|
file: docker-compose.common.yml
|
|
|
|
|
service: minio
|
2026-05-11 06:06:59 -04:00
|
|
|
azurite:
|
|
|
|
|
extends:
|
|
|
|
|
file: docker-compose.common.yml
|
|
|
|
|
service: azurite
|
2018-12-10 11:58:09 -05:00
|
|
|
inbucket:
|
2019-08-14 10:33:49 -04:00
|
|
|
extends:
|
|
|
|
|
file: docker-compose.common.yml
|
|
|
|
|
service: inbucket
|
2018-12-10 11:58:09 -05:00
|
|
|
openldap:
|
2019-08-14 10:33:49 -04:00
|
|
|
extends:
|
|
|
|
|
file: docker-compose.common.yml
|
|
|
|
|
service: openldap
|
2018-12-10 11:58:09 -05:00
|
|
|
elasticsearch:
|
2019-08-14 10:33:49 -04:00
|
|
|
extends:
|
|
|
|
|
file: docker-compose.common.yml
|
|
|
|
|
service: elasticsearch
|
2024-07-11 03:43:31 -04:00
|
|
|
opensearch:
|
|
|
|
|
extends:
|
|
|
|
|
file: docker-compose.common.yml
|
|
|
|
|
service: opensearch
|
2024-09-18 09:43:44 -04:00
|
|
|
redis:
|
|
|
|
|
extends:
|
|
|
|
|
file: docker-compose.common.yml
|
|
|
|
|
service: redis
|
2020-07-13 16:29:39 -04:00
|
|
|
dejavu:
|
|
|
|
|
extends:
|
|
|
|
|
file: docker-compose.common.yml
|
|
|
|
|
service: dejavu
|
|
|
|
|
keycloak:
|
|
|
|
|
extends:
|
|
|
|
|
file: docker-compose.common.yml
|
|
|
|
|
service: keycloak
|
2021-01-19 21:28:22 -05:00
|
|
|
prometheus:
|
|
|
|
|
extends:
|
|
|
|
|
file: docker-compose.common.yml
|
|
|
|
|
service: prometheus
|
|
|
|
|
grafana:
|
|
|
|
|
extends:
|
|
|
|
|
file: docker-compose.common.yml
|
|
|
|
|
service: grafana
|
2024-05-16 11:16:08 -04:00
|
|
|
loki:
|
|
|
|
|
extends:
|
|
|
|
|
file: docker-compose.common.yml
|
|
|
|
|
service: loki
|
MM-67668: Replace Promtail with OpenTelemetry collector (#35381)
* Add container name to Docker logs
This will allow for querying Loki by container's name:
{job="docker",container_name="mattermost-postgres"}
* Configue Loki to prepare for OTLP ingestion
- Add a volume to Loki container to get the config
- Configure Loki with the expected labels so that we can query by job,
app, container.name...
* Add OpenTelemetry collector configuration
There are three pipelines:
1. logs/mattermost scrapes the logs from mattermost.log, parsing the
timestamp and severity, and pushes them to Loki.
2. logs/docker scrapes the Docker logs from *-json.log, parsing the
timestamp, the log itself and the container name, and pushes them to Loki.
3. metrics/docker scrapes the Docker socket to retrieve the containers'
uptime values and pushes them to Prometheus.
* Replace Promtail with OpenTelemetry collector
* Update build tooling for OpenTelemetry collector
1. Make sure that the logs directory is created
2. Swap Promtail with OpenTelemetry collector
* Scrape collector to get Docker stats
Prometheus needs to scrape the OpenTelemetry collector in the exposed
port to get the Docker stats, so that we can query the uptime with
metric container_uptime_seconds, which has a container_name label to
filter by container.
* Update Grafana dashboard for Docker health checks
1. Use Prometheus as the datasource in all queries
2. Simplify the mappings to either 0 (offline, red) or 1 (online,
green).
3. Unify all queries on container_uptime_seconds, filtering by
container_name, and making sure that the latest value we got is at most
15 seconds old, so that it does not show stale data.
4. Add Redis health check, that was missing
5. Update the dashboard title to Docker containers
* Tune Loki and OTel collector configs for local dev
- Switch filelog receivers to start_at: beginning so existing logs are
ingested on collector startup, not just new entries.
- Fix Docker log timestamp layout to use 9s (variable-length nanos)
instead of 0s (fixed-width), matching actual Docker JSON log format.
- Add ingester max_chunk_age to keep chunks open longer in the
single-instance dev setup, so that we can ingest older logs (the
window is max_chunk_age/2).
- Relax Loki limits for local development: allow unordered writes,
disable old-sample rejection, and raise ingestion rate/burst to 64 MB
to avoid throttling during bulk ingest.
2026-02-27 10:48:17 -05:00
|
|
|
otel-collector:
|
2024-05-16 11:16:08 -04:00
|
|
|
extends:
|
|
|
|
|
file: docker-compose.common.yml
|
MM-67668: Replace Promtail with OpenTelemetry collector (#35381)
* Add container name to Docker logs
This will allow for querying Loki by container's name:
{job="docker",container_name="mattermost-postgres"}
* Configue Loki to prepare for OTLP ingestion
- Add a volume to Loki container to get the config
- Configure Loki with the expected labels so that we can query by job,
app, container.name...
* Add OpenTelemetry collector configuration
There are three pipelines:
1. logs/mattermost scrapes the logs from mattermost.log, parsing the
timestamp and severity, and pushes them to Loki.
2. logs/docker scrapes the Docker logs from *-json.log, parsing the
timestamp, the log itself and the container name, and pushes them to Loki.
3. metrics/docker scrapes the Docker socket to retrieve the containers'
uptime values and pushes them to Prometheus.
* Replace Promtail with OpenTelemetry collector
* Update build tooling for OpenTelemetry collector
1. Make sure that the logs directory is created
2. Swap Promtail with OpenTelemetry collector
* Scrape collector to get Docker stats
Prometheus needs to scrape the OpenTelemetry collector in the exposed
port to get the Docker stats, so that we can query the uptime with
metric container_uptime_seconds, which has a container_name label to
filter by container.
* Update Grafana dashboard for Docker health checks
1. Use Prometheus as the datasource in all queries
2. Simplify the mappings to either 0 (offline, red) or 1 (online,
green).
3. Unify all queries on container_uptime_seconds, filtering by
container_name, and making sure that the latest value we got is at most
15 seconds old, so that it does not show stale data.
4. Add Redis health check, that was missing
5. Update the dashboard title to Docker containers
* Tune Loki and OTel collector configs for local dev
- Switch filelog receivers to start_at: beginning so existing logs are
ingested on collector startup, not just new entries.
- Fix Docker log timestamp layout to use 9s (variable-length nanos)
instead of 0s (fixed-width), matching actual Docker JSON log format.
- Add ingester max_chunk_age to keep chunks open longer in the
single-instance dev setup, so that we can ingest older logs (the
window is max_chunk_age/2).
- Relax Loki limits for local development: allow unordered writes,
disable old-sample rejection, and raise ingestion rate/burst to 64 MB
to avoid throttling during bulk ingest.
2026-02-27 10:48:17 -05:00
|
|
|
service: otel-collector
|
2019-08-06 08:33:40 -04:00
|
|
|
|
2018-12-10 11:58:09 -05:00
|
|
|
start_dependencies:
|
|
|
|
|
image: mattermost/mattermost-wait-for-dep:latest
|
|
|
|
|
networks:
|
|
|
|
|
- mm-test
|
|
|
|
|
depends_on:
|
|
|
|
|
- postgres
|
|
|
|
|
- minio
|
2026-05-11 06:06:59 -04:00
|
|
|
- azurite
|
2018-12-10 11:58:09 -05:00
|
|
|
- inbucket
|
|
|
|
|
- openldap
|
|
|
|
|
- elasticsearch
|
2024-07-11 03:43:31 -04:00
|
|
|
- opensearch
|
2024-09-18 09:43:44 -04:00
|
|
|
- redis
|
2026-05-11 06:06:59 -04:00
|
|
|
command: postgres:5432 minio:9000 azurite:10000 inbucket:9001 openldap:389 elasticsearch:9200 opensearch:9201 redis:6379
|
2018-12-10 11:58:09 -05:00
|
|
|
|
|
|
|
|
networks:
|
|
|
|
|
mm-test:
|
|
|
|
|
driver: bridge
|
