From d0631558c741f6949087a197a9b4a57e5b20547c Mon Sep 17 00:00:00 2001
From: Florent Daigniere
Date: Thu, 24 Nov 2022 16:23:53 +0100
Subject: [PATCH] Remove Swarm everywhere.
This hasn't been tested
---
docs/contributors/environment.rst | 4 +-
docs/contributors/guidelines.rst | 2 +-
docs/faq.rst | 6 +-
docs/swarm/1.5/README.md | 364 ------------------
docs/swarm/master/README.md | 337 ----------------
docs/swarm/master/README_nfs_example.md | 357 -----------------
setup/flavors/stack/docker-compose.yml | 139 -------
setup/flavors/stack/mailu.env | 1 -
setup/flavors/stack/setup.html | 65 ----
setup/server.py | 10 +-
.../templates/steps/compose/02_services.html | 2 +-
setup/templates/steps/compose/03_expose.html | 2 +-
setup/templates/steps/config.html | 13 +-
setup/templates/steps/flavor.html | 13 -
setup/templates/steps/stack/02_services.html | 62 ---
setup/templates/steps/stack/03_expose.html | 24 --
setup/templates/wizard.html | 6 -
17 files changed, 9 insertions(+), 1398 deletions(-)
delete mode 100644 docs/swarm/1.5/README.md
delete mode 100644 docs/swarm/master/README.md
delete mode 100644 docs/swarm/master/README_nfs_example.md
delete mode 100644 setup/flavors/stack/docker-compose.yml
delete mode 120000 setup/flavors/stack/mailu.env
delete mode 100644 setup/flavors/stack/setup.html
delete mode 100644 setup/templates/steps/flavor.html
delete mode 100644 setup/templates/steps/stack/02_services.html
delete mode 100644 setup/templates/steps/stack/03_expose.html
diff --git a/docs/contributors/environment.rst b/docs/contributors/environment.rst
index 5949fbe5..25f6fbc0 100644
--- a/docs/contributors/environment.rst
+++ b/docs/contributors/environment.rst
@@ -130,8 +130,8 @@ To re-build only specific containers at a later time.
docker buildx bake -f tests/build.hcl admin webdav
-If you have to push the images to Docker Hub for testing in Docker Swarm or a remote
-host, you have to define ``DOCKER_ORG`` (usually your Docker user-name) and login to
+If you have to push the images to Docker Hub for testing, you have to
+define ``DOCKER_ORG`` (usually your Docker user-name) and login to
the hub.
.. code-block:: bash
diff --git a/docs/contributors/guidelines.rst b/docs/contributors/guidelines.rst
index d55f9adf..8644d83e 100644
--- a/docs/contributors/guidelines.rst
+++ b/docs/contributors/guidelines.rst
@@ -54,7 +54,7 @@ Architecture
What setups should be supported
```````````````````````````````
-Mailu supports out-of-the-box Docker Compose, Docker Swarm and Kubernetes
+Mailu supports out-of-the-box Docker Compose and Kubernetes
environments. In those environments, it consists of many containers and
supports hosting some of those containers in a separate environment.
diff --git a/docs/faq.rst b/docs/faq.rst
index 7782e93c..bd0f4d17 100644
--- a/docs/faq.rst
+++ b/docs/faq.rst
@@ -195,9 +195,8 @@ Mailu will start to function on IPv6:
How does Mailu scale up?
````````````````````````
-Recent works allow Mailu to be deployed in Docker Swarm and Kubernetes.
-This means it can be scaled horizontally. For more information, refer to :ref:`kubernetes`
-or the `Docker swarm howto`_.
+Recent works allow Mailu to be deployed in Docker Kubernetes.
+This means it can be scaled horizontally. For more information, refer to :ref:`kubernetes`.
*Issue reference:* `165`_, `520`_.
@@ -360,7 +359,6 @@ How do I use webdav (radicale)?
.. _`Rspamd`: https://www.rspamd.com/doc/configuration/index.html
.. _`Roundcube`: https://github.com/roundcube/roundcubemail/wiki/Configuration#customize-the-look
-.. _`Docker swarm howto`: https://github.com/Mailu/Mailu/tree/master/docs/swarm/master
.. _`125`: https://github.com/Mailu/Mailu/issues/125
.. _`165`: https://github.com/Mailu/Mailu/issues/165
.. _`177`: https://github.com/Mailu/Mailu/issues/177
diff --git a/docs/swarm/1.5/README.md b/docs/swarm/1.5/README.md
deleted file mode 100644
index 5af4c9dd..00000000
--- a/docs/swarm/1.5/README.md
+++ /dev/null
@@ -1,364 +0,0 @@
-# Install Mailu on a docker swarm
-
-## Prerequisites
-
-### Swarm
-
-In order to deploy Mailu on a swarm, you will first need to initialize the swarm:
-
-The main command will be:
-```bash
-docker swarm init --advertise-addr
-```
-See https://docs.docker.com/engine/swarm/swarm-tutorial/create-swarm/
-
-If you want to add other managers or workers, please use:
-```bash
-docker swarm join --token xxxxx
-```
-See https://docs.docker.com/engine/swarm/join-nodes/
-
-You have now a working swarm, and you can check its status with:
-```bash
-core@coreos-01 ~/git/Mailu/docs/swarm/1.5 $ docker node ls
-ID HOSTNAME STATUS AVAILABILITY MANAGER STATUS ENGINE VERSION
-xhgeekkrlttpmtgmapt5hyxrb black-pearl Ready Active 18.06.0-ce
-sczlqjgfhehsfdjhfhhph1nvb * coreos-01 Ready Active Leader 18.03.1-ce
-mzrm9nbdggsfz4sgq6dhs5i6n flying-dutchman Ready Active 18.06.0-ce
-```
-
-### Volume definition
-For data persistence (the Mailu services might be launched/relaunched on any of the swarm nodes), we need to have Mailu data stored in a manner accessible by every manager or worker in the swarm.
-Hereafter we will use a NFS share:
-```bash
-core@coreos-01 ~ $ showmount -e 192.168.0.30
-Export list for 192.168.0.30:
-/mnt/Pool1/pv 192.168.0.0
-```
-
-on the nfs server, I am using the following /etc/exports
-```bash
-$more /etc/exports
-/mnt/Pool1/pv -alldirs -mapall=root -network 192.168.0.0 -mask 255.255.255.0
-```
-on the nfs server, I created the Mailu directory (in fact I copied a working Mailu set-up)
-```bash
-$mkdir /mnt/Pool1/pv/mailu
-```
-
-On your manager node, mount the nfs share to check that the share is available:
-```bash
-core@coreos-01 ~ $ sudo mount -t nfs 192.168.0.30:/mnt/Pool1/pv/mailu /mnt/local/
-```
-If this is ok, you can umount it:
-```bash
-core@coreos-01 ~ $ sudo umount /mnt/local/
-```
-
-
-### Networking mode
-On a swarm, the services are available (default mode) through a routing mesh managed by docker itself. With this mode, each service is given a virtual IP adress and docker manages the routing between this virtual IP and the container(s) provinding this service.
-With this default networking mode, I cannot get login working properly... As found in https://github.com/Mailu/Mailu/issues/375 , a workaround is to use the dnsrr networking mode at least for the front services.
-
-The main consequence/limitation will be that the front services will *not* be available on every node, but only on the node where it will be deployed. In my case, I have only one manager and I choose to deploy the front service to the manager node, so I know on wich IP the front service will be available (aka the IP adress of my manager node).
-
-### Variable substitution and docker-compose.yml
-The docker stack deploy command doesn't support variable substitution in the .yml file itself (but we still can use .env file to pass variables to the services). As a consequence we need to adjust the docker-compose file in order to :
-- remove all variables : $VERSION , $BIND_ADDRESS4 , $BIND_ADDRESS6 , $ANTIVIRUS , $WEBMAIL , etc
-- change the way we define the volumes (nfs share in our case)
-- add a deploy section for every service
-
-### Docker compose
-An example of docker-compose-stack.yml file is available here:
-
-```yaml
-
-version: '3.2'
-
-services:
-
- front:
- image: mailu/nginx:1.5
- env_file: .env
- ports:
- - target: 80
- published: 80
- mode: host
- - target: 443
- published: 443
- mode: host
- - target: 110
- published: 110
- mode: host
- - target: 143
- published: 143
- mode: host
- - target: 993
- published: 993
- mode: host
- - target: 995
- published: 995
- mode: host
- - target: 25
- published: 25
- mode: host
- - target: 465
- published: 465
- mode: host
- - target: 587
- published: 587
- mode: host
- volumes:
-# - "$ROOT/certs:/certs"
- - type: volume
- source: mailu_certs
- target: /certs
- deploy:
- endpoint_mode: dnsrr
- replicas: 1
- placement:
- constraints: [node.role == manager]
-
- redis:
- image: redis:alpine
- restart: always
- volumes:
-# - "$ROOT/redis:/data"
- - type: volume
- source: mailu_redis
- target: /data
- deploy:
- endpoint_mode: dnsrr
- replicas: 1
- placement:
- constraints: [node.role == manager]
-
- imap:
- image: mailu/dovecot:1.5
- restart: always
- env_file: .env
- volumes:
-# - "$ROOT/data:/data"
- - type: volume
- source: mailu_data
- target: /data
-# - "$ROOT/mail:/mail"
- - type: volume
- source: mailu_mail
- target: /mail
-# - "$ROOT/overrides:/overrides"
- - type: volume
- source: mailu_overrides
- target: /overrides
- depends_on:
- - front
- deploy:
- endpoint_mode: dnsrr
- replicas: 1
- placement:
- constraints: [node.role == manager]
-
- smtp:
- image: mailu/postfix:1.5
- restart: always
- env_file: .env
- volumes:
-# - "$ROOT/data:/data"
- - type: volume
- source: mailu_data
- target: /data
-# - "$ROOT/overrides:/overrides"
- - type: volume
- source: mailu_overrides
- target: /overrides
- depends_on:
- - front
- deploy:
- endpoint_mode: dnsrr
- replicas: 1
- placement:
- constraints: [node.role == manager]
-
- antispam:
- image: mailu/rspamd:1.5
- restart: always
- env_file: .env
- depends_on:
- - front
- volumes:
-# - "$ROOT/filter:/var/lib/rspamd"
- - type: volume
- source: mailu_filter
- target: /var/lib/rspamd
-# - "$ROOT/dkim:/dkim"
- - type: volume
- source: mailu_dkim
- target: /dkim
-# - "$ROOT/overrides/rspamd:/etc/rspamd/override.d"
- - type: volume
- source: mailu_overrides_rspamd
- target: /etc/rspamd/override.d
- deploy:
- endpoint_mode: dnsrr
- replicas: 1
- placement:
- constraints: [node.role == manager]
-
- antivirus:
- image: mailu/none:1.5
- restart: always
- env_file: .env
- volumes:
-# - "$ROOT/filter:/data"
- - type: volume
- source: mailu_filter
- target: /data
- deploy:
- endpoint_mode: dnsrr
- replicas: 1
- placement:
- constraints: [node.role == manager]
-
- webdav:
- image: mailu/none:1.5
- restart: always
- env_file: .env
- volumes:
-# - "$ROOT/dav:/data"
- - type: volume
- source: mailu_dav
- target: /data
- deploy:
- endpoint_mode: dnsrr
- replicas: 1
- placement:
- constraints: [node.role == manager]
-
- admin:
- image: mailu/admin:1.5
- restart: always
- env_file: .env
- volumes:
-# - "$ROOT/data:/data"
- - type: volume
- source: mailu_data
- target: /data
-# - "$ROOT/dkim:/dkim"
- - type: volume
- source: mailu_dkim
- target: /dkim
- - /var/run/docker.sock:/var/run/docker.sock:ro
- depends_on:
- - redis
- deploy:
- endpoint_mode: dnsrr
- replicas: 1
- placement:
- constraints: [node.role == manager]
-
- webmail:
- image: "mailu/roundcube:1.5"
- restart: always
- env_file: .env
- volumes:
-# - "$ROOT/webmail:/data"
- - type: volume
- source: mailu_data
- target: /data
- depends_on:
- - imap
- deploy:
- endpoint_mode: dnsrr
- replicas: 1
- placement:
- constraints: [node.role == manager]
-
- fetchmail:
- image: mailu/fetchmail:1.5
- restart: always
- env_file: .env
- volumes:
-# - "$ROOT/data:/data"
- - type: volume
- source: mailu_data
- target: /data
- logging:
- driver: none
- deploy:
- endpoint_mode: dnsrr
- replicas: 1
- placement:
- constraints: [node.role == manager]
-
-volumes:
- mailu_filter:
- driver_opts:
- type: "nfs"
- o: "addr=192.168.0.30,nolock,soft,rw"
- device: ":/mnt/Pool1/pv/mailu/filter"
- mailu_dkim:
- driver_opts:
- type: "nfs"
- o: "addr=192.168.0.30,nolock,soft,rw"
- device: ":/mnt/Pool1/pv/mailu/dkim"
- mailu_overrides_rspamd:
- driver_opts:
- type: "nfs"
- o: "addr=192.168.0.30,nolock,soft,rw"
- device: ":/mnt/Pool1/pv/mailu/overrides/rspamd"
- mailu_data:
- driver_opts:
- type: "nfs"
- o: "addr=192.168.0.30,nolock,soft,rw"
- device: ":/mnt/Pool1/pv/mailu/data"
- mailu_mail:
- driver_opts:
- type: "nfs"
- o: "addr=192.168.0.30,nolock,soft,rw"
- device: ":/mnt/Pool1/pv/mailu/mail"
- mailu_overrides:
- driver_opts:
- type: "nfs"
- o: "addr=192.168.0.30,nolock,soft,rw"
- device: ":/mnt/Pool1/pv/mailu/overrides"
- mailu_dav:
- driver_opts:
- type: "nfs"
- o: "addr=192.168.0.30,nolock,soft,rw"
- device: ":/mnt/Pool1/pv/mailu/dav"
- mailu_certs:
- driver_opts:
- type: "nfs"
- o: "addr=192.168.0.30,nolock,soft,rw"
- device: ":/mnt/Pool1/pv/mailu/certs"
- mailu_redis:
- driver_opts:
- type: "nfs"
- o: "addr=192.168.0.30,nolock,soft,rw"
- device: ":/mnt/Pool1/pv/mailu/redis"
-```
-
-### Deploy Mailu on the docker swarm
-Run the following command:
-```bash
-docker stack deploy -c docker-compose-stack.yml mailu
-```
-See how the services are being deployed:
-```bash
-core@coreos-01 ~ $ docker service ls
-ID NAME MODE REPLICAS IMAGE PORTS
-ywnsetmtkb1l mailu_antivirus replicated 1/1 mailu/none:1.5
-pqokiaz0q128 mailu_fetchmail replicated 1/1 mailu/fetchmail:1.5
-```
-check a specific service:
-```bash
-core@coreos-01 ~ $ docker service ps mailu_fetchmail
-ID NAME IMAGE NODE DESIRED STATE CURRENT STATE ERROR PORTS
-tbu8ppgsdffj mailu_fetchmail.1 mailu/fetchmail:1.5 coreos-01 Running Running 11 days ago
-```
-
-### Remove the stack
-Run the following command:
-```bash
-core@coreos-01 ~ $ docker stack rm mailu
-```
diff --git a/docs/swarm/master/README.md b/docs/swarm/master/README.md
deleted file mode 100644
index 56cec36d..00000000
--- a/docs/swarm/master/README.md
+++ /dev/null
@@ -1,337 +0,0 @@
-# Install Mailu on a docker swarm
-
-## Some warnings
-
-### How Docker swarm works
-
-Docker swarm enables replication and fail-over scenarios. As a feature, if a node dies or goes away, Docker will re-schedule it's containers on the remaining nodes.
-In order to take this decisions, docker swarm works on a consensus between managers regarding the state of nodes. Therefore it recommends to always have an uneven amount of manager nodes. This will always give a majority on either halve of a potential network split.
-
-### Storage
-
-On top of this some of Mailu's containers heavily rely on disk storage. As noted below, every host will need the same dataset on every host where related containers are run. So Dovecot IMAP needs `/mailu/mail` replicated to every node it *may* be scheduled to run. There are various solutions for this like NFS and GlusterFS.
-
-### When disaster strikes
-
-So imagine 3 swarm nodes and 3 GlusterFS endpoints:
-
-```
-node-A -> gluster-A --|
-node-B -> gluster-B --|--> Single file system
-node-C -> gluster-C --|
-```
-
-Each node has a connection to the shared file system and maintains connections between the other nodes. Let's say Dovecot is running on `node-A`. Now a network error / outage occurs on the route between `node-A` and the remaining nodes, but stays connected to the `gluster-A` endpoint. `node-B` and `node-C` conclude that `node-A` is down. They reschedule Dovecot to start on either one of them. Dovecot starts reading and writing its indexes to the **shared** filesystem. However, it is possible the Dovecot on `node-A` is still up and handling some client requests. I've seen cases where this situations resulted in:
-
-- Retained locks
-- Corrupted indexes
-- Users no longer able to read any of mail
-- Lost mail
-
-### It gets funkier
-
-Our original deployment also included `main.db` on the GlusterFS. Due to the above we corrupted it once and we decided to move it to local storage and restirct the `admin` container to that host only. This inspired us to put some legwork is supporting different database back-ends like MySQL and PostgreSQL. We highly recommend to use either of them, in favor of sqlite.
-
-### Conclusion
-
-Although the above situation is less-likely to occur on a stable (local) network, it does indicate a failure case where there is a probability of data-loss or downtime. It may help to create redundant networks, but the effort might be too much for the actual results. We will need to look into better and safer methods of replicating mail data. For now, we regret to have to inform you that Docker swarm deployment is **unstable** and should be avoided in production environments.
-
--- @muhlemmer, 17th of January 2019.
-
-## Prerequisites
-
-### Swarm
-
-In order to deploy Mailu on a swarm, you will first need to initialize the swarm:
-
-The main command will be:
-```bash
-docker swarm init --advertise-addr
-```
-See https://docs.docker.com/engine/swarm/swarm-tutorial/create-swarm/
-
-If you want to add other managers or workers, please use:
-```bash
-docker swarm join --token xxxxx
-```
-See https://docs.docker.com/engine/swarm/join-nodes/
-
-You have now a working swarm, and you can check its status with:
-```bash
-core@coreos-01 ~/git/Mailu/docs/swarm/1.5 $ docker node ls
-ID HOSTNAME STATUS AVAILABILITY MANAGER STATUS ENGINE VERSION
-xhgeekkrlttpmtgmapt5hyxrb black-pearl Ready Active 18.06.0-ce
-sczlqjgfhehsfdjhfhhph1nvb * coreos-01 Ready Active Leader 18.03.1-ce
-mzrm9nbdggsfz4sgq6dhs5i6n flying-dutchman Ready Active 18.06.0-ce
-```
-
-### Volume definition
-For data persistence (the Mailu services might be launched/relaunched on any of the swarm nodes), we need to have Mailu data stored in a manner accessible by every manager or worker in the swarm.
-
-Hereafter we will assume that "Mailu Data" is available on every node at "$ROOT" (GlusterFS and nfs shares have been successfully used).
-
-On this example, we are using:
-- the mesh routing mode (default mode). With this mode, each service is given a virtual IP adress and docker manages the routing between this virtual IP and the container(s) providing this service.
-- the default ingress mode.
-
-### Allow authentification with the mesh routing
-In order to allow every (front & webmail) container to access the other services, we will use the variable SUBNET.
-
-Let's create the mailu_default network:
-```bash
-core@coreos-01 ~ $ docker network create -d overlay --attachable mailu_default
-core@coreos-01 ~ $ docker network inspect mailu_default | grep Subnet
- "Subnet": "10.0.1.0/24",
-```
-In the docker-compose.yml file, we will then use SUBNET = 10.0.1.0/24
-In fact, imap & smtp logs doesn't show the IPs from the front(s) container(s), but the IP of "mailu_default-endpoint". So it is sufficient to set SUBNET to this specific ip (which can be found by inspecting mailu_default network). The issue is that this endpoint is created while the stack is created, I did'nt figure a way to determine this IP before the stack creation...
-
-### Limitation with the ingress mode
-With the default ingress mode, the front(s) container(s) will see origin IP(s) all being 10.255.0.x (which is the ingress-endpoint, can be found by inspecting the ingress network)
-
-This issue is known and discussed here:
-
-https://github.com/moby/moby/issues/25526
-
-A workaround (using network host mode and global deployment) is discussed here:
-
-https://github.com/moby/moby/issues/25526#issuecomment-336363408
-
-### Don't create an open relay !
-As a side effect of this ingress mode "feature", make sure that the ingress subnet is not in your RELAYHOST, otherwise you would create an smtp open relay :-(
-
-### Ratelimits
-
-When using ingress mode you probably want to disable rate limits, because all requests originate from the same ip address. Otherwise automatic login attempts can easily DoS the legitimate users.
-
-## Scalability
-- smtp and imap are scalable
-- front and webmail are scalable (pending SUBNET is used), although the let's encrypt magic might not like it (race condidtion ? or risk to be banned by let's encrypt server if too many front containers attemps to renew the certs at the same time)
-- redis, antispam, antivirus, fetchmail, admin, webdav have not been tested (hence replicas=1 in the following docker-compose.yml file)
-
-## Docker secrets
-There are DB_PW_FILE and SECRET_KEY_FILE environment variables available to specify files for these variables. These can be used to configure Docker secrets instead of writing the values directly into the `docker-compose.yml` or `mailu.env`.
-
-## Variable substitution and docker-compose.yml
-The docker stack deploy command doesn't support variable substitution in the .yml file itself.
-As a consequence, we cannot simply use ``` docker stack deploy -c docker.compose.yml mailu ```
-Instead, we will use the following work-around:
-``` echo "$(docker-compose -f /mnt/docker/apps/mailu/docker-compose.yml config 2>/dev/null)" | docker stack deploy -c- mailu ```
-
-We need also to:
-- add a deploy section for every service
-- modify the way the ports are defined for the front service
-- add the SUBNET definition for admin (for imap), smtp and antispam services
-
-## Docker compose
-An example of docker-compose-stack.yml file is available here:
-
-```yaml
-
-version: '3.2'
-
-services:
-
- front:
- image: mailu/nginx:$VERSION
- restart: always
- env_file: .env
- ports:
- - target: 80
- published: 80
- - target: 443
- published: 443
- - target: 110
- published: 110
- - target: 143
- published: 143
- - target: 993
- published: 993
- - target: 995
- published: 995
- - target: 25
- published: 25
- - target: 465
- published: 465
- - target: 587
- published: 587
- volumes:
- - "$ROOT/certs:/certs"
- deploy:
- replicas: 2
-
- redis:
- image: redis:alpine
- restart: always
- volumes:
- - "$ROOT/redis:/data"
- deploy:
- replicas: 1
-
- imap:
- image: mailu/dovecot:$VERSION
- restart: always
- env_file: .env
- volumes:
- - "$ROOT/mail:/mail"
- - "$ROOT/overrides:/overrides"
- depends_on:
- - front
- deploy:
- replicas: 2
-
- smtp:
- image: mailu/postfix:$VERSION
- restart: always
- env_file: .env
- environment:
- - SUBNET=10.0.1.0/24
- volumes:
- - "$ROOT/overrides:/overrides"
- depends_on:
- - front
- deploy:
- replicas: 2
-
- antispam:
- image: mailu/rspamd:$VERSION
- restart: always
- env_file: .env
- environment:
- - SUBNET=10.0.1.0/24
- volumes:
- - "$ROOT/filter:/var/lib/rspamd"
- - "$ROOT/dkim:/dkim"
- - "$ROOT/overrides/rspamd:/etc/rspamd/override.d"
- depends_on:
- - front
- deploy:
- replicas: 1
-
- antivirus:
- image: mailu/none:$VERSION
- restart: always
- env_file: .env
- volumes:
- - "$ROOT/filter:/data"
- deploy:
- replicas: 1
-
- webdav:
- image: mailu/none:$VERSION
- restart: always
- env_file: .env
- volumes:
- - "$ROOT/dav:/data"
- deploy:
- replicas: 1
-
- admin:
- image: mailu/admin:$VERSION
- restart: always
- env_file: .env
- environment:
- - SUBNET=10.0.1.0/24
- volumes:
- - "$ROOT/data:/data"
- - "$ROOT/dkim:/dkim"
- - /var/run/docker.sock:/var/run/docker.sock:ro
- depends_on:
- - redis
- deploy:
- replicas: 1
-
- webmail:
- image: mailu/roundcube:$VERSION
- restart: always
- env_file: .env
- volumes:
- - "$ROOT/webmail:/data"
- depends_on:
- - imap
- deploy:
- replicas: 2
-
- fetchmail:
- image: mailu/fetchmail:$VERSION
- restart: always
- env_file: .env
- volumes:
- deploy:
- replicas: 1
-
-networks:
- default:
- external:
- name: mailu_default
-```
-
-## Deploy Mailu on the docker swarm
-Run the following command:
-```bash
-echo "$(docker-compose -f /mnt/docker/apps/mailu/docker-compose.yml config 2>/dev/null)" | docker stack deploy -c- mailu
-```
-See how the services are being deployed:
-```bash
-core@coreos-01 ~ $ docker service ls
-ID NAME MODE REPLICAS IMAGE PORTS
-ywnsetmtkb1l mailu_antivirus replicated 1/1 mailu/none:master
-pqokiaz0q128 mailu_fetchmail replicated 1/1 mailu/fetchmail:master
-```
-check a specific service:
-```bash
-core@coreos-01 ~ $ docker service ps mailu_fetchmail
-ID NAME IMAGE NODE DESIRED STATE CURRENT STATE ERROR PORTS
-tbu8ppgsdffj mailu_fetchmail.1 mailu/fetchmail:master coreos-01 Running Running 11 days ago
-```
-You might also have a look on the logs:
-```bash
-core@coreos-01 ~ $ docker service logs -f mailu_fetchmail
-```
-
-## Remove the stack
-Run the following command:
-```bash
-core@coreos-01 ~ $ docker stack rm mailu
-```
-
-## Notes on unbound resolver
-
-In Docker compose flavor we currently have the option to include the unbound DNS resolver. This does not work in Docker Swarm, as it in not possible to configure any static IP addresses. There is an [open issue](https://github.com/moby/moby/issues/24170) for this at Docker. However, this doesn't seem to move anywhere since some time now. For that reasons we've chosen not to include the unbound resolver in the stack flavor.
-
-If you still want to benefit from Unbound as a system resolver, you can install it system-wide. The following procedure was done on a Fedora 28 system and might needs some adjustments for your system. Note that this will need to be done on every swarm node. In this example we will make use of `dnssec-trigger`, which is used to configure unbound. When installing this and running the service, unbound is pulled in as dependency and does not need to be installed, configured or run separately.
-
-Install required packages(unbound will be installed as dependency):
-
-```
-sudo dnf install dnssec-trigger
-```
-
-Enable and start the *dnssec-trigger* daemon:
-
-```
-sudo systemctl enable --now dnssec-triggerd.service
-```
-
-Configure NetworkManager to use unbound, create the file `/etc/NetworkManager/conf.d/unbound.conf` with contents:
-
-```
-[main]
-dns=unbound
-```
-
-You might need to restart NetworkManager for the changes to take effect:
-
-```
-sudo systemctl restart NetworkManager
-```
-
-Verify `resolv.conf`:
-
-```
-$ cat /etc/resolv.conf
-# Generated by dnssec-trigger-script
-nameserver 127.0.0.1
-```
-
-Most of this info was take from this [Fedora Project page](https://fedoraproject.org/wiki/Changes/Default_Local_DNS_Resolver#How_To_Test).
diff --git a/docs/swarm/master/README_nfs_example.md b/docs/swarm/master/README_nfs_example.md
deleted file mode 100644
index 2c4b8145..00000000
--- a/docs/swarm/master/README_nfs_example.md
+++ /dev/null
@@ -1,357 +0,0 @@
-# Install Mailu on a docker swarm
-
-## Prequisites
-
-### Swarm
-
-In order to deploy Mailu on a swarm, you will first need to initialize the swarm:
-
-The main command will be:
-```bash
-docker swarm init --advertise-addr
-```
-See https://docs.docker.com/engine/swarm/swarm-tutorial/create-swarm/
-
-If you want to add other managers or workers, please use:
-```bash
-docker swarm join --token xxxxx
-```
-See https://docs.docker.com/engine/swarm/join-nodes/
-
-You have now a working swarm, and you can check its status with:
-```bash
-core@coreos-01 ~/git/Mailu/docs/swarm/1.5 $ docker node ls
-ID HOSTNAME STATUS AVAILABILITY MANAGER STATUS ENGINE VERSION
-xhgeekkrlttpmtgmapt5hyxrb black-pearl Ready Active 18.06.0-ce
-sczlqjgfhehsfdjhfhhph1nvb * coreos-01 Ready Active Leader 18.03.1-ce
-mzrm9nbdggsfz4sgq6dhs5i6n flying-dutchman Ready Active 18.06.0-ce
-```
-
-### Volume definition
-For data persistence (the Mailu services might be launched/relaunched on any of the swarm nodes), we need to have Mailu data stored in a manner accessible by every manager or worker in the swarm.
-Hereafter we will use a NFS share:
-```bash
-core@coreos-01 ~ $ showmount -e 192.168.0.30
-Export list for 192.168.0.30:
-/mnt/Pool1/pv 192.168.0.0
-```
-
-on the nfs server, I am using the following /etc/exports
-```bash
-$more /etc/exports
-/mnt/Pool1/pv -alldirs -mapall=root -network 192.168.0.0 -mask 255.255.255.0
-```
-on the nfs server, I created the Mailu directory (in fact I copied a working Mailu set-up)
-```bash
-$mkdir /mnt/Pool1/pv/mailu
-```
-
-On your manager node, mount the nfs share to check that the share is available:
-```bash
-core@coreos-01 ~ $ sudo mount -t nfs 192.168.0.30:/mnt/Pool1/pv/mailu /mnt/local/
-```
-If this is ok, you can umount it:
-```bash
-core@coreos-01 ~ $ sudo umount /mnt/local/
-```
-
-
-## Networking mode
-On this example, we are using:
-- the mesh routing mode (default mode). With this mode, each service is given a virtual IP address and docker manages the routing between this virtual IP and the container(s) providing this service.
-- the default ingress mode.
-
-### Allow authentification with the mesh routing
-In order to allow every (front & webmail) container to access the other services, we will use the variable SUBNET.
-
-Let's create the mailu_default network:
-```bash
-core@coreos-01 ~ $ docker network create -d overlay --attachable mailu_default
-core@coreos-01 ~ $ docker network inspect mailu_default | grep Subnet
- "Subnet": "10.0.1.0/24",
-```
-In the docker-compose.yml file, we will then use SUBNET = 10.0.1.0/24
-In fact, imap & smtp logs doesn't show the IPs from the front(s) container(s), but the IP of "mailu_default-endpoint". So it is sufficient to set SUBNET to this specific ip (which can be found by inspecting mailu_default network). The issue is that this endpoint is created while the stack is created, I did'nt figure a way to determine this IP before the stack creation...
-
-### Limitation with the ingress mode
-With the default ingress mode, the front(s) container(s) will see origin IP(s) all being 10.255.0.x (which is the ingress-endpoint, can be found by inspecting the ingress network)
-
-This issue is known and discussed here:
-
-https://github.com/moby/moby/issues/25526
-
-A workaround (using network host mode and global deployment) is discussed here:
-
-https://github.com/moby/moby/issues/25526#issuecomment-336363408
-
-### Don't create an open relay !
-As a side effect of this ingress mode "feature", make sure that the ingress subnet is not in your RELAYHOST, otherwise you would create an smtp open relay :-(
-
-
-## Scalability
-- smtp and imap are scalable
-- front and webmail are scalable (pending SUBNET is used), although the let's encrypt magic might not like it (race condidtion ? or risk to be banned by let's encrypt server if too many front containers attemps to renew the certs at the same time)
-- redis, antispam, antivirus, fetchmail, admin, webdav have not been tested (hence replicas=1 in the following docker-compose.yml file)
-
-## Variable substitution and docker-compose.yml
-The docker stack deploy command doesn't support variable substitution in the .yml file itself. As a consequence, we need to use the following work-around:
-``` echo "$(docker-compose -f /mnt/docker/apps/mailu/docker-compose.yml config 2>/dev/null)" | docker stack deploy -c- mailu ```
-
-We need also to:
-- change the way we define the volumes (nfs share in our case)
-- add a deploy section for every service
-- the way the ports are defined for the front service
-
-## Docker compose
-An example of docker-compose-stack.yml file is available here:
-
-```yaml
-
-version: '3.2'
-
-services:
-
- front:
- image: mailu/nginx:$VERSION
- restart: always
- env_file: .env
- ports:
- - target: 80
- published: 80
- - target: 443
- published: 443
- - target: 110
- published: 110
- - target: 143
- published: 143
- - target: 993
- published: 993
- - target: 995
- published: 995
- - target: 25
- published: 25
- - target: 465
- published: 465
- - target: 587
- published: 587
- volumes:
-# - "$ROOT/certs:/certs"
- - type: volume
- source: mailu_certs
- target: /certs
- deploy:
- replicas: 2
-
- redis:
- image: redis:alpine
- restart: always
- volumes:
-# - "$ROOT/redis:/data"
- - type: volume
- source: mailu_redis
- target: /data
- deploy:
- replicas: 1
-
- imap:
- image: mailu/dovecot:$VERSION
- restart: always
- env_file: .env
- volumes:
-# - "$ROOT/mail:/mail"
- - type: volume
- source: mailu_mail
- target: /mail
-# - "$ROOT/overrides:/overrides"
- - type: volume
- source: mailu_overrides
- target: /overrides
- depends_on:
- - front
- deploy:
- replicas: 2
-
- smtp:
- image: mailu/postfix:$VERSION
- restart: always
- env_file: .env
- environment:
- - SUBNET=10.0.1.0/24
- volumes:
-# - "$ROOT/overrides:/overrides"
- - type: volume
- source: mailu_overrides
- target: /overrides
- depends_on:
- - front
- deploy:
- replicas: 2
-
- antispam:
- image: mailu/rspamd:$VERSION
- restart: always
- env_file: .env
- environment:
- - SUBNET=10.0.1.0/24
- depends_on:
- - front
- volumes:
-# - "$ROOT/filter:/var/lib/rspamd"
- - type: volume
- source: mailu_filter
- target: /var/lib/rspamd
-# - "$ROOT/dkim:/dkim"
- - type: volume
- source: mailu_dkim
- target: /dkim
-# - "$ROOT/overrides/rspamd:/etc/rspamd/override.d"
- - type: volume
- source: mailu_overrides_rspamd
- target: /etc/rspamd/override.d
- deploy:
- replicas: 1
-
- antivirus:
- image: mailu/none:$VERSION
- restart: always
- env_file: .env
- volumes:
-# - "$ROOT/filter:/data"
- - type: volume
- source: mailu_filter
- target: /data
- deploy:
- replicas: 1
-
- webdav:
- image: mailu/none:$VERSION
- restart: always
- env_file: .env
- volumes:
-# - "$ROOT/dav:/data"
- - type: volume
- source: mailu_dav
- target: /data
- deploy:
- replicas: 1
-
- admin:
- image: mailu/admin:$VERSION
- restart: always
- env_file: .env
- environment:
- - SUBNET=10.0.1.0/24
- volumes:
-# - "$ROOT/data:/data"
- - type: volume
- source: mailu_data
- target: /data
-# - "$ROOT/dkim:/dkim"
- - type: volume
- source: mailu_dkim
- target: /dkim
- - /var/run/docker.sock:/var/run/docker.sock:ro
- depends_on:
- - redis
- deploy:
- replicas: 1
-
- webmail:
- image: mailu/roundcube:$VERSION
- restart: always
- env_file: .env
- volumes:
-# - "$ROOT/webmail:/data"
- - type: volume
- source: mailu_data
- target: /data
- depends_on:
- - imap
- deploy:
- replicas: 2
-
- fetchmail:
- image: mailu/fetchmail:$VERSION
- restart: always
- env_file: .env
- volumes:
- deploy:
- replicas: 1
-
-networks:
- default:
- external:
- name: mailu_default
-
-volumes:
- mailu_filter:
- driver_opts:
- type: "nfs"
- o: "addr=192.168.0.30,soft,rw"
- device: ":/mnt/Pool1/pv/mailu/filter"
- mailu_dkim:
- driver_opts:
- type: "nfs"
- o: "addr=192.168.0.30,soft,rw"
- device: ":/mnt/Pool1/pv/mailu/dkim"
- mailu_overrides_rspamd:
- driver_opts:
- type: "nfs"
- o: "addr=192.168.0.30,soft,rw"
- device: ":/mnt/Pool1/pv/mailu/overrides/rspamd"
- mailu_data:
- driver_opts:
- type: "nfs"
- o: "addr=192.168.0.30,soft,rw"
- device: ":/mnt/Pool1/pv/mailu/data"
- mailu_mail:
- driver_opts:
- type: "nfs"
- o: "addr=192.168.0.30,soft,rw"
- device: ":/mnt/Pool1/pv/mailu/mail"
- mailu_overrides:
- driver_opts:
- type: "nfs"
- o: "addr=192.168.0.30,soft,rw"
- device: ":/mnt/Pool1/pv/mailu/overrides"
- mailu_dav:
- driver_opts:
- type: "nfs"
- o: "addr=192.168.0.30,soft,rw"
- device: ":/mnt/Pool1/pv/mailu/dav"
- mailu_certs:
- driver_opts:
- type: "nfs"
- o: "addr=192.168.0.30,soft,rw"
- device: ":/mnt/Pool1/pv/mailu/certs"
- mailu_redis:
- driver_opts:
- type: "nfs"
- o: "addr=192.168.0.30,soft,rw"
- device: ":/mnt/Pool1/pv/mailu/redis"
-```
-
-## Deploy Mailu on the docker swarm
-Run the following command:
-```bash
-echo "$(docker-compose -f /mnt/docker/apps/mailu/docker-compose.yml config 2>/dev/null)" | docker stack deploy -c- mailu
-```
-See how the services are being deployed:
-```bash
-core@coreos-01 ~ $ docker service ls
-ID NAME MODE REPLICAS IMAGE PORTS
-ywnsetmtkb1l mailu_antivirus replicated 1/1 mailu/none:master
-pqokiaz0q128 mailu_fetchmail replicated 1/1 mailu/fetchmail:master
-```
-check a specific service:
-```bash
-core@coreos-01 ~ $ docker service ps mailu_fetchmail
-ID NAME IMAGE NODE DESIRED STATE CURRENT STATE ERROR PORTS
-tbu8ppgsdffj mailu_fetchmail.1 mailu/fetchmail:master coreos-01 Running Running 11 days ago
-```
-
-## Remove the stack
-Run the following command:
-```bash
-core@coreos-01 ~ $ docker stack rm mailu
-```
diff --git a/setup/flavors/stack/docker-compose.yml b/setup/flavors/stack/docker-compose.yml
deleted file mode 100644
index 809362df..00000000
--- a/setup/flavors/stack/docker-compose.yml
+++ /dev/null
@@ -1,139 +0,0 @@
-{% set env='mailu.env' %}
-# This file is auto-generated by the Mailu configuration wizard.
-# Please read the documentation before attempting any change.
-# Generated for {{ flavor }} flavor
-
-version: '3.6'
-
-services:
-
-# External dependencies
- redis:
- image: redis:alpine
- volumes:
- - "{{ root }}/redis:/data"
-
-# Core services
- front:
- image: ${DOCKER_ORG:-mailu}/${DOCKER_PREFIX:-}nginx:${MAILU_VERSION:-{{ version }}}
- env_file: {{ env }}
- logging:
- driver: {{ log_driver or 'json-file' }}
- ports:
- {% for port in (80, 443, 25, 465, 587, 110, 995, 143, 993) %}
- - target: {{ port }}
- published: {{ port }}
- mode: overlay
- {% endfor %}
- volumes:
- - "{{ root }}/certs:/certs"
- - "{{ root }}/overrides/nginx:/overrides:ro"
- deploy:
- replicas: 1
-
- admin:
- image: ${DOCKER_ORG:-mailu}/${DOCKER_PREFIX:-}admin:${MAILU_VERSION:-{{ version }}}
- env_file: {{ env }}
- {% if not admin_enabled %}
- ports:
- - 127.0.0.1:8080:80
- {% endif %}
- volumes:
- - "{{ root }}/data:/data"
- - "{{ root }}/dkim:/dkim"
- deploy:
- replicas: 1
- healthcheck:
- disable: true
-
- imap:
- image: ${DOCKER_ORG:-mailu}/${DOCKER_PREFIX:-}dovecot:${MAILU_VERSION:-{{ version }}}
- env_file: {{ env }}
- volumes:
- - "{{ root }}/mail:/mail"
- - "{{ root }}/overrides/dovecot:/overrides:ro"
- deploy:
- replicas: 1
- healthcheck:
- disable: true
-
- smtp:
- image: ${DOCKER_ORG:-mailu}/${DOCKER_PREFIX:-}postfix:${MAILU_VERSION:-{{ version }}}
- env_file: {{ env }}
- volumes:
- - "{{ root }}/mailqueue:/queue"
- - "{{ root }}/overrides/postfix:/overrides:ro"
- deploy:
- replicas: 1
- healthcheck:
- disable: true
-
- antispam:
- image: ${DOCKER_ORG:-mailu}/${DOCKER_PREFIX:-}rspamd:${MAILU_VERSION:-{{ version }}}
- hostname: antispam
- env_file: {{ env }}
- volumes:
- - "{{ root }}/filter:/var/lib/rspamd"
- - "{{ root }}/overrides/rspamd:/etc/rspamd/override.d:ro"
- deploy:
- replicas: 1
- healthcheck:
- disable: true
-
- # Optional services
- {% if antivirus_enabled %}
- antivirus:
- image: ${DOCKER_ORG:-mailu}/${DOCKER_PREFIX:-}clamav:${MAILU_VERSION:-{{ version }}}
- env_file: {{ env }}
- volumes:
- - "{{ root }}/filter:/data"
- deploy:
- replicas: 1
- healthcheck:
- disable: true
- {% endif %}
-
- {% if webdav_enabled %}
- webdav:
- image: ${DOCKER_ORG:-mailu}/${DOCKER_PREFIX:-}radicale:${MAILU_VERSION:-{{ version }}}
- env_file: {{ env }}
- volumes:
- - "{{ root }}/dav:/data"
- deploy:
- replicas: 1
- healthcheck:
- disable: true
- {% endif %}
-
- {% if fetchmail_enabled %}
- fetchmail:
- image: ${DOCKER_ORG:-mailu}/${DOCKER_PREFIX:-}fetchmail:${MAILU_VERSION:-{{ version }}}
- env_file: {{ env }}
- volumes:
- - "{{ root }}/data/fetchmail:/data"
- deploy:
- replicas: 1
- healthcheck:
- disable: true
- {% endif %}
-
- {% if webmail_type != 'none' %}
- webmail:
- image: ${DOCKER_ORG:-mailu}/${DOCKER_PREFIX:-}webmail:${MAILU_VERSION:-{{ version }}}
- env_file: {{ env }}
- volumes:
- - "{{ root }}/webmail:/data"
- - "{{ root }}/overrides/{{ webmail_type }}:/overrides:ro"
- deploy:
- replicas: 1
- healthcheck:
- disable: true
- {% endif %}
-
-networks:
- default:
- driver: overlay
- ipam:
- driver: default
- config:
- - subnet: {{ subnet }}
diff --git a/setup/flavors/stack/mailu.env b/setup/flavors/stack/mailu.env
deleted file mode 120000
index 7123102b..00000000
--- a/setup/flavors/stack/mailu.env
+++ /dev/null
@@ -1 +0,0 @@
-../compose/mailu.env
\ No newline at end of file
diff --git a/setup/flavors/stack/setup.html b/setup/flavors/stack/setup.html
deleted file mode 100644
index 2a635562..00000000
--- a/setup/flavors/stack/setup.html
+++ /dev/null
@@ -1,65 +0,0 @@
-{% import "macros.html" as macros %}
-
-{% call macros.panel("info", "Step 1 - Download your configuration files") %}
-
Docker Stack expects a project file, named docker-compose.yml
-in a project directory. First create your project directory.
We did not insert any malicious code on purpose in the configurations we
-distribute, but your download could have been intercepted, or our wizard
-website could have been compromised, so make sure you check the configuration
-files before going any further.
-
-
When you are done checking them, check them one last time.
-
-In the docker stack deploy command, mailu is the app name. Feel free to change it.
-In order to display the running container you can use
-
docker ps
-or
-
docker stack ps --no-trunc mailu
-Command for removing docker stack is
-
docker stack rm mailu
-
-Before you can use Mailu, you must create the primary administrator user account. This should be {{ postmaster }}@{{ domain }}. Use the following command, changing PASSWORD to your liking:
-
-
Login to the admin interface to change the password for a safe one, at
-{% if admin_enabled %}
-one of the hostnames
-{{ hostnames.split(',')[0] }}{{ admin_path }}.
-{% else %}
-http://127.0.0.1:8080/ui (only directly from the host running docker).
-If you run mailu on a remote server, and wish to access the admin interface via a SSH tunnel, you can create a port-forward from your local machine to your server like
-
Mailu comes with multiple base features, including a specific admin
interface, Web email clients, antispam, antivirus, etc.
In this section you can enable the services to you liking.
diff --git a/setup/templates/steps/compose/03_expose.html b/setup/templates/steps/compose/03_expose.html
index 201ac3eb..c1d3ca8c 100644
--- a/setup/templates/steps/compose/03_expose.html
+++ b/setup/templates/steps/compose/03_expose.html
@@ -1,4 +1,4 @@
-{% call macros.panel("info", "Step 4 - expose Mailu to the world") %}
+{% call macros.panel("info", "Step 3 - expose Mailu to the world") %}
A mail server must be exposed to the world to receive emails, send emails,
and let users access their mailboxes. Mailu has some flexibility in the way
you expose it to the world.
diff --git a/setup/templates/steps/config.html b/setup/templates/steps/config.html
index 74a45800..ce7ade70 100644
--- a/setup/templates/steps/config.html
+++ b/setup/templates/steps/config.html
@@ -1,15 +1,4 @@
-{% if flavor == "stack" %}
-{% call macros.panel("danger", "Docker stack / swarm is experimental") %}
-Setup is capable of generating a somewhat decent docker-compose.yml,
-for the docker stack flavor. However its usage is for advanced users only and is experimental.
-Expect many challenges such as shared mail storage and fail-over scenarios! Some user experiences
-have been shared on GitHub.
-For this reason also think very hard about using a replica count higher than 1. This cannot be used with the default config.
-Manual post-configuration is required for using a replica count higher than 1.
-{% endcall %}
-{% endif %}
-
-{% call macros.panel("info", "Step 2 - Initial configuration") %}
+{% call macros.panel("info", "Step 1 - Initial configuration") %}
Mailu comes in multiple "flavors". It was originally
-designed to run on top of Docker Compose but now offers multiple options
-including Docker Stack, Rancher, Kubernetes.
-
Please note that "official" support, that is provided by the most active
-developers will mostly cover Compose and Stack, while other flavors are
-maintained by specific contributors.
-
-
- {{ macros.radio("flavor", "compose", "Compose", "simply using Docker Compose manager", flavor) }}
- {{ macros.radio("flavor", "stack", "Stack", "using stack deployments in a Swarm cluster", flavor) }}
-
Mailu comes with multiple base features, including a specific admin
-interface, Web email clients, antispam, antivirus, etc.
-In this section you can enable the services to you liking.
-
-
-
A Webmail is a Web interface exposing an email client. Mailu webmails are
-bound to the internal IMAP and SMTP server for users to access their mailbox through
-the Web. By exposing a complex application such as a Webmail, you should be aware of
-the security implications caused by such an increase of attack surface.
-
-
-
-
-
-
-
-
-
-
-
-
-
-
- An antivirus server helps fighting large scale virus spreading campaigns that leverage
- e-mail for initial infection. Make sure that you have at least 1GB of memory for ClamAV to
- load its signature database.
-
-
-
-
-
-
- A Webdav server exposes a Dav interface over HTTP so that clients can store
- contacts or calendars using the mail account.
-
-
-
-
-
-
- Fetchmail allows users to retrieve mail from an external mail-server via IMAP/POP3 and puts it in their inbox.
-
A mail server must be exposed to the world to receive emails, send emails,
-and let users access their mailboxes. Mailu has some flexibility in the way
-you expose it to the world.
-
-
-
-
-
-
-
You server will be available under a main hostname but may expose multiple public
-hostnames. Every e-mail domain that points to this server must have one of the
-hostnames in its MX record. Hostnames must be comma-separated. If you're having
-trouble accessing your admin interface, make sure it is the first entry here (and possibly the
-same as your DOMAIN entry from earlier.
-
-
-
-
-
-
-{% endcall %}
diff --git a/setup/templates/wizard.html b/setup/templates/wizard.html
index e618b716..c98672a6 100644
--- a/setup/templates/wizard.html
+++ b/setup/templates/wizard.html
@@ -8,11 +8,6 @@
ready when using this wizard.
{% endcall %}
-
- {% if flavor %}
{% endblock %}