Changes for page Proxmox Backup server

Summary

• Page properties (1 modified, 0 added, 0 removed)

Details

Page properties

Content

...	...	@@ -2,7 +2,7 @@
2	2	(((
3	3	(% class="col-xs-12 col-sm-8" %)
4	4	(((
5		-= Configuration =
	5	+= Backup Server configuration =
6	6
7	7	Backup server is setup with:
8	8
...	...	@@ -15,7 +15,7 @@
15	15	** permissions
16	16	* timings and simulator
17	17
18		-= ZFS storage array =
	18	+== ZFS storage array ==
19	19
20	20	There are currently 2 x 8TB WD drives. Current pool status:
21	21
...	...	@@ -34,7 +34,7 @@
34	34	errors: No known data errors}}}
35	35
36	36
37		-== Creating and expanding zfs pool ==
	37	+=== Creating and expanding zfs pool ===
38	38
39	39	```
40	40	zpool create pergamum raidz /dev/disk/by-partuuid/9fab17e5-df2d-2448-b5d4-10193c673a6b /dev/disk/by-partuuid/f801ed37-1d6c-ee40-8b85-6bfc49aba0fb -f
...	...	@@ -50,6 +50,71 @@
50	50	```
51	51	~> NOTE! `-n` is dry run, remove to commit.
52	52
	53	+
	54	+== Access Control ==
	55	+
	56	+Each client host that wants to backup their contents to the backup server should have their unique API token for authentication.
	57	+
	58	+API Token:
	59	+
	60	+* user: [[root@pam>>mailto:root@pam]]
	61	+* token name: CLIENT_NAME
	62	+* expire: never
	63	+* enabled: true
	64	+
	65	+Permissions - Add a API Token Permission:
	66	+
	67	+* path: /datastore/proxmox-backup/CLIENT_NAME
	68	+* api token: root@pam!CLIENT_NAME
	69	+* role: DatastoreBackup
	70	+* propagate: true
	71	+
	72	+>Note! The path will not be define until after the Datastore namespace is define in the steps below
	73	+
	74	+== Proxmox datastore ==
	75	+
	76	+If none exists create the datastore. Ours point is named `proxmox-backup` and points to ZFS storage mounted at `/mnt/pergamum`. All references to `proxmox-backup` referes to what you named it as in the create step here.
	77	+
	78	+=== Namespace ===
	79	+
	80	+Namespaces is what we will use in a datastore to separate permissions to each host. It's important to create these for the API tokens create in Access Control section above.
	81	+
	82	+=== Prune & Garbage collect ===
	83	+
	84	+We don't require backups for every day of the year. Pruning lets you systematically delete older backups, retaining backups for the last given number of time intervals. There exists a fantastic simulator that can be used to experiment with different backup schedules and prune options: [[https:~~/~~/pbs.proxmox.com/docs/prune-simulator/>>https://pbs.proxmox.com/docs/prune-simulator/]]. The current configuration is:
	85	+
	86	+* datastore: proxmox-backup
	87	+* namespace: root
	88	+* keep last: 4
	89	+* keep: hourly: -
	90	+* keep daily: 6
	91	+* keep weekly: 3
	92	+* keep monthly: 6
	93	+* keep yearly: 4
	94	+* max_depth: full
	95	+* prune schedule: 0/6:00
	96	+* enabled: true
	97	+
	98	+=== Verify jobs ===
	99	+
	100	+Current configuration is:
	101	+
	102	+* local datastore: proxmox-backup
	103	+* namespace: root
	104	+* max-depth: full
	105	+* schedule: daily
	106	+* skip verified: true
	107	+* re-verify after: 30 days
	108	+
	109	+=== Permissions ===
	110	+
	111	+Permissions are explained in the Access Control section above, but it can be easier to configure permissions from the datastore. Navigate to the datastore Permission tab and add API Token Permission:
	112	+
	113	+* path: /datastore/proxmox-backup/CLIENT_NAME
	114	+* API Token: root@pam!CLIENT_NAME
	115	+* Role: DatastoreBackup
	116	+* Propagate: true
	117	+
53	53	= Tailscale =
54	54
55	55	Tailscale is used to create a network that uses wireguard to transparently between local and remote machines. To not require a third party a local instance of headscale is used as the tailscale login server.
...	...	@@ -57,37 +57,62 @@
57	57	Setting up a connection should only require `sudo tailscale up ~-~-login-server https:~/~/TAILSCALE_SUBDOMAIN.schleppe.cloud`.
58	58	To view the status: `sudo tailscale status`.
59	59
60		-= Client Configuration =
	125	+= Jottacloud client =
61	61
62		-Configure Backup on the Datacenter or PVE host level in the proxmox web GUI. If a backup storage is already added input the following preferences:
63		-\\{{code language="none" width="100%"}}Selection mode: include selected VMs
64		-Send email to: kevin.midboe+{PVE_HOSTNAME}@gmail.com
65		-Email: On failure only
66		-Mode: Snapshot
67		-Enabled: True
68		-Job Comment: {{guestname}}, {{node}}, {{vmid}}{{/code}}
	127	+Cloud backup provider used is jottacloud. They provide a cli to easily add directories to sync to their cloud backup storage.
	128	+NOTE! This setup still uses user `kevin` and not the correct jottad user.
69	69
70		-= Methodology =
71	71
72		-Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
	131	+{{{# install jotta-cli
	132	+sudo curl -fsSL https://repo.jotta.cloud/public.asc -o /usr/share/keyrings/jotta.gpg
	133	+echo "deb [signed-by=/usr/share/keyrings/jotta.gpg] https://repo.jotta.cloud/debian debian main" | sudo tee /etc/apt/sources.list.d/jotta-cli.list
	134	+sudo apt-get update
	135	+sudo apt-get install jotta-cli
73	73
74		-== Sub-paragraph ==
	137	+# configure runtime environment
	138	+sudo useradd -m jottad
	139	+sudo usermod -a -G jottad backup}}}
75	75
76		-Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
77	77
78		-= Proxmox backup server =
	142	+Create systemd file: `/usr/lib/systemd/user/jottad.service ` and enable with :
79	79
80		-= =
	144	+(((
	145	+
81	81
82		-Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
	147	+{{code language="ini" layout="LINENUMBERS" title="/usr/lib/systemd/user/jottad.service"}}
	148	+[Unit]
	149	+Description=Jotta client daemon
83	83
84		-== Sub-paragraph ==
	151	+[Service]
	152	+Type=notify
	153	+# Group=backup
	154	+# UMask=0002
85	85
86		-Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
	156	+# EnvironmentFile=-%h/.config/jotta-cli/jotta-cli.env
	157	+ExecStart=/usr/bin/jottad stdoutlog datadir %h/.jottad/
	158	+Restart=on-failure
87	87
88		-== Sub-paragraph ==
	160	+[Install]
	161	+WantedBy=default.target
	162	+{{/code}}
	163	+)))
89	89
90		-Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
	165	+== Flaws ==
	166	+
	167	+Since proxmox backup server uses chunks for deduplicating data a complete file list is required. This makes it impossible to download a single file representing a VM or LXC, all files must be downloaded and imported into proxmox backup server for reconstruction.
	168	+
	169	+It also seems like there are a LOT of files shifting - being added and deleted. Making the diff uploaded to jottacloud huge.
	170	+
	171	+= Client Configuration =
	172	+
	173	+Configure Backup on the Datacenter or PVE host level in the proxmox web GUI. If a backup storage is already added input the following preferences:
	174	+
	175	+* selection mode: include selected VMs
	176	+* send email to: [[[email protected]>>mailto:[email protected]]]
	177	+* email: on failure only
	178	+* mode: snapshot
	179	+* enabled: true
	180	+* job comment: ~{~{guestname}}, ~{~{node}}, ~{~{vmid}}
91	91	)))
92	92
93	93