Skip to Content

Changes for page Proxmox Backup server

Last modified by Kevin Wiki on 2024/05/21 21:23
From version 18.1
edited by Kevin Wiki
on 2024/04/06 12:48
Change comment: There is no comment for this version
To version 13.1
edited by Kevin Wiki
on 2024/04/06 11:12
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -2,7 +2,7 @@
2 2  (((
3 3  (% class="col-xs-12 col-sm-8" %)
4 4  (((
5 -= Backup Server configuration =
5 += Configuration =
6 6  
7 7  Backup server is setup with:
8 8  
... ... @@ -15,7 +15,7 @@
15 15  ** permissions
16 16  * timings and simulator
17 17  
18 -== ZFS storage array ==
18 += ZFS storage array =
19 19  
20 20  There are currently 2 x 8TB WD drives. Current pool status:
21 21  
... ... @@ -34,7 +34,7 @@
34 34  errors: No known data errors}}}
35 35  
36 36  
37 -=== Creating and expanding zfs pool ===
37 +== Creating and expanding zfs pool ==
38 38  
39 39  ```
40 40  zpool create pergamum raidz /dev/disk/by-partuuid/9fab17e5-df2d-2448-b5d4-10193c673a6b /dev/disk/by-partuuid/f801ed37-1d6c-ee40-8b85-6bfc49aba0fb -f
... ... @@ -51,7 +51,7 @@
51 51  ~> NOTE! `-n` is dry run, remove to commit.
52 52  
53 53  
54 -== Access Control ==
54 += Access Control =
55 55  
56 56  Each client host that wants to backup their contents to the backup server should have their unique API token for authentication.
57 57  
... ... @@ -71,15 +71,15 @@
71 71  
72 72  >Note! The path will not be define until after the Datastore namespace is define in the steps below
73 73  
74 -== Proxmox datastore ==
74 += Proxmox datastore =
75 75  
76 76  If none exists create the datastore. Ours point is named `proxmox-backup` and points to ZFS storage mounted at `/mnt/pergamum`. All references to `proxmox-backup` referes to what you named it as in the create step here.
77 77  
78 -=== Namespace ===
78 +== Namespace ==
79 79  
80 80  Namespaces is what we will use in a datastore to separate permissions to each host. It's important to create these for the API tokens create in Access Control section above.
81 81  
82 -=== Prune & Garbage collect ===
82 +== Prune & Garbage collect ==
83 83  
84 84  We don't require backups for every day of the year. Pruning lets you systematically delete older backups, retaining backups for the last given number of time intervals. There exists a fantastic simulator that can be used to experiment with different backup schedules and prune options: [[https:~~/~~/pbs.proxmox.com/docs/prune-simulator/>>https://pbs.proxmox.com/docs/prune-simulator/]]. The current configuration is:
85 85  
... ... @@ -95,7 +95,7 @@
95 95  * prune schedule: 0/6:00
96 96  * enabled: true
97 97  
98 -=== Verify jobs ===
98 +== Verify jobs ==
99 99  
100 100  Current configuration is:
101 101  
... ... @@ -106,7 +106,7 @@
106 106  * skip verified: true
107 107  * re-verify after: 30 days
108 108  
109 -=== Permissions ===
109 +== Permissions ==
110 110  
111 111  Permissions are explained in the Access Control section above, but it can be easier to configure permissions from the datastore. Navigate to the datastore Permission tab and add API Token Permission:
112 112  
... ... @@ -122,62 +122,37 @@
122 122  Setting up a connection should only require `sudo tailscale up ~-~-login-server https:~/~/TAILSCALE_SUBDOMAIN.schleppe.cloud`.
123 123  To view the status: `sudo tailscale status`.
124 124  
125 -= Jottacloud client =
125 += Client Configuration =
126 126  
127 -Cloud backup provider used is jottacloud. They provide a cli to easily add directories to sync to their cloud backup storage.
128 -NOTE! This setup still uses user `kevin` and not the correct jottad user.
127 +Configure Backup on the Datacenter or PVE host level in the proxmox web GUI. If a backup storage is already added input the following preferences:
128 +\\{{code language="none" width="100%"}}Selection mode: include selected VMs
129 +Send email to: kevin.midboe+{PVE_HOSTNAME}@gmail.com
130 +Email: On failure only
131 +Mode: Snapshot
132 +Enabled: True
133 +Job Comment: {{guestname}}, {{node}}, {{vmid}}{{/code}}
129 129  
135 += Methodology =
130 130  
131 -{{{# install jotta-cli
132 -sudo curl -fsSL https://repo.jotta.cloud/public.asc -o /usr/share/keyrings/jotta.gpg
133 -echo "deb [signed-by=/usr/share/keyrings/jotta.gpg] https://repo.jotta.cloud/debian debian main" | sudo tee /etc/apt/sources.list.d/jotta-cli.list
134 -sudo apt-get update
135 -sudo apt-get install jotta-cli
137 +Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
136 136  
137 -# configure runtime environment
138 -sudo useradd -m jottad
139 -sudo usermod -a -G jottad backup}}}
139 +== Sub-paragraph ==
140 140  
141 +Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
141 141  
142 -Create systemd file: `/usr/lib/systemd/user/jottad.service ` and enable with :
143 += Proxmox backup server =
143 143  
144 -(((
145 -
145 += =
146 146  
147 -{{code language="ini" layout="LINENUMBERS" title="/usr/lib/systemd/user/jottad.service"}}
148 -[Unit]
149 -Description=Jotta client daemon
147 +Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
150 150  
151 -[Service]
152 -Type=notify
153 -# Group=backup
154 -# UMask=0002
149 +== Sub-paragraph ==
155 155  
156 -# EnvironmentFile=-%h/.config/jotta-cli/jotta-cli.env
157 -ExecStart=/usr/bin/jottad stdoutlog datadir %h/.jottad/
158 -Restart=on-failure
151 +Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
159 159  
160 -[Install]
161 -WantedBy=default.target
162 -{{/code}}
163 -)))
153 +== Sub-paragraph ==
164 164  
165 -== Flaws ==
166 -
167 -Since proxmox backup server uses chunks for deduplicating data a complete file list is required. This makes it impossible to download a single file representing a VM or LXC, all files must be downloaded and imported into proxmox backup server for reconstruction.
168 -
169 -It also seems like there are a LOT of files shifting - being added and deleted. Making the diff uploaded to jottacloud huge.
170 -
171 -= Client Configuration =
172 -
173 -Configure Backup on the Datacenter or PVE host level in the proxmox web GUI. If a backup storage is already added input the following preferences:
174 -
175 -* selection mode: include selected VMs
176 -* send email to: [[[email protected]>>mailto:[email protected]]]
177 -* email: on failure only
178 -* mode: snapshot
179 -* enabled: true
180 -* job comment: ~{~{guestname}}, ~{~{node}}, ~{~{vmid}}
155 +Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
181 181  )))
182 182  
183 183