Day 9 of 100 Days of Devops
Maria DB Trouble Shooting
Day 9 of 100 Days of Devops
There is a critical issue going on with the Nautilus application in Stratos DC. The production support team identified that the application is unable to connect to the database. After digging into the issue, the team found that mariadb service is down on the database server.
Look into the issue and fix the same.
Investigation
First as usual we need to identify and login to DB server this time round it is different server from App server
Investigation
Apparently the instruction mentioned that the application was down.
So I tried to start it
systemctl start mariadb.service
Then check the status using systemctl status systemctl status mariadb.service
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
[root@stdb01 ~]# journalctl -xeu mariadb.service
Dec 02 05:00:42 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: starting held back, waiting for: sysinit.target
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Will spawn child (service_enter_start_pre): /usr/libexec/mariadb-check-socket
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Failed to reset devices.allow/devices.deny: Operation not permitted
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Failed to set 'trusted.invocation_id' xattr on control group /docker/9c8b3d07a3455534f212274c34940551ccfac292194b655a992b2354de483fef/system.slice/mariadb.service, ignoring: Operation not permitted
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Failed to remove 'trusted.delegate' xattr flag on control group /docker/9c8b3d07a3455534f212274c34940551ccfac292194b655a992b2354de483fef/system.slice/mariadb.service, ignoring: Operation not permitted
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: About to execute /usr/libexec/mariadb-check-socket
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Forked /usr/libexec/mariadb-check-socket as 877
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Changed dead -> start-pre
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[877]: PR_SET_MM_ARG_START failed: Operation not permitted
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[1]: Starting MariaDB 10.5 database server...
░░ Subject: A start job for unit mariadb.service has begun execution
░░ Defined-By: systemd
░░ Support: https://access.redhat.com/support
░░
░░ A start job for unit mariadb.service has begun execution.
░░
░░ The job identifier is 59.
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: User lookup succeeded: uid=27 gid=27
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[877]: Bind-mounting / on /run/systemd/unit-root (MS_BIND|MS_REC "")...
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[877]: Applying namespace mount on /run/systemd/unit-root/run/credentials
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[877]: Bind-mounting /run/systemd/inaccessible/dir on /run/systemd/unit-root/run/credentials (MS_BIND|MS_REC "")...
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[877]: Successfully mounted /run/systemd/inaccessible/dir to /run/systemd/unit-root/run/credentials
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[877]: Applying namespace mount on /run/systemd/unit-root/run/systemd/incoming
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[877]: Followed source symlinks /run/systemd/propagate/mariadb.service → /run/systemd/propagate/mariadb.service.
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[877]: Bind-mounting /run/systemd/propagate/mariadb.service on /run/systemd/unit-root/run/systemd/incoming (MS_BIND "")...
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[877]: Successfully mounted /run/systemd/propagate/mariadb.service to /run/systemd/unit-root/run/systemd/incoming
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[877]: Applying namespace mount on /run/systemd/unit-root/tmp
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[877]: Bind-mounting /tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-T2F5Jt/tmp on /run/systemd/unit-root/tmp (MS_BIND|MS_REC "")...
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[877]: Successfully mounted /tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-T2F5Jt/tmp to /run/systemd/unit-root/tmp
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[877]: Applying namespace mount on /run/systemd/unit-root/var/tmp
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[877]: Bind-mounting /var/tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-OrvRME/tmp on /run/systemd/unit-root/var/tmp (MS_BIND|MS_REC "")...
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[877]: Successfully mounted /var/tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-OrvRME/tmp to /run/systemd/unit-root/var/tmp
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[877]: Remounted /run/systemd/unit-root/run/credentials.
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[877]: Remounted /run/systemd/unit-root/run/systemd/incoming.
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[877]: Remounted /run/systemd/unit-root/run/credentials.
Dec 02 05:00:43 stdb01.stratos.xfusioncorp.com systemd[877]: mariadb.service: Executing: /usr/libexec/mariadb-check-socket
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Child 877 belongs to mariadb.service.
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Control process exited, code=exited, status=0/SUCCESS (success)
░░ Subject: Unit process exited
░░ Defined-By: systemd
░░ Support: https://access.redhat.com/support
░░
░░ An ExecStartPre= process belonging to unit mariadb.service has exited.
░░
░░ The process' exit code is 'exited' and its exit status is 0.
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Running next control command for state start-pre.
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Will spawn child (service_run_next_control): /usr/libexec/mariadb-prepare-db-dir
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: About to execute /usr/libexec/mariadb-prepare-db-dir mariadb.service
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Forked /usr/libexec/mariadb-prepare-db-dir as 1084
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1084]: PR_SET_MM_ARG_START failed: Operation not permitted
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: User lookup succeeded: uid=27 gid=27
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1084]: Bind-mounting / on /run/systemd/unit-root (MS_BIND|MS_REC "")...
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1084]: Applying namespace mount on /run/systemd/unit-root/run/credentials
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1084]: Bind-mounting /run/systemd/inaccessible/dir on /run/systemd/unit-root/run/credentials (MS_BIND|MS_REC "")...
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1084]: Successfully mounted /run/systemd/inaccessible/dir to /run/systemd/unit-root/run/credentials
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1084]: Applying namespace mount on /run/systemd/unit-root/run/systemd/incoming
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1084]: Followed source symlinks /run/systemd/propagate/mariadb.service → /run/systemd/propagate/mariadb.service.
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1084]: Bind-mounting /run/systemd/propagate/mariadb.service on /run/systemd/unit-root/run/systemd/incoming (MS_BIND "")...
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1084]: Successfully mounted /run/systemd/propagate/mariadb.service to /run/systemd/unit-root/run/systemd/incoming
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1084]: Applying namespace mount on /run/systemd/unit-root/tmp
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1084]: Bind-mounting /tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-T2F5Jt/tmp on /run/systemd/unit-root/tmp (MS_BIND|MS_REC "")...
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1084]: Successfully mounted /tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-T2F5Jt/tmp to /run/systemd/unit-root/tmp
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1084]: Applying namespace mount on /run/systemd/unit-root/var/tmp
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1084]: Bind-mounting /var/tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-OrvRME/tmp on /run/systemd/unit-root/var/tmp (MS_BIND|MS_REC "")...
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1084]: Successfully mounted /var/tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-OrvRME/tmp to /run/systemd/unit-root/var/tmp
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1084]: Remounted /run/systemd/unit-root/run/credentials.
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1084]: Remounted /run/systemd/unit-root/run/systemd/incoming.
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1084]: Remounted /run/systemd/unit-root/run/credentials.
Dec 02 05:00:44 stdb01.stratos.xfusioncorp.com systemd[1084]: mariadb.service: Executing: /usr/libexec/mariadb-prepare-db-dir mariadb.service
Dec 02 05:00:45 stdb01.stratos.xfusioncorp.com mariadb-prepare-db-dir[1084]: Initializing MariaDB database
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com mariadb-prepare-db-dir[1388]: Two all-privilege accounts were created.
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com mariadb-prepare-db-dir[1388]: One is root@localhost, it has no password, but you need to
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com mariadb-prepare-db-dir[1388]: be system 'root' user to connect. Use, for example, sudo mysql
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com mariadb-prepare-db-dir[1388]: The second is mysql@localhost, it has no password either, but
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com mariadb-prepare-db-dir[1388]: you need to be the system 'mysql' user to connect.
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com mariadb-prepare-db-dir[1388]: After connecting you can set the password, if you would need to be
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com mariadb-prepare-db-dir[1388]: able to connect as any of these users with a password and without sudo
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com mariadb-prepare-db-dir[1388]: See the MariaDB Knowledgebase at https://mariadb.com/kb
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com mariadb-prepare-db-dir[1388]: Please report any problems at https://mariadb.org/jira
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com mariadb-prepare-db-dir[1388]: The latest information about MariaDB is available at https://mariadb.org/.
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com mariadb-prepare-db-dir[1388]: Consider joining MariaDB's strong and vibrant community:
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com mariadb-prepare-db-dir[1388]: https://mariadb.org/get-involved/
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Child 1084 belongs to mariadb.service.
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Control process exited, code=exited, status=0/SUCCESS (success)
░░ Subject: Unit process exited
░░ Defined-By: systemd
░░ Support: https://access.redhat.com/support
░░
░░ An ExecStartPre= process belonging to unit mariadb.service has exited.
░░
░░ The process' exit code is 'exited' and its exit status is 0.
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Got final SIGCHLD for state start-pre.
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Will spawn child (service_enter_start): /usr/libexec/mariadbd
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Passing 0 fds to service
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: About to execute /usr/libexec/mariadbd --basedir=/usr "\$MYSQLD_OPTS" "\$_WSREP_NEW_CLUSTER"
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Forked /usr/libexec/mariadbd as 1452
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1452]: PR_SET_MM_ARG_START failed: Operation not permitted
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Changed start-pre -> start
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: User lookup succeeded: uid=27 gid=27
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1452]: Bind-mounting / on /run/systemd/unit-root (MS_BIND|MS_REC "")...
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1452]: Applying namespace mount on /run/systemd/unit-root/run/credentials
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1452]: Bind-mounting /run/systemd/inaccessible/dir on /run/systemd/unit-root/run/credentials (MS_BIND|MS_REC "")...
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1452]: Successfully mounted /run/systemd/inaccessible/dir to /run/systemd/unit-root/run/credentials
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1452]: Applying namespace mount on /run/systemd/unit-root/run/systemd/incoming
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1452]: Followed source symlinks /run/systemd/propagate/mariadb.service → /run/systemd/propagate/mariadb.service.
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1452]: Bind-mounting /run/systemd/propagate/mariadb.service on /run/systemd/unit-root/run/systemd/incoming (MS_BIND "")...
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1452]: Successfully mounted /run/systemd/propagate/mariadb.service to /run/systemd/unit-root/run/systemd/incoming
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1452]: Applying namespace mount on /run/systemd/unit-root/tmp
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1452]: Bind-mounting /tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-T2F5Jt/tmp on /run/systemd/unit-root/tmp (MS_BIND|MS_REC "")...
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1452]: Successfully mounted /tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-T2F5Jt/tmp to /run/systemd/unit-root/tmp
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1452]: Applying namespace mount on /run/systemd/unit-root/var/tmp
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1452]: Bind-mounting /var/tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-OrvRME/tmp on /run/systemd/unit-root/var/tmp (MS_BIND|MS_REC "")...
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1452]: Successfully mounted /var/tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-OrvRME/tmp to /run/systemd/unit-root/var/tmp
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1452]: Remounted /run/systemd/unit-root/run/credentials.
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1452]: Remounted /run/systemd/unit-root/run/systemd/incoming.
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1452]: Remounted /run/systemd/unit-root/run/credentials.
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1452]: mariadb.service: Executing: /usr/libexec/mariadbd --basedir=/usr
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Got notification message from PID 1452 (READY=1, STATUS=Taking your SQL requests now...)
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Will spawn child (service_enter_start_post): /usr/libexec/mariadb-check-upgrade
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: About to execute /usr/libexec/mariadb-check-upgrade
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Forked /usr/libexec/mariadb-check-upgrade as 1501
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1501]: PR_SET_MM_ARG_START failed: Operation not permitted
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Changed start -> start-post
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: User lookup succeeded: uid=27 gid=27
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1501]: Bind-mounting / on /run/systemd/unit-root (MS_BIND|MS_REC "")...
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1501]: Applying namespace mount on /run/systemd/unit-root/run/credentials
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1501]: Bind-mounting /run/systemd/inaccessible/dir on /run/systemd/unit-root/run/credentials (MS_BIND|MS_REC "")...
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1501]: Successfully mounted /run/systemd/inaccessible/dir to /run/systemd/unit-root/run/credentials
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1501]: Applying namespace mount on /run/systemd/unit-root/run/systemd/incoming
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1501]: Followed source symlinks /run/systemd/propagate/mariadb.service → /run/systemd/propagate/mariadb.service.
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1501]: Bind-mounting /run/systemd/propagate/mariadb.service on /run/systemd/unit-root/run/systemd/incoming (MS_BIND "")...
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1501]: Successfully mounted /run/systemd/propagate/mariadb.service to /run/systemd/unit-root/run/systemd/incoming
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1501]: Applying namespace mount on /run/systemd/unit-root/tmp
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1501]: Bind-mounting /tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-T2F5Jt/tmp on /run/systemd/unit-root/tmp (MS_BIND|MS_REC "")...
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1501]: Successfully mounted /tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-T2F5Jt/tmp to /run/systemd/unit-root/tmp
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1501]: Applying namespace mount on /run/systemd/unit-root/var/tmp
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1501]: Bind-mounting /var/tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-OrvRME/tmp on /run/systemd/unit-root/var/tmp (MS_BIND|MS_REC "")...
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1501]: Successfully mounted /var/tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-OrvRME/tmp to /run/systemd/unit-root/var/tmp
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1501]: Remounted /run/systemd/unit-root/run/credentials.
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1501]: Remounted /run/systemd/unit-root/run/systemd/incoming.
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1501]: Remounted /run/systemd/unit-root/run/credentials.
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1501]: mariadb.service: Executing: /usr/libexec/mariadb-check-upgrade
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Child 1501 belongs to mariadb.service.
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Control process exited, code=exited, status=0/SUCCESS (success)
░░ Subject: Unit process exited
░░ Defined-By: systemd
░░ Support: https://access.redhat.com/support
░░
░░ An ExecStartPost= process belonging to unit mariadb.service has exited.
░░
░░ The process' exit code is 'exited' and its exit status is 0.
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Got final SIGCHLD for state start-post.
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Changed start-post -> running
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Job 59 mariadb.service/start finished, result=done
Dec 02 05:00:47 stdb01.stratos.xfusioncorp.com systemd[1]: Started MariaDB 10.5 database server.
░░ Subject: A start job for unit mariadb.service has finished successfully
░░ Defined-By: systemd
░░ Support: https://access.redhat.com/support
░░
░░ A start job for unit mariadb.service has finished successfully.
░░
░░ The job identifier is 59.
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Trying to enqueue job mariadb.service/stop/replace
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Installed new job mariadb.service/stop as 112
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Enqueued job mariadb.service/stop as 112
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Changed running -> stop-sigterm
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: Stopping MariaDB 10.5 database server...
░░ Subject: A stop job for unit mariadb.service has begun execution
░░ Defined-By: systemd
░░ Support: https://access.redhat.com/support
░░
░░ A stop job for unit mariadb.service has begun execution.
░░
░░ The job identifier is 112.
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Got notification message from PID 1452 (STOPPING=1, STATUS=Shutdown in progress)
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Got notification message from PID 1452 (STATUS=Dumping buffer pool page 1/176, EXTEND_TIMEOUT_USEC=30000000)
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Got notification message from PID 1452 (STATUS=Waiting for page cleaner thread to exit, EXTEND_TIMEOUT_USEC=120000000)
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Got notification message from PID 1452 (STATUS=Waiting to flush the buffer pool, EXTEND_TIMEOUT_USEC=30000000)
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Got notification message from PID 1452 (STATUS=ensuring dirty buffer pool are written to log, EXTEND_TIMEOUT_USEC=30000000)
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Got notification message from PID 1452 (STATUS=Free innodb buffer pool, EXTEND_TIMEOUT_USEC=30000000)
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Got notification message from PID 1452 (STATUS=MariaDB server is down)
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Got notification message from PID 1452 (STATUS=MariaDB server is down)
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Child 1452 belongs to mariadb.service.
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Main process exited, code=exited, status=0/SUCCESS (success)
░░ Subject: Unit process exited
░░ Defined-By: systemd
░░ Support: https://access.redhat.com/support
░░
░░ An ExecStart= process belonging to unit mariadb.service has exited.
░░
░░ The process' exit code is 'exited' and its exit status is 0.
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Deactivated successfully.
░░ Subject: Unit succeeded
░░ Defined-By: systemd
░░ Support: https://access.redhat.com/support
░░
░░ The unit mariadb.service has successfully entered the 'dead' state.
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Service restart not allowed.
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Changed stop-sigterm -> dead
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Job 112 mariadb.service/stop finished, result=done
Dec 02 05:00:53 stdb01.stratos.xfusioncorp.com systemd[1]: Stopped MariaDB 10.5 database server.
░░ Subject: A stop job for unit mariadb.service has finished
░░ Defined-By: systemd
░░ Support: https://access.redhat.com/support
░░
░░ A stop job for unit mariadb.service has finished.
░░
░░ The job identifier is 112 and the job result is done.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Trying to enqueue job mariadb.service/restart/replace
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Installed new job mariadb.service/restart as 278
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Enqueued job mariadb.service/restart as 278
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Job 278 mariadb.service/restart finished, result=done
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Converting job mariadb.service/restart -> mariadb.service/start
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Will spawn child (service_enter_start_pre): /usr/libexec/mariadb-check-socket
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Failed to reset devices.allow/devices.deny: Operation not permitted
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Failed to set 'trusted.invocation_id' xattr on control group /docker/9c8b3d07a3455534f212274c34940551ccfac292194b655a992b2354de483fef/system.slice/mariadb.service, ignoring: Operation not permitted
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Failed to remove 'trusted.delegate' xattr flag on control group /docker/9c8b3d07a3455534f212274c34940551ccfac292194b655a992b2354de483fef/system.slice/mariadb.service, ignoring: Operation not permitted
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: About to execute /usr/libexec/mariadb-check-socket
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Forked /usr/libexec/mariadb-check-socket as 2470
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2470]: PR_SET_MM_ARG_START failed: Operation not permitted
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Changed dead -> start-pre
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: Starting MariaDB 10.5 database server...
░░ Subject: A start job for unit mariadb.service has begun execution
░░ Defined-By: systemd
░░ Support: https://access.redhat.com/support
░░
░░ A start job for unit mariadb.service has begun execution.
░░
░░ The job identifier is 278.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: User lookup succeeded: uid=27 gid=27
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2470]: Bind-mounting / on /run/systemd/unit-root (MS_BIND|MS_REC "")...
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2470]: Applying namespace mount on /run/systemd/unit-root/run/credentials
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2470]: Bind-mounting /run/systemd/inaccessible/dir on /run/systemd/unit-root/run/credentials (MS_BIND|MS_REC "")...
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2470]: Successfully mounted /run/systemd/inaccessible/dir to /run/systemd/unit-root/run/credentials
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2470]: Applying namespace mount on /run/systemd/unit-root/run/systemd/incoming
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2470]: Followed source symlinks /run/systemd/propagate/mariadb.service → /run/systemd/propagate/mariadb.service.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2470]: Bind-mounting /run/systemd/propagate/mariadb.service on /run/systemd/unit-root/run/systemd/incoming (MS_BIND "")...
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2470]: Successfully mounted /run/systemd/propagate/mariadb.service to /run/systemd/unit-root/run/systemd/incoming
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2470]: Applying namespace mount on /run/systemd/unit-root/tmp
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2470]: Bind-mounting /tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-aqz1hD/tmp on /run/systemd/unit-root/tmp (MS_BIND|MS_REC "")...
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2470]: Successfully mounted /tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-aqz1hD/tmp to /run/systemd/unit-root/tmp
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2470]: Applying namespace mount on /run/systemd/unit-root/var/tmp
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2470]: Bind-mounting /var/tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-KnSAML/tmp on /run/systemd/unit-root/var/tmp (MS_BIND|MS_REC "")...
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2470]: Successfully mounted /var/tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-KnSAML/tmp to /run/systemd/unit-root/var/tmp
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2470]: Remounted /run/systemd/unit-root/run/credentials.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2470]: Remounted /run/systemd/unit-root/run/systemd/incoming.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2470]: Remounted /run/systemd/unit-root/run/credentials.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2470]: mariadb.service: Executing: /usr/libexec/mariadb-check-socket
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Child 2470 belongs to mariadb.service.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Control process exited, code=exited, status=0/SUCCESS (success)
░░ Subject: Unit process exited
░░ Defined-By: systemd
░░ Support: https://access.redhat.com/support
░░
░░ An ExecStartPre= process belonging to unit mariadb.service has exited.
░░
░░ The process' exit code is 'exited' and its exit status is 0.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Running next control command for state start-pre.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Will spawn child (service_run_next_control): /usr/libexec/mariadb-prepare-db-dir
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: About to execute /usr/libexec/mariadb-prepare-db-dir mariadb.service
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Forked /usr/libexec/mariadb-prepare-db-dir as 2504
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2504]: PR_SET_MM_ARG_START failed: Operation not permitted
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: User lookup succeeded: uid=27 gid=27
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2504]: Bind-mounting / on /run/systemd/unit-root (MS_BIND|MS_REC "")...
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2504]: Applying namespace mount on /run/systemd/unit-root/run/credentials
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2504]: Bind-mounting /run/systemd/inaccessible/dir on /run/systemd/unit-root/run/credentials (MS_BIND|MS_REC "")...
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2504]: Successfully mounted /run/systemd/inaccessible/dir to /run/systemd/unit-root/run/credentials
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2504]: Applying namespace mount on /run/systemd/unit-root/run/systemd/incoming
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2504]: Followed source symlinks /run/systemd/propagate/mariadb.service → /run/systemd/propagate/mariadb.service.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2504]: Bind-mounting /run/systemd/propagate/mariadb.service on /run/systemd/unit-root/run/systemd/incoming (MS_BIND "")...
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2504]: Successfully mounted /run/systemd/propagate/mariadb.service to /run/systemd/unit-root/run/systemd/incoming
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2504]: Applying namespace mount on /run/systemd/unit-root/tmp
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2504]: Bind-mounting /tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-aqz1hD/tmp on /run/systemd/unit-root/tmp (MS_BIND|MS_REC "")...
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2504]: Successfully mounted /tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-aqz1hD/tmp to /run/systemd/unit-root/tmp
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2504]: Applying namespace mount on /run/systemd/unit-root/var/tmp
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2504]: Bind-mounting /var/tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-KnSAML/tmp on /run/systemd/unit-root/var/tmp (MS_BIND|MS_REC "")...
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2504]: Successfully mounted /var/tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-KnSAML/tmp to /run/systemd/unit-root/var/tmp
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2504]: Remounted /run/systemd/unit-root/run/credentials.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2504]: Remounted /run/systemd/unit-root/run/systemd/incoming.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2504]: Remounted /run/systemd/unit-root/run/credentials.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2504]: mariadb.service: Executing: /usr/libexec/mariadb-prepare-db-dir mariadb.service
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com mariadb-prepare-db-dir[2504]: Database MariaDB is probably initialized in /var/lib/mysql already, nothing is done.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com mariadb-prepare-db-dir[2504]: If this is not the case, make sure the /var/lib/mysql is empty before running mariadb-prepare-db-dir.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Child 2504 belongs to mariadb.service.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Control process exited, code=exited, status=0/SUCCESS (success)
░░ Subject: Unit process exited
░░ Defined-By: systemd
░░ Support: https://access.redhat.com/support
░░
░░ An ExecStartPre= process belonging to unit mariadb.service has exited.
░░
░░ The process' exit code is 'exited' and its exit status is 0.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Got final SIGCHLD for state start-pre.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Will spawn child (service_enter_start): /usr/libexec/mariadbd
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Passing 0 fds to service
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: About to execute /usr/libexec/mariadbd --basedir=/usr "\$MYSQLD_OPTS" "\$_WSREP_NEW_CLUSTER"
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Forked /usr/libexec/mariadbd as 2599
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2599]: PR_SET_MM_ARG_START failed: Operation not permitted
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Changed start-pre -> start
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: User lookup succeeded: uid=27 gid=27
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2599]: Bind-mounting / on /run/systemd/unit-root (MS_BIND|MS_REC "")...
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2599]: Applying namespace mount on /run/systemd/unit-root/run/credentials
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2599]: Bind-mounting /run/systemd/inaccessible/dir on /run/systemd/unit-root/run/credentials (MS_BIND|MS_REC "")...
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2599]: Successfully mounted /run/systemd/inaccessible/dir to /run/systemd/unit-root/run/credentials
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2599]: Applying namespace mount on /run/systemd/unit-root/run/systemd/incoming
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2599]: Followed source symlinks /run/systemd/propagate/mariadb.service → /run/systemd/propagate/mariadb.service.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2599]: Bind-mounting /run/systemd/propagate/mariadb.service on /run/systemd/unit-root/run/systemd/incoming (MS_BIND "")...
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2599]: Successfully mounted /run/systemd/propagate/mariadb.service to /run/systemd/unit-root/run/systemd/incoming
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2599]: Applying namespace mount on /run/systemd/unit-root/tmp
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2599]: Bind-mounting /tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-aqz1hD/tmp on /run/systemd/unit-root/tmp (MS_BIND|MS_REC "")...
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2599]: Successfully mounted /tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-aqz1hD/tmp to /run/systemd/unit-root/tmp
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2599]: Applying namespace mount on /run/systemd/unit-root/var/tmp
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2599]: Bind-mounting /var/tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-KnSAML/tmp on /run/systemd/unit-root/var/tmp (MS_BIND|MS_REC "")...
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2599]: Successfully mounted /var/tmp/systemd-private-1435520e8a0746a589dc0f038604b67c-mariadb.service-KnSAML/tmp to /run/systemd/unit-root/var/tmp
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2599]: Remounted /run/systemd/unit-root/run/credentials.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2599]: Remounted /run/systemd/unit-root/run/systemd/incoming.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2599]: Remounted /run/systemd/unit-root/run/credentials.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[2599]: mariadb.service: Executing: /usr/libexec/mariadbd --basedir=/usr
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com mariadbd[2599]: 2025-12-02 5:05:40 0 [Warning] Can't create test file '/var/lib/mysql/stdb01.lower-test' (Errcode: 13 "Permission denied")
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Got notification message from PID 2599 (STATUS=Waiting for page cleaner thread to exit, EXTEND_TIMEOUT_USEC=120000000)
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Got notification message from PID 2599 (STATUS=Waiting to flush the buffer pool, EXTEND_TIMEOUT_USEC=30000000)
Dec 02 05:05:41 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Got notification message from PID 2599 (STATUS=MariaDB server is down)
Dec 02 05:05:41 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Child 2599 belongs to mariadb.service.
Dec 02 05:05:41 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Main process exited, code=exited, status=1/FAILURE
░░ Subject: Unit process exited
░░ Defined-By: systemd
░░ Support: https://access.redhat.com/support
░░
░░ An ExecStart= process belonging to unit mariadb.service has exited.
░░
░░ The process' exit code is 'exited' and its exit status is 1.
Dec 02 05:05:41 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Failed with result 'exit-code'.
░░ Subject: Unit failed
░░ Defined-By: systemd
░░ Support: https://access.redhat.com/support
░░
░░ The unit mariadb.service has entered the 'failed' state with result 'exit-code'.
Dec 02 05:05:41 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Service will not restart (restart setting)
Dec 02 05:05:41 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Changed start -> failed
Dec 02 05:05:41 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Job 278 mariadb.service/start finished, result=failed
Dec 02 05:05:41 stdb01.stratos.xfusioncorp.com systemd[1]: Failed to start MariaDB 10.5 database server.
░░ Subject: A start job for unit mariadb.service has failed
░░ Defined-By: systemd
░░ Support: https://access.redhat.com/support
░░
░░ A start job for unit mariadb.service has finished with a failure.
░░
░░ The job identifier is 278 and the job result is failed.
Dec 02 05:05:41 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Unit entered failed state.
The journal will be long its good to read the journal details for more information. After reading that journal logs of mariadb.service you will be seeing this
1
2
3
4
5
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com mariadbd[2599]: 2025-12-02 5:05:40 0 [Warning] Can't create test file '/var/lib/mysql/stdb01.lower-test' (Errcode: 13 "Permission denied")
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com mariadb-prepare-db-dir[2504]: Database MariaDB is probably initialized in /var/lib/mysql already, nothing is done.
Dec 02 05:05:40 stdb01.stratos.xfusioncorp.com mariadb-prepare-db-dir[2504]: If this is not the case, make sure the /var/lib/mysql is empty before running mariadb-prepare-db-dir.
So As you can see there is error message and it is more likely to be ownership because the mariadb service is trying to write the file to that path.
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
[root@stdb01 lib]# ls -lah
total 68K
drwxr-xr-x 1 root root 4.0K Dec 2 04:42 .
drwxr-xr-x 1 root root 4.0K Dec 2 05:00 ..
drwxr-xr-x 1 root root 4.0K Aug 29 06:05 alternatives
drwxr-xr-x 1 root root 4.0K Aug 29 06:05 dnf
drwxr-xr-x 2 root root 4.0K Jun 25 2024 games
drwxr-xr-x 2 root root 4.0K Jun 25 2024 misc
drwxr-xr-x 1 root mysql 4.0K Dec 2 05:00 mysql
drwx------ 2 root root 4.0K Aug 29 04:35 private
drwxr-xr-x 1 root root 4.0K May 7 2025 rpm
drwxr-xr-x 2 root root 4.0K Jun 25 2024 rpm-state
drwxr-xr-x 3 root root 4.0K Aug 26 04:16 selinux
drwxr-xr-x 1 root root 4.0K Dec 2 05:00 systemd
drwxr-xr-x 1 root root 4.0K Aug 29 04:35 tpm2-tss
So have to change the owner ship of mysql folder to mysql using
chown mysql mysql
And try starting again
#
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
[root@stdb01 lib]# systemctl status mariadb.service
● mariadb.service - MariaDB 10.5 database server
Loaded: loaded (/usr/lib/systemd/system/mariadb.service; enabled; preset: disabled)
Active: active (running) since Tue 2025-12-02 05:14:20 UTC; 44s ago
Docs: man:mariadbd(8)
https://mariadb.com/kb/en/library/systemd/
Process: 2712 ExecStartPre=/usr/libexec/mariadb-check-socket (code=exited, status=0/SUCCESS)
Process: 2746 ExecStartPre=/usr/libexec/mariadb-prepare-db-dir mariadb.service (code=exited, status=0/SUCCESS)
Process: 2874 ExecStartPost=/usr/libexec/mariadb-check-upgrade (code=exited, status=0/SUCCESS)
Main PID: 2841 (mariadbd)
Status: "Taking your SQL requests now..."
Tasks: 14 (limit: 411434)
Memory: 93.5M
CGroup: /docker/9c8b3d07a3455534f212274c34940551ccfac292194b655a992b2354de483fef/system.slice/mariadb.service
└─2841 /usr/libexec/mariadbd --basedir=/usr
Dec 02 05:14:20 stdb01.stratos.xfusioncorp.com systemd[2874]: Remounted /run/systemd/unit-root/run/systemd/incoming.
Dec 02 05:14:20 stdb01.stratos.xfusioncorp.com systemd[2874]: Remounted /run/systemd/unit-root/run/credentials.
Dec 02 05:14:20 stdb01.stratos.xfusioncorp.com systemd[2874]: mariadb.service: Executing: /usr/libexec/mariadb-check-upgrade
Dec 02 05:14:20 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Child 2874 belongs to mariadb.service.
Dec 02 05:14:20 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Control process exited, code=exited, status=0/SUCCESS (success)
Dec 02 05:14:20 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Got final SIGCHLD for state start-post.
Dec 02 05:14:20 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Changed start-post -> running
Dec 02 05:14:20 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Job 317 mariadb.service/start finished, result=done
Dec 02 05:14:20 stdb01.stratos.xfusioncorp.com systemd[1]: Started MariaDB 10.5 database server.
Dec 02 05:14:20 stdb01.stratos.xfusioncorp.com systemd[1]: mariadb.service: Failed to send unit change signal for mariadb.service: Connection reset by peer
Thats all for today , Thx Bye.
This post is licensed under CC BY 4.0 by the author.