2020-03-13 06:17:41+00:00 [Warning] MountVolume.SetUp failed for volume "gluster" : mount failed: mount failed: exit status 1 Mounting command: systemd-run Mounting arguments: --description=Kubernetes transient mount for /var/data/kubelet/pods/963ba097-0dd4-4a66-a354-0542c527ee81/volumes/kubernetes.io~glusterfs/gluster --scope -- mount -t glusterfs -o auto_unmount,backup-volfile-servers=10.114.214.22:10.114.214.46:10.114.214.6:10.114.214.60:10.114.214.62:10.114.214.83:10.114.214.84:10.114.214.90:10.115.125.137:10.115.125.25:10.166.130.146:10.166.130.214:10.166.130.222:10.166.130.224:10.166.130.228:10.166.130.242:10.166.130.53:10.166.130.75:10.166.130.85:10.166.130.92,log-file=/var/data/kubelet/plugins/kubernetes.io/glusterfs/gluster/jupyterlab-rileydeverea-glusterfs.log,log-level=ERROR 10.166.130.224:gluster-production-storage/production/rileydeverea /var/data/kubelet/pods/963ba097-0dd4-4a66-a354-0542c527ee81/volumes/kubernetes.io~glusterfs/gluster Output: Running scope as unit: run-ra7b408b2a2654aaba4803f8b78187eb0.scope [2020-03-13 06:17:41.631814] E [glusterfsd.c:825:gf_remember_backup_volfile_server] 0-glusterfs: failed to set volfile server: File exists Mount failed. Please check the log file for more details. , the following error information was pulled from the glusterfs log to help diagnose this issue: [2020-03-13 06:17:41.763226] E [timer.c:34:gf_timer_call_after] (-->/usr/lib/x86_64-linux-gnu/glusterfs/6.8/xlator/protocol/client.so(+0x13d04) [0x7f63eb922d04] -->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_submit+0x629) [0x7f63f27e4ec9] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_timer_call_after+0x2f3) [0x7f63f2a45753] ) 0-timer: Either ctx is NULL or ctx cleanup started [Invalid argument] [2020-03-13 06:17:41.763359] E [timer.c:34:gf_timer_call_after] (-->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(+0x12b6f) [0x7f63f27e8b6f] -->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(+0x12191) [0x7f63f27e8191] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_timer_call_after+0x2f3) [0x7f63f2a45753] ) 0-timer: Either ctx is NULL or ctx cleanup started [Invalid argument]
Having the error:
2020-03-13 06:17:41+00:00 [Warning] MountVolume.SetUp failed for volume "gluster" : mount failed: mount failed: exit status 1 Mounting command: systemd-run Mounting arguments: --description=Kubernetes transient mount for /var/data/kubelet/pods/963ba097-0dd4-4a66-a354-0542c527ee81/volumes/kubernetes.io~glusterfs/gluster --scope -- mount -t glusterfs -o auto_unmount,backup-volfile-servers=10.114.214.22:10.114.214.46:10.114.214.6:10.114.214.60:10.114.214.62:10.114.214.83:10.114.214.84:10.114.214.90:10.115.125.137:10.115.125.25:10.166.130.146:10.166.130.214:10.166.130.222:10.166.130.224:10.166.130.228:10.166.130.242:10.166.130.53:10.166.130.75:10.166.130.85:10.166.130.92,log-file=/var/data/kubelet/plugins/kubernetes.io/glusterfs/gluster/jupyterlab-rileydeverea-glusterfs.log,log-level=ERROR 10.166.130.224:gluster-production-storage/production/rileydeverea /var/data/kubelet/pods/963ba097-0dd4-4a66-a354-0542c527ee81/volumes/kubernetes.io~glusterfs/gluster Output: Running scope as unit: run-ra7b408b2a2654aaba4803f8b78187eb0.scope [2020-03-13 06:17:41.631814] E [glusterfsd.c:825:gf_remember_backup_volfile_server] 0-glusterfs: failed to set volfile server: File exists Mount failed. Please check the log file for more details. , the following error information was pulled from the glusterfs log to help diagnose this issue: [2020-03-13 06:17:41.763226] E [timer.c:34:gf_timer_call_after] (-->/usr/lib/x86_64-linux-gnu/glusterfs/6.8/xlator/protocol/client.so(+0x13d04) [0x7f63eb922d04] -->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_submit+0x629) [0x7f63f27e4ec9] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_timer_call_after+0x2f3) [0x7f63f2a45753] ) 0-timer: Either ctx is NULL or ctx cleanup started [Invalid argument] [2020-03-13 06:17:41.763359] E [timer.c:34:gf_timer_call_after] (-->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(+0x12b6f) [0x7f63f27e8b6f] -->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(+0x12191) [0x7f63f27e8191] -->/usr/lib/x86_64-linux-gnu/libglusterfs.so.0(gf_timer_call_after+0x2f3) [0x7f63f2a45753] ) 0-timer: Either ctx is NULL or ctx cleanup started [Invalid argument]