Skip to content

MongoDB keeps failing #16

@f1shy-dev

Description

@f1shy-dev

I'm trying to install MAS using the latest setup in the repo. However the whole thing keeps failing at mongoDB. First it was due to the PVC/PC being unable to bind. I got those to work eventually. But now am stuck here, with no resolution...

Host machine/OS: Debian 12, 14vcpu, 30GB ram

>_ $ oc describe pod mas-mongo-ce-0 -n mongoce
# <...truncated...>
Events:
  Type     Reason          Age                    From               Message
  ----     ------          ----                   ----               -------
  Normal   Scheduled       2m47s                  default-scheduler  Successfully assigned mongoce/mas-mongo-ce-0 to crc
  Normal   AddedInterface  2m46s                  multus             Add eth0 [10.217.0.33/23] from ovn-kubernetes
  Normal   Pulling         2m46s                  kubelet            Pulling image "quay.io/mongodb/mongodb-kubernetes-operator-version-upgrade-post-start-hook@sha256:893527c88d7b7acc2a5f6fe4e38d8cac5ee99bf5a8c2e4405d2fc6ed4e509bbc"
  Normal   Pulled          2m45s                  kubelet            Successfully pulled image "quay.io/mongodb/mongodb-kubernetes-operator-version-upgrade-post-start-hook@sha256:893527c88d7b7acc2a5f6fe4e38d8cac5ee99bf5a8c2e4405d2fc6ed4e509bbc" in 1.461s (1.461s including waiting). Image size: 138211346 bytes.
  Normal   Created         2m45s                  kubelet            Created container: mongod-posthook
  Normal   Started         2m45s                  kubelet            Started container mongod-posthook
  Normal   Pulling         2m44s                  kubelet            Pulling image "quay.io/mongodb/mongodb-kubernetes-readinessprobe@sha256:169c1f047b58134b82da6646c4fb75f3fd30599ccc3d54fffd16e56e61e8c01f"
  Normal   Pulled          2m42s                  kubelet            Successfully pulled image "quay.io/mongodb/mongodb-kubernetes-readinessprobe@sha256:169c1f047b58134b82da6646c4fb75f3fd30599ccc3d54fffd16e56e61e8c01f" in 1.644s (1.644s including waiting). Image size: 144364052 bytes.
  Normal   Created         2m42s                  kubelet            Created container: mongodb-agent-readinessprobe
  Normal   Started         2m42s                  kubelet            Started container mongodb-agent-readinessprobe
  Normal   Pulling         2m33s                  kubelet            Pulling image "quay.io/mongodb/mongodb-agent@sha256:d5b34afd48568f5a6a9fce03c78660cbf8d3a96e7fd9a6fbe1d028b01112840f"
  Normal   Started         2m31s                  kubelet            Started container mongodb-agent
  Normal   Pulled          2m31s                  kubelet            Successfully pulled image "quay.io/mongodb/mongodb-agent@sha256:d5b34afd48568f5a6a9fce03c78660cbf8d3a96e7fd9a6fbe1d028b01112840f" in 1.652s (1.652s including waiting). Image size: 560180825 bytes.
  Normal   Created         2m31s                  kubelet            Created container: mongodb-agent
  Warning  Failed          2m29s (x2 over 2m30s)  kubelet            Error: ImagePullBackOff
  Normal   BackOff         2m29s (x2 over 2m30s)  kubelet            Back-off pulling image "quay.io/ibmmas/mongo@sha256:34341de709b1a70f5e0339ecb1ad2aa2152ecf88e5ca825e2a764da69bbd0269"
  Warning  Unhealthy       2m26s                  kubelet            Readiness probe failed: {"level":"info","ts":1747589710.1760914,"msg":"logging configuration: &{Filename:/var/log/mongodb-mms-automation/readiness.log MaxSize:5 MaxAge:0 MaxBackups:5 LocalTime:false Compress:false size:0 file:<nil> mu:{state:0 sema:0} millCh:<nil> startMill:{done:0 m:{state:0 sema:0}}}"}
{"level":"error","ts":1747589710.1761916,"msg":"health status file not avaible yet: open /var/log/mongodb-mms-automation/healthstatus/agent-health-status.json: no such file or directory "}
  Warning  Unhealthy  2m16s  kubelet  Readiness probe failed: {"level":"info","ts":1747589720.2301493,"msg":"logging configuration: &{Filename:/var/log/mongodb-mms-automation/readiness.log MaxSize:5 MaxAge:0 MaxBackups:5 LocalTime:false Compress:false size:0 file:<nil> mu:{state:0 sema:0} millCh:<nil> startMill:{done:0 m:{state:0 sema:0}}}"}
{"level":"info","ts":1747589720.2503157,"msg":"Mongod is not ready"}
{"level":"info","ts":1747589720.2503517,"msg":"Reached the end of the check. Returning not ready."}
  Warning  Unhealthy  2m16s  kubelet  Readiness probe failed: {"level":"info","ts":1747589720.177535,"msg":"logging configuration: &{Filename:/var/log/mongodb-mms-automation/readiness.log MaxSize:5 MaxAge:0 MaxBackups:5 LocalTime:false Compress:false size:0 file:<nil> mu:{state:0 sema:0} millCh:<nil> startMill:{done:0 m:{state:0 sema:0}}}"}
{"level":"info","ts":1747589720.200809,"msg":"Mongod is not ready"}
{"level":"info","ts":1747589720.2008474,"msg":"Reached the end of the check. Returning not ready."}
  Normal   Pulling  2m16s (x2 over 2m42s)  kubelet  Pulling image "quay.io/ibmmas/mongo@sha256:34341de709b1a70f5e0339ecb1ad2aa2152ecf88e5ca825e2a764da69bbd0269"
  Warning  Failed   2m7s (x2 over 2m33s)   kubelet  Error: ErrImagePull
  Warning  Failed   2m7s (x2 over 2m33s)   kubelet  Failed to pull image "quay.io/ibmmas/mongo@sha256:34341de709b1a70f5e0339ecb1ad2aa2152ecf88e5ca825e2a764da69bbd0269": writing blob: adding layer with blob "sha256:74f3a5ab402ee9ff8f8d7cc8b2ee523e347e930f81a623ea216e89246b73cc2a"/""/"sha256:fa3ca5521ea059dd7b292cf26918502130a8f9497802afdae3022b9c827ac5a1": readlink /var/lib/containers/storage/overlay/l: invalid argument

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions