MME crashing due to libprotobuf FATAL /usr/include/google/protobuf/repeated_field.h:1514] CHECK failed: (index) < (current_size_) error

[amarjargal]

Prior to submitting an issue, check to see if one has already been created. If there is currently an open issue, add a thumbs-up emoji to identify that it is also affecting you.

Your Environment

• Version: 1.8.0-1663094999-49ed2e69
• Affected Component: Access Gateway
• Affected Subcomponent: MME
• Deployment Environment: bare-metal (AGW)

Describe the Issue

After fresh installation of the latest AGW on virtualbox Ubuntu Server 20.04, mme kept crashing. After solving sanitizer issue with issue #15279, mme now crashes with the following error. Tried downgrading and upgrading protobuf, with no result.

May 15 04:53:03 magma systemd[1]: Started Magma OAI MME service.
May 15 04:53:03 magma mme[24380]: Initializing OAI Logging
May 15 04:53:03 magma mme[24380]: Initializing OAI Logging to syslog
May 15 04:53:03 magma mme[24380]: Initializing shared logging
May 15 04:53:03 magma mme[24380]: Initializing shared logging Done
May 15 04:53:04 magma mme[24380]: [libprotobuf FATAL /usr/include/google/protobuf/repeated_field.h:1514] CHECK failed: (index) < (current_size_):
May 15 04:53:04 magma mme[24380]: terminate called after throwing an instance of 'google::protobuf::FatalException'
May 15 04:53:04 magma mme[24380]: what(): CHECK failed: (index) < (current_size_):
May 15 04:53:04 magma systemd[1]: [email protected]: Main process exited, code=dumped, status=6/ABRT
May 15 04:53:04 magma systemd[1]: [email protected]: Failed with result 'core-dump'.
May 15 04:53:10 magma systemd[1]: [email protected]: Scheduled restart job, restart counter is at 41.
May 15 04:53:10 magma systemd[1]: Stopped Magma OAI MME service.
May 15 04:53:12 magma systemd[1]: Starting Magma OAI MME service...

To Reproduce

1. Install bare metal access gateway following the official guide.
2. Check mme status, see it's not starting
3. Fixed sanitizer issue with issue Endless AGW crashloop, mme exiting on start with Sanitizer CHECK failed #15279
4. Check mme status again, see this protobuf error.

Expected behavior

MME service to start without error.

Additional context

attached the syslog
syslog.zip

[maxthetor]

I also noticed this, but only after:
#bash agw_post_install_ubuntu.sh

[amarjargal]

I also noticed this, but only after: #bash agw_post_install_ubuntu.sh

Hi, did you manage to solve this issue?

[maxthetor]

not yet.
long live open5gs.