OttoFMS and AWS Instance Crash

General
1

On a low use server ( a couple files and < 10 users ), we had an AWS instance go down shortly after starting a migration. Not 100% sure where to start with this one.

Migration started at 10:07 AM Eastern.
Server reported down by user, at 10:13 AM.
After reboot and clean consistency checks, the migration resumed automatically ( we attempted to abort it, but no response ).
Instance shutdown again.
Started server, force restarted OttoFMS to kill the migration that was still showing as running.

FMS: 20.3.2
OttoDeploy: 4.10.3
File Size: 200 MB
AWS Instance: c7g.xlarge ( 4 cpu, 8 GB RAM )

otto-info.log.zip (2.7 KB)

2

Hey Josh,

Here are some clues

msadmin command LIST FILES -s failed with error: Command failed with exit code 9: /opt/FileMaker/FileMaker Server/Database Server/bin/fmsadmin LIST FILES -s -u ********** -p ******** Server/Database Server/bin/fmsadmin: Permission denied. Error: 9 (Access denied),

These errors are a sign of a busted FileMaker Server Admin server, and or Filemaker command line tool.

You will want to restart the FileMaker Server Admin Service, and if that doesn’t help, restart the server, and if that doesn’t work, you may need to re-install FileMaker Server. You can test it by simply running

fmsadmin -v -u ********** -p ******** in the terminal.

If it is still broken you will get this.

Server 20
Copyright (c) 1994-2024 Claris International Inc. All rights reserved.

/opt/FileMaker/FileMaker Server/Database Server/bin/fmsadmin: Version 20.3.2

/opt/FileMaker/FileMaker Server/Database Server/bin/fmsadmin: Permission denied.
Error: 9 (Access denied)

However I don’t think that should crash your server. Did you let the FileMaker server install a swap file, when you installed it. Because if not, that would cause a crash pretty quickly.

You can check if there is one with.

sudo swapon --show

(No output means no swap file)

Todd

3

Well, there should be a swap file on this server… but I see there is not. That’s fixed. I’ll monitor this server tonight when I rerun the migration. A little surprised there wasn’t already a swap file on this server, all the other servers have one set up ( I know because I did it myself LOL ).

Anyway, thanks Todd.

4

Make sure you test for that error 9 problem. If that is still there your migration will fail.

Todd

1 Like
5

@jormond new install on Linux asks if you want to do a swap file but not as far as I know on Win (which I presume this is)
I think that was because its easier to do there???

1 Like
6

My statement wasn’t 100% accurate. There was a swap file, it was just really really tiny. All of the other servers have the swap file.

7

As expected, a properly sized swap file helped solve the problem.

1 Like