Offsite backup fails with MaxBufferError

Hi Team,

I’m running into an issue on one of our servers where offsite uploads are failing with the following error (provider and bucket redacted for privacy)

2025-03-02T16:34:10.827Z	error	Error sending backup to offsite: MaxBufferError: Command failed: /opt/OttoFMS/bin/rclone copy /opt/FileMaker/FileMaker Server/Data/Backups/Weekly STORAGEPROVIDER:BUCKET/dbs -v --use-json-log --include **Weekly** --config /opt/OttoFMS/config/rclone.conf maxBuffer exceeded

Server is a 4-Core, 16Gb RAM server running on Ubuntu 22.04 LTS

The databases and external container data is around 160Gb in size, made up of just over 1 million files on disk

Any help getting this sorted would be appreciated

Cheers
James

Hey James,

Does the backup get partially pushed up? I can look into this, just trying to figure out if it is an issue with the actual pushing or just with the response being too large because there are so many files.

-Kyle

Hi Kyle,

The backup does get partially uploaded before erroring

Cheers
James

Additionally, the otto-info log contains 100,000’s of lines like the following, this causes Otto to freeze in the browser when trying to view the log. The log was about 1Gb on disk.

{"level":"info","msg":"Copied (new)","object":"Weekly_2025-03-02_2330/Databases/RC_Data_FMS/file_Data/Data/HazardItems/Image Hazard 3/IMG_5023_3.jpg","objectType":"*local.Object","size":106300,"source":"operations/operations.go:577","time":"2025-03-03T04:20:12.952912+13:00"}

yeah I suspect that the logged lines coming back are simply too long and are firing that error (which is then getting printed to otto-info since its an error). I’ll see about reducing the number of lines it logs there to avoid the issue. I can’t think of a great workaround for you right now other than not sending container data (which obviously is not ideal). We’re planning on releasing a new version in the next week or two, I’ll get this fix in that version.

-Kyle

Thanks Kyle, appreciate the quick responses as always

1 Like

Hey @jamesatdf ,

This issue should be fixed in OttoFMS 4.10.0. Let me know if you continue having any problems with that backup.

-Kyle

Thanks Kyle, will update now and let you know if we encounter any issues after the next run.

1 Like