hey mako—sorry about the issues. i’m looking into it right now. will update asap
edit: looks like the EC2 instance hard crashed. i can’t even restart it from AWS console. i am starting up a new instance with more RAM.
edit2: confirmed via syslog (after taking a long time to restart the old server) it was OOM. new machine has 8x more ram. added monitoring and will investigate potential memory leaks tomorrow
hey mako—sorry about the issues. i’m looking into it right now. will update asap
edit: looks like the EC2 instance hard crashed. i can’t even restart it from AWS console. i am starting up a new instance with more RAM.
edit2: confirmed via syslog (after taking a long time to restart the old server) it was OOM. new machine has 8x more ram. added monitoring and will investigate potential memory leaks tomorrow