Next to Ruben's answer, which disables all web apps, is it also possible to disable only the Monitoring web app (separate checkbox under Modules). There are also separate flags for Dashboards, Jobs, Ticketing, User-definable apps (Low-code apps).