Your insurance is also there to handle all legal matters on your behalf, not simply pay money to you when stuff breaks.
As such half the reason you pay them is to handle all these matters on your behalf.
Sure it saves you a quick buck to go direct, but also costs you plenty in time and effort, especially if they put a fight up and don't automatically admit liability.