Catch Floating Point Exception in PETSc with adjoint

[xiyuanbao]

Hi,
I am using ROL and firedrake to do adjoint calculation, and I encounter the floating point exception from PETSc randomly in long adjoint solves:

...
  Linear firedrake_1498_fieldsplit_0_ solve converged due to CONVERGED_RTOL iterations 37
[0]PETSC ERROR: ------------------------------------------------------------------------
[0]PETSC ERROR: Caught signal number 8 FPE: Floating Point Exception,probably divide by zero
[0]PETSC ERROR: Try option -start_in_debugger or -on_error_attach_debugger
[0]PETSC ERROR: or see https://petsc.org/release/faq/#valgrind and https://petsc.org/release/faq/
[0]PETSC ERROR: configure using --with-debugging=yes, recompile, link, and run
[0]PETSC ERROR: to get more information on the crash.
Abort(59) on node 0 (rank 0 in comm 0): application called MPI_Abort(MPI_COMM_WORLD, 59) - process 0

This problem can go away if I add small perturbations to the control variable, or use a fresh NonlinearVariationalSolver. But since the program aborts every time the FPE error happens, I will need to restart calculation manually.

I am wondering if it is possible to catch the exception in python and use try except to continue computation? Thank you very much!