Yes, it is an approximation, as noted at the start of that section:
If all eigenvalues of the Hessian are positive and non trivial,[3] we can approximate the loss as a paraboloid centered on our minimum:
Yes, it is an approximation, as noted at the start of that section: