In this case, it seems especially important whether the purported irreducible entropy is below human-level performance (in which case sufficiently scaled models would outperform humans, if the scaling laws holds up) or if they’re above human-level (in which case the constant loss isn’t irreducible at all, but betrays some limits of the models).
In this case, it seems especially important whether the purported irreducible entropy is below human-level performance (in which case sufficiently scaled models would outperform humans, if the scaling laws holds up) or if they’re above human-level (in which case the constant loss isn’t irreducible at all, but betrays some limits of the models).