Infallibility of the Sovereign Pontiff

In the present state of affairs, many traditionalists see it as a viable solution to the mysterious situation in which we find ourselves regarding the apostasy of modernist Rome to simply diminish the dogma of the infallibility of the Sovereign Pontiff. After all, the modernist men on the throne of Peter have never invoked infallibility. Therefore, they say, we should have no problem considering them as true Vicars of Christ, all while disregarding everything they say and disobeying everything they ask from the faithful and the clergy. But is this Catholic?