But I was on 7.2 that is why I wanted to upgrade to 7.4

Now on the wordpress I have 5.6.40. You are saying I have to update on the wordpress files first and just then upgrade to 7.4?

You could not do that directly from multi php 7.2 -> 7.4

Sorry to ask that because previously any upgrade on the php was just from the cpannel done from what I know