Whoa!! First, you NEVER take your money OUT of your IRA until absolutely necessary — because that will incur taxes! And you’ll lose all future tax-deferred growth.
BUT, your husband could ask his “advisor” to sell HALF of his stock funds and move them to a money market mutual fund INSIDE his IRA. That would involve no taxes and maybe he could sleep better at night. And he would still have some exposure to stocks to offset future inflation.
By the way, it’s called an INDIVIDUAL Retirement Account for a reason. You make your own decisions! He cannot and should not be telling you what to do with your own account. And your advisor should not take direction from him about YOUR account!