The Internal Revenue Service (IRS) does not allow you to borrow money from your Simplified Employee Pension Individual Retirement Account (SEP IRA) or to use it as loan collateral. However, the IRS permits you to roll money from your SEP IRA into another qualified retirement plan.