If you don’t file, penalties start adding up right away . If you keep not filing, the IRS can file a return for you, decide what you owe, and start collecting — which can mean liens, wage garnishment, or a bank levy. Every one of those stages can be fixed.
Not filing does not blow up all at once. It moves through stages, and each stage takes time. That means there is almost always room to step in and change the outcome — even if the last return you filed was years ago.
Here is what actually happens, in order.
Stage 1: The penalties start
The moment a return is late, two separate penalties can start running.
The first is for not filing. The second is for not paying. They are different penalties with different rates, and the not-filing one is the more expensive of the two . That surprises people. Most assume the IRS cares most about the money. It cares more about the paperwork.
This is the reason for the single most useful rule in this whole area: file even if you cannot pay. Filing a return you can’t pay stops the bigger penalty from running. It does not create a new problem. If a balance is what you’re dreading, here is what actually happens when you owe the IRS money.
Interest is separate from penalties. It runs on the unpaid tax and it keeps running until the balance is gone.
Stage 2: The IRS notices
The IRS gets copies of your W-2s, your 1099s, your mortgage interest, your brokerage sales — all of it. That information keeps arriving whether you file or not.
When their records show income but no return, you’ll usually get a letter asking you to file. Sometimes several, months apart. This is the quiet stage. Nothing is being taken. Nobody is at your door. If you open the mail at this point and act, the problem stays small.
A lot of people don’t open the mail at this point. That is understandable, and it is also the moment where a small problem starts becoming a big one.
Stage 3: The IRS files a return for you
If you still don’t file, the IRS can prepare one on your behalf. It’s called a Substitute for Return (SFR) — a return the IRS builds from the income documents it already has.
Here is the important part: an SFR is almost always worse than the return you would have filed yourself.
The IRS builds it from the income side only. It generally does not include:
- Your business expenses, if you’re self-employed
- Your cost basis on stock sales (so a $40,000 sale can be treated as $40,000 of profit)
- Itemized deductions
- Credits you would have claimed
- The right filing status, if a better one applies
So the balance on an SFR is often far higher than the real number. People see that figure, panic, and assume it’s what they owe. It usually isn’t.
You can replace an SFR by filing your own actual return, even years later. The IRS will process it and adjust the balance. That single step has cut a lot of five-figure balances down to something much smaller — and sometimes to nothing.
Stage 4: The tax gets assessed
Assessment is the IRS formally putting the balance on your account. It’s a bookkeeping event, but it matters, because it starts a clock.
The IRS generally has 10 years from the assessment date to collect . That deadline is called the CSED (the last day the IRS can collect). Certain things — bankruptcy, an offer in compromise under review, time spent outside the country — can pause the clock and push the date later.
You’ll get a bill after assessment, then more notices, each with a firmer tone than the last.
Stage 5: Collection
If the balance sits unpaid, the IRS can begin enforced collection. In practice that means:
- A federal tax lien — a public claim against your property. It doesn’t take anything, but it attaches to what you own and can make selling or borrowing difficult.
- A wage garnishment — a chunk of every paycheck goes to the IRS. The IRS does not take a flat percentage. It leaves you an exempt amount based on your filing status and dependents, and takes everything above that.
- A bank levy — money is pulled out of your account.
- Your refunds — any future refund gets applied to the old balance.
Before a levy, the IRS has to send a specific notice giving you the right to a hearing. That notice is a deadline, not a threat — responding to it in time can stop the levy before it happens.
What if the IRS actually owes you money?
This is the part almost nobody talks about, and it costs people real money every year.
If you were owed a refund and you file too late, you don’t get it. There is a window to claim a refund — generally three years from the original due date of that return . Miss it, and the money stays with the Treasury. Permanently. There is no appeal, no hardship exception, no “but I didn’t know.”
Plenty of people who haven’t filed in years actually had refunds coming — because they had withholding from a W-2 job, or qualified for a refundable credit. They avoided filing because they assumed they owed. In some cases they were owed thousands, and the deadline quietly expired while they were afraid to open the envelope.
If any of your unfiled years might have been refund years, that is a reason to move now rather than later — not out of panic, just because that particular door closes on a schedule.
Is not filing a crime?
Almost always, no.
Failing to file is technically a misdemeanor under federal law, but the IRS handles the overwhelming majority of non-filers as a civil matter — penalties, interest, and collection. Criminal cases are reserved for deliberate, sustained evasion: hidden income, fake documents, active concealment.
Being behind because life fell apart is not what criminal enforcement is for. If you’re afraid to file because you think filing will trigger something, understand that the reverse is closer to the truth. Coming forward voluntarily is the thing that protects you. Waiting to be found is not.
Every stage is fixable
That’s not reassurance for its own sake. It’s the actual structure of the system:
| Where you are | What fixes it |
|---|---|
| Late, nothing filed yet | File the returns — that stops the bigger penalty |
| SFR filed against you | File your real return to replace it |
| Balance assessed, can’t pay in full | A payment plan, or hardship status |
| Balance you’ll never realistically pay | An offer in compromise, if you qualify |
| Penalties piled on top | Penalty relief, if you have a real reason |
| Levy or garnishment already started | It can usually be released once you’re in compliance |
The one requirement running through all of it: the IRS will not negotiate anything with you until your returns are filed. Filing isn’t the punishment. It’s the key that unlocks every option. See IRS back taxes help for how the options compare.
What to do next
- Write down which years you haven’t filed. Best guess is fine. You don’t need to be right yet.
- Pull your IRS transcripts. They show the income the IRS already has for each year — W-2s, 1099s, everything. This is how you rebuild records you no longer have.
- Check for refund years first. Those have a hard deadline and they expire.
- File the oldest required year first, and work forward.
- Deal with the balance only after everything is filed. A payment plan, hardship status, or penalty relief — none of it is available until you’re current.
If the pile feels too big to start on, that’s the normal reaction, not a personal failing. Luisa N. Victoria is a Federally Authorized Enrolled Agent, admitted to represent taxpayers before the IRS in all 50 states, and unfiled-year cases are routine work. Start at back taxes and unfiled returns, or book a free strategy session at 386-276-8535 and we’ll map out which years actually need to be filed.
