How the IRS Works

IRS building
The Internal Revenue Service headquarters are in Washington, D.C. Matthew Cavanaugh/Getty Images

Taxes are a sore spot for Americans. The United States was founded, in part, as a result of the revolt against what colonists considered unfair and exorbitant taxes. The rallying cry of "No taxation without representation!" fueled the ire of colonists and instigated the successful Revolutionary War against Britain. Yet, even Americans recognized that a government would find it difficult to survive without them. As the Founding Father Benjamin Franklin quipped, "Nothing in this world is certain, except death and taxes."

Even if people come to terms with the idea that paying taxes is one's civic duty, it's hard to appreciate a tax collector. This is why the U.S. government's tax collection agency, the Internal Revenue Service (IRS), isn't exactly the nation's most popular organization. When April rolls around and it's time to pay up, it's easy to imagine the IRS as a soulless agency that is out to suck you dry of your hard-earned income. However, it's good to keep in mind that Congress actually creates and enacts tax code (and extremely complicated tax code at that). The IRS simply enforces it.

Advertisement

­Nevertheless, one could argue that the agency's reputation isn't entirely unwarranted. The IRS doesn't have the cleanest history: It's been embroiled with corruption, undergone multiple reforms and still faces problems and controversy. To understand its storied past is to understand many of the difficulties inherent in tax collection and tax law itself.

Although taxes might be as certain as death, the U.S. federal government hasn't always found a need for a tax collection agency. In fact, it operated without one for some time. Now, the IRS pulls in trillions of dollars in revenue for the federal government each year and fights crime on the side, helping to attain convictions for notorious gangsters, among others. Before we find out how it does this, we'll take a look at the history of the IRS to see how this once unnecessary agency ballooned in scope and importance in a relatively short time.

Advertisement

IRS History: Beginnings

civil war surrender
President Abraham Lincoln pushed for the first (short-lived) income tax to help pay for the Civil War. This led to the Bureau of Internal Revenue. David Knox/Library of Congress via Getty Images

After gaining independence from Britain, Americans were wary of abusive taxes and didn't even grant the federal government authority to enforce taxation at first. Under the Articles of Confederation, the federal government could request taxes from states, but this was essentially voluntary. When this system proved to be ineffective, the framers of the U.S. Constitution made sure that that Congress could indeed "lay and collect" taxes.

But even then, it didn't require an agency to collect these taxes. The states were responsible for collecting federal taxes on goods like sugar, liquor and tobacco. For decades, Americans had to pay taxes on various domestic products (excise taxes), imports (custom taxes) and exports (tariffs), but didn't have to pay any portion of their incomes to the federal government.

Advertisement

This all changed with the onset of a national crisis: the Civil War. To pay for this war, President Abraham Lincoln pushed the nation's first income tax, along with high excise taxes, which Congress passed in 1861. Although modest by current standards, the 3 and 5 percent income tax on people with over $800 and $10,000 in annual income, respectively, meant an enormous increase in tax revenue. Enforcing and collecting so much tax required an entire agency, so this is how the first federal tax collection agency — the Bureau of Internal Revenue (BIR) — was born [sources: Treasury.gov, Tax History Museum].

This income tax that necessitated the BIR was short-lived, however. While taxpayers stomached steep taxes in wart­ime, tolerance dwindled after peace was restored. Taxes decreased significantly, and the income tax expired by 1872. Meanwhile, the BIR had shrunk, but stuck.

Some years later in 1895, Congress tried to pass an income tax again. But the Supreme Court quickly declared it unconstitutional because the Constitution only allowed direct taxes to be imposed in proportion to state population. Clamor to change this provision eventually won out, and in 1913, Congress passed the 16th Amendment, which says that Congress has the power to lay and collect taxes. Those who earned more than $3,000 were taxed at 1 percent.

Although it started small, the income tax dramatically grew in the coming years due to war and Congress's responses to drastic economic fluctuations. In addition, Congress also passed a tax on corporations during this period. This translated into an enormous increase in revenue that the BIR would be responsible for collecting.

Significant growing pains accompanied this unprecedented growth. The BIR was unprepared for the influx in responsibility it would face in the 20th century.

Advertisement

Federal IRS Growth, Corruption and Reform

Ever since the beginning of the Internal Revenue Service (IRS), taxpayers have suspected it of abusing its power, showing favoritism and invading privacy. In some cases, these accusations have been well-founded. Arguably, however, many of these problems stemmed from the difficult and unprecedented responsibilities Congress put on its shoulders.

As the nation shifted its focus toward Progressive reform politics, it brought fundamental change in the nature of tax law. Using taxes to support the "general welfare" of the nation no longer meant just funding defense and the costs of merely keeping a small federal government running. Now, taxes became an important factor in the health of the economy, curbing the influence of the rich — people and corporations — and redirecting that wealth to try to care for society's less fortunate. As taxes grew to meet these goals in this new wave of reform, the BIR soon found itself drowning in work.

Advertisement

Growth and increasing complexity in federal taxes before and during World War I led to many problems. The agency had to grow and organize its administration to interpret and enforce new tax legislation. The BIR quickly fell behind in processing the paperwork. Soon after the war, Congress scaled back taxes, but they were still significant. In the 1920s, a congressional investigation into the BIR found the sources of problems and also evidence of corruption within the agency.

­Insufficient regulations, a high staff turnover and increasingly complex tax legislation meant that the BIR was not living up to its responsibilities. In addition, the BIR became wrought with instances of favoritism and questionable practices on the part of its agents. Many pointed to suspicious hiring practices as a source of the problem, saying patronage — not merit — decided who got jobs there.

The BIR implemented some changes to counter the corruption uncovered in the 1920s. Significant reform, however, came in the 1950s. The BIR again struggled to handle increased taxes during World War II, and instances of corruption moved into the national spotlight soon after. Reforms purged the BIR of many officials, got rid of the patronage in hiring and dramatically decentralized the organization of the agency. To emphasize the change of focus as a service to the taxpayer, the agency changed its name to the Internal Revenue Service in 1953 [source: Treasury.gov].

Reforms didn't end there, however. Despite its efforts in the following decades, the IRS failed to sufficiently modernize and automate tax processing. Coupled with growing political animosity toward taxes and more revelations of corruption, this led to another reform effort in the 1990s. The resulting IRS Restructuring and Reform Act of 1998 reorganized the IRS establishing an oversight board and a Taxpayer's Bill of Rights [source: IRS]. Among other things, this Bill of Rights shifted the burden of proof — in some cases — to the IRS rather than the taxpayer when disputes arose.

Advertisement

The Organization of the IRS

The IRS is one of the largest federal agencies outside of the military and the U.S. Post Office. As of 2017, the IRS employed 76,832 people full time [source: IRS]. Although it might seem daunting to understand such a large organization, let's break down the structure of the IRS.

The IRS falls under the Department of the Treasury. The only two appointed positions in the IRS are the Commissioner of Internal Revenue and the Chief Counsel. The president appoints and the Senate confirms candidates for both of these roles. The Commissioner is the head of the IRS and serves a renewable five-year term. The Chief Counsel advises the IRS on legal matters, including interpreting and enforcing tax laws. A nine-member IRS Oversight Board is supposed to ensure that the agency is treating taxpayers fairly and reviews IRS plans, but as of 2019, the IRS Oversight Board has six open seats and has not operated since 2015 [source: Treasury.gov].

Advertisement

Since its reorganization in 2000, the IRS's responsibilities have been divided into four main operating divisions — rather than by geographic region as they were previously — to promote efficiency. These divisions are [source: IRS]:

  • Wage and Investment: Located in Atlanta, Georgia, this division is responsible for processing all 1040 individual income tax forms, which totaled more than 152 million in 2018 [source: IRS].
  • Small Business/Self-employed: An office in the D.C. metro area that addresses self-employed people and small businesses with $10 million or less in assets, a total of approximately 57 million taxpayers.
  • Large Business and International: This division, in Washington, D.C., deals mostly with corporations and partnerships whose assets total more that $10 million.
  • Tax-exempt and Government Entities: This division works with a variety of tax-exempt organizations including universities, pension plans, state governments, political organizations, nonprofit organizations and Native American tribal governments.

The four main divisions of the IRS handle things when all goes relatively smoothly. But, as you may know, this doesn't always happen. Because the tax code is so complex, confusion and disputes between taxpayers and the IRS happen all the time. For this reason, the IRS also manages the Office of Appeals, which attempts to provide an impartial resolution to tax disputes without having to go to court. In addition, the Taxpayer Advocate Office is an independent organization within the agency that offers free assistance to taxpayers with questions or problems.

And then there's the Criminal Investigation (CI) unit, which investigates violations of the tax code. It has also become involved in crimes seemingly unrelated to taxes because people must pay taxes on income, even when that income is illegally obtained. Although sly criminals might elude elite detectives, they find it more difficult to hide their riches. In recent years, the CI unit has invested more resources in identifying fraudulent returns filed by identity thieves including the Questionable Refund Program.

Advertisement

IRS Tax Enforcement

standing in post office line
Nicole Inocent (L) and Clayton Belmontes look through income tax forms at a post office during the last day for filing taxes April 15, 2002 in New York City. E-filing has made standing in post office lines less of an issue. Mario Tama/Getty Images

The IRS reports that in 2017 it processed 245.4 million federal tax returns, collected $3.4 trillion in revenue and handed out $437 billion in refunds. This is an enormous task, especially considering some people's reluctance to fork over money to the government.

So how does the IRS convince taxpayers to hand over hard-earned cash every year? As is the case with most laws, much of the tax system relies on people's willingness to voluntarily comply. Of course, employer withholding of income tax is one of the most effective tools, but fear of being audited and solicited by tax collectors helps ensure enforcement otherwise. The IRS estimates that 83.7 of taxpayers voluntarily comply with the tax laws and file their returns in a timely fashion.

Advertisement

An IRS audit is an examination of your tax records to make sure you paid all you owed. If the IRS selects you to be audited, it doesn't necessarily mean they suspect you of underpaying your taxes. The possibility of being audited, however, is a good reason to stay honest and make sure you keep good records — especially if you claim itemized deductions. A randomized computer selection determines who gets audited, but it isn't entirely random. Some people, including those who are self-employed or receive tips, are more likely to be selected [source: Daily].

That said, your odds of getting audited in person are extremely low, especially since the IRS workforce has shrunk almost 15 percent since 2012 [source: IRS]. In 2017, only 1.1 million (0.5 percent) of all returns were flagged for "examination" and only 309,000 resulted in in-person field audits. The other 750,000 were simply sent letters requesting more documents or clarification [source: IRS].

If you simply can't afford to pay your tax bill in April, file your return anyway and contact the IRS to set up a payment plan. If you don't, interest on your tax debt will start accruing daily and the IRS could put a lien on your assets and freeze your bank accounts until the debt is paid.

In any case, if you want to avoid problems with the IRS, take a look at the links on the next page and learn more about taxes.

Advertisement

Lots More Information

Related Articles

More Great Links

  • Daily, Frederick. "Why the Self-Employed Are Audit Targets." Nolo (April 3, 2019) https://www.nolo.com/legal-encyclopedia/tax-audits-target-self-employed-29498.html
  • IRS. "Enforcement: Examinations" (April 3, 2019) https://www.irs.gov/statistics/enforcement-examinations
  • IRS. "IRS Budget and Workforce" (April 3, 2019) https://www.irs.gov/statistics/irs-budget-and-workforce
  • IRS. "IRS Modernization" (April 3, 2019) https://www.irs.gov/newsroom/irs-modernization
  • IRS. "Returns Filed, Taxes Collected and Refunds Issued" (April 3, 2019) https://www.irs.gov/statistics/returns-filed-taxes-collected-and-refunds-issued
  • IRS. "SOI Tax Stats - Individual Income Tax Returns Publication 1304" (April 3, 2019) https://www.irs.gov/statistics/soi-tax-stats-individual-income-tax-returns-publication-1304-complete-report#_IndReturns
  • IRS. "The Tax Gap" (April 3, 2019) https://www.irs.gov/newsroom/the-tax-gap
  • U.S. Department of the Treasury. "Department of the Treasury." 2006 (April 3, 2019) https://www.treasury.gov/about/education/Documents/brochure%20(1).pdf
  • U.S. Department of the Treasury. "IRS Oversight Board" (April 3, 2019) https://www.treasury.gov/irsob/Pages/default.aspx

Advertisement

Loading...