Early Retirement and Social Security

UPDATE October 20, 2023: This post has been updated for the 2024 Social Security numbers.

I can’t retire early! I’ll destroy my Social Security!

Is that true? What happens to Social Security benefits when retirees retire early? Are significantly reduced Social Security benefits a drawback of the financial independence retire early (FIRE) movement? 

Below I explore how Social Security benefits are computed and the effects of retiring early on Social Security.

Social Security Earnings

Form W-2 reports to the government one’s earnings during the year. For the self-employed, the Schedule SE performs this function. The Social Security Administration tracks those earnings. 

Only a limited amount of earnings every year count as Social Security earnings. There is an annual maximum on the amount of earnings that can go on one’s Social Security record, regardless of the number of jobs one has. For 2024, the Social Security cap is $168,600. The cap is increased most years for inflation. Payroll taxes for Social Security (FICA for W-2 workers, self-employment taxes for the self-employed) are not due on earnings above the cap.

Social Security Benefits

A few very general rules need to be established as we consider the amount Social Security pays.

1. Only the highest 35 years of earnings during one’s working years count in determining Social Security benefits.

2. For most Americans reading this, full retirement age is 67. This means a person can collect his or her “full” Social Security benefits at age 67.

3. Social Security benefits can be collected as early as age 62 and can be deferred as late as age 70. Collecting early reduces annual benefits (by roughly 5 to 7 percent per year) and collecting late increases benefits (by 8 percent per year).

4. Annual earnings used in determining benefits are inflation adjusted through age 59. Earnings earned at age 60 and later are not inflation adjusted for purposes of computing Social Security benefits. 

5. Very roughly speaking, the annual benefit is computed as follows: accumulated earnings (computed based on the rules described above) in the high 35 years are summed and then divided by 35. The resulting average annual earnings are applied against the Social Security “brackets” or “bend points.” Up to $14,088 (using 2024 numbers) of computed average annual earnings is replaced by Social Security at a 90% rate. The next $70,848 of average annual earnings are replaced at a 32% rate. Any additional amount of average annual earnings is replaced at a 15% replacement rate. The bend points are adjusted for inflation.

One need not be an expert on Social Security to see directionally how early retirement might impact Social Security benefits. Because of the progressive nature of Social Security benefits, leaving work early (by conventional standards) tends to reduce benefits less than one might initially expect. Additional earnings later in life tend to only slightly increase Social Security benefits.  

Early Retirement Social Security Example

Here’s an example to help us understand the impact of an early retirement on Social Security benefits. 

Chuck is 55 years old and has 32 years of earnings recorded with Social Security. Those earnings, adjusted (thus, nominally increased) for inflation by Social Security, total $3,100,000 as of 2024. Divided by 35, they average $88,571. This means Chuck has filled the 90 percent replacement bend point (up to $14,088) and filled the 32 percent replacement bend point (from $14,088 to $84,936) of average annual earnings. If Chuck continues to work, his wages will be replaced at a 15 percent replacement rate by Social Security. 

If Chuck retires now and earns nothing more, his annual Social Security benefits, expressed in 2024 dollars, will look something like this at full retirement age:

Replacement Rate	Replaced Annual Income	Annual Social Security at Full Retirement Age
90%	$14,088	$12,679
32%	$70,848	$22,671
15%	$3,635	$545
Total	$88,571	$35,896

Note that I rounded each bend point’s calculation. With the cents Chuck gets in each bend point, his total is increased by almost a full dollar. Similar rounding applies to the examples below as well.

At age 67, Chuck’s annual Social Security will be $35,896 (expressed in 2024 dollars).

If Chuck continues to work for one more year at a $130,000 salary, and then retires his annual Social Security benefits at full retirement age, expressed in 2024 dollars, looks something like this:

Replacement Rate	Replaced Annual Income	Annual Social Security at Full Retirement Age
90%	$14,088	$12,679
32%	$70,848	$22,671
15%	$7,349	$1,102
Total	$92,285	$36,453

Interestingly, an additional year of work only increased Chuck’s annual Social Security benefit by $557. Why is that? Remember that every dollar earned is divided by 35 for purposes of computing Social Security benefits. You can see that Chuck’s replaced income increased by $3,714 (from $88,571 to $92,285). By earning $130,000 in 2024, Chuck increased his Social Security average annual income by $3,714, which is $130,000 divided by 35.

Multiplying the increase in replaced income ($3,714) by the replacement rate (15%) gets us the additional $557 in annual Social Security benefits. 

Okay, but what about three more years of earnings. Say Chuck can work for three more years at an average annual salary of $135,000. What result (in 2024 dollars) then? 

Replacement Rate	Replaced Annual Income	Annual Social Security at Full Retirement Age
90%	$14,088	$12,679
32%	$70,848	$22,671
15%	$18,920	$2,838
Total	$103,856	$38,188

Where I come from, $1,735 ($38,188 minus $36,453) in increased annual Social Security benefits at full retirement age is not nothing. But is it worth delaying retirement for three full years if one is otherwise financially independent? To my mind, probably not. 

Spousal Benefits

What if Chuck is married to Mary? How does that impact the analysis?

During Chuck and Mary’s joint lifetimes, it depends on whether Mary collects spousal benefits. If Mary has Social Security earnings of greater than 50 percent of Chuck’s Social Security earnings, she will likely collect benefits under her own earnings record, and not a spousal benefit. Thus, Chuck’s Social Security earnings will be irrelevant to the Social Security benefit Mary collects.

If, however, Mary’s lifetime Social Security earnings are less than 50 percent of Chuck’s, Mary is likely to collect a spousal benefit of roughly half of Chuck’s annual benefit. In this case, Chuck working 3 more years creates $2,603 of additional annual Social Security income ($1,735 for Chuck and $868 as Mary’s spousal benefit). Even $2,603 in additional annual income isn’t likely to justify Chuck working for three more years.

At Chuck’s death, assuming Chuck predeceases Mary, Mary will collect the greater of her own Social Security benefit or Chuck’s Social Security benefit. Thus, Chuck increasing his Social Security earnings could increase Mary’s Social Security benefit as a widow.

I’ve got a plan to save Social Security and Medicare.

Resource

Most people I know cannot tell you their Social Security earnings record off the top of their head. But, this information is accessible by creating an account at ssa.gov. From there, Americans can obtain their Social Security statement which includes their Social Security earnings (though the statement does not adjust those annual earnings for inflation). The 2024 factors to increase annual earnings for inflation can be found by entering “2024” in the search box at the bottom of this SSA.gov website.

Conclusion

There are many factors to consider before retiring early. It is helpful to understand how Social Security benefits are computed so early retirees can understand the potential impact of retiring on their Social Security benefits. 

FI Tax Guy can be your financial planner! Find out more by visiting mullaneyfinancial.com

Follow me on Twitter at @SeanMoneyandTax

This post is for entertainment and educational purposes only. It does not constitute accounting, financial, legal, investment, or tax advice. Please consult with your advisor(s) regarding your personal accounting, financial, legal, and tax matters. Please also refer to the Disclaimer & Warning section found here.