Will withdrawals from my individual retirement account affect my Social Security benefits?
Social Security does not count pension payments, annuities, or the interest or dividends from your savings and investments as earnings. They do not lower your Social Security retirement benefits.
See What Income Is Included in Your Social Security Record for more information.