People may not realize they will be subject to IRMAA until they receive their Medicare notice, potentially causing financial stress. IRMAA is calculated using your income from two years prior, meaning even if your income drops in retirement, you might still be subject to the surcharge.