When a boiler or furnace shuts off, the flow of oil is expected to cease instantly via a valve inside the appliance. However, when this valve stops working correctly due to sticking or being unable to close fully, oil will leak into the combustion chamber and cause a buildup.