The company said that it will reduce prices of 4,000 items at its Amazon Fresh grocery stores online as well as at its brick-and-mortar locations.