Ramaswamy was briefly a billionaire before a downturn in the stock market shrunk his wealth to just over $950 million, according to Forbes.