Minaj's "gold card" was just a "memento," a Commerce Department official said.