Fidelity Investments on Tuesday said it was reviewing its relationship with money manager Ken Fisher and Philadelphia's board of pensions said it terminated its business with his firm after Fisher allegedly made disparaging remarks about women at a conference last week.