Do I need to have a work permit with an F-card?

No. The F-card is in effect your work permit. You have a right to work as a family member of an EU citizen domiciled in Belgium.
Obviously in the longer term it will probably be in your interests to obtain Belgian citizenship as you should qualify after living AND working here for five years.