Can we buy a house with an FHA loan if MLS listing says possible financing is CONV and ICON?

You can make an offer to purchase under any terms, it is up to the seller to determine if your terms are acceptable (not the listing).