What to clean a fish tank with?

You don't need to throw away the filter or gravel. Just get a gravel cleaner. It will suck up the dirt, clean the gravel and remove water for a good water changed. It will help remove some fungus there might be left.