Appearance of fungus, obvious separation of seams, caulking failure, swelling, delaminating, boards that no longer lay flat against your house, paint failure, moisture on the inside of your house, all could be signs of siding failure.