Yes you do have a problem. I find it interesting that the fruits have no damage. It would help diagnose the problem if they did. I think that you have one of three things going on. It could be Bacterial Spot, Bacterial Speck or Tomato Spotted Wilt Virus. All of these diseases are quite similar in their symptoms. It might be best for you to take a sample into your county extension office for an accurate diagnosis.
Tomato Spotted Wilt Virus -
http://vegetablemdonline.ppath.corne...pottedWilt.htm
Bacterial Speck -
https://pddc.wisc.edu/wp-content/blo...peck_of_Tomato.
Bacterial Spot -
http://hort.uwex.edu/articles/bacterial-spot-of-tomato/
Sadly I think that it is the Tomato Spotted Wilt Virus that you have. I do hope that I am wrong.