I don't know if Chamomile and Lady bugs have an affliction for each
other, if my chamomile has a ton of others bugs in it the lady bugs like
and that I can't see, or if I'm just lucky

If you can't find any insect pests (aphids, spider mites) using a hand lens or
magnifying glass, then I would venture a guess that they are there for the
pollen. Lady beetles do not subsist on other insects alone. I have never seen
chamomile listed as a plant that attacts them, but they do like plants with
white flowers (cosmos) so who knows.
sed5555