It is not uncommon to experience genitofemoral nerve irritation as a result of the hernia. The nerve that supplies the sensation to the testicle is in the neighborhood of the area where the tear in the abdominal wall occurs. The local injury and inflammatory response can irritate the nerve resulting in vague testicular aching or irritation you can’t quite put your finger on.
In fact for some people they have this for quite some time before they develop a clinically evident hernia. It’s part of the reason they end up being sent to urologists and other specialists and the diagnosis gets missed for quite some time. Eventually the hole gets big enough that fat comes through and then the diagnosis is obvious.
The pain does not necessarily mean that material is going down into your testicle and causing irritation there.